package upload/import speed

[Toshio Kuratomi]

Mike Bonnet wrote:
> On Wed, 2008-07-23 at 15:56 -0400, Naveen Gavini wrote:
>> Hello all,
>>
>> When importing or building RPM's from source is there an option that is 
>> throttling the upload speed of the package?
>> We are seeing speeds of 10kbps which makes importing/building large 
>> packages very slow.
> 
> Package upload happens via xml-rpc, and to avoid holding the entire
> contents of the file in memory, it's done in chunks.  Unfortunately
> python xml-rpc libs don't support keep-alive, so if you're using SSL
> authentication you incur the non-trivial SSL connection setup/teardown
> overhead for every chunk, in addition to the TCP connection
> setup/teardown.  The chunk size in your version is probably very small
> (64k?).  That has been increased in the Koji repo, but not released yet.
> The next version will improve this situation somewhat.
> 
Any chance we could port to pycurl which does support keep-alive?  Or is 
urllib pretty deeply embedded in the code ATM?

-Toshio

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 197 bytes
Desc: OpenPGP digital signature
URL: <http://listman.redhat.com/archives/fedora-buildsys-list/attachments/20080723/60d49f48/attachment.sig>