package upload/import speed

[Oliver Falk]

Mike Bonnet wrote:
> On Wed, 2008-07-23 at 15:56 -0400, Naveen Gavini wrote:
>> Hello all,
>>
>> When importing or building RPM's from source is there an option that is 
>> throttling the upload speed of the package?
>> We are seeing speeds of 10kbps which makes importing/building large 
>> packages very slow.
> 
> Package upload happens via xml-rpc, and to avoid holding the entire
> contents of the file in memory, it's done in chunks.  Unfortunately
> python xml-rpc libs don't support keep-alive, so if you're using SSL
> authentication you incur the non-trivial SSL connection setup/teardown
> overhead for every chunk, in addition to the TCP connection
> setup/teardown.  The chunk size in your version is probably very small
> (64k?).  That has been increased in the Koji repo, but not released yet.
> The next version will improve this situation somewhat.

Just wanted to write the same...

Naveen, you could increase your blocksiize as a workaround. Just search 
for blocksize in /usr/bin/koji (function do_import)... I've done that 
here and it helps. BUT do not set to too large, as for every chunk some 
checksum (it seems) is being build (SSL does that I think) and the 
larger your chunk the more CPU resources it will use!!!

-of