Copy with SCP - low performance

Christopher Ness nesscg at mcmaster.ca
Tue Mar 30 01:18:25 UTC 2004


On Mon, 2004-03-29 at 18:04, Horacio Reyes wrote:
> I am using scp to copy large amount of small files between 2 servers
> with a firewall in the middle, but the copy takes all CPU, this is the
> situation:
> 
> - The files are copied in batch of 100 tif images, in a directory with
> more than 5 million files.

Do you have the diskspace to make a tarball and optionally compress the
tarball before sending?

I'm not sure if it's the small files or the firewall that is causing
your slow transfer.  If it's the number of files this could be a
solution.

Cheers,
Chris
-- 
Software Engineering IV,
McMaster University
PGP Public Key: http://nesser.org/pgp-key/

20:16:31 up 10:55, 3 users, load average: 0.57, 0.42, 0.25 

Please avoid sending me Word or PowerPoint attachments.
See http://www.fsf.org/philosophy/no-word-attachments.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
URL: <http://listman.redhat.com/archives/fedora-list/attachments/20040329/e882627c/attachment-0001.sig>


More information about the fedora-list mailing list