Copy with SCP - low performance

Florin Andrei florin at andrei.myip.org
Wed Mar 31 03:52:36 UTC 2004


On Mon, 2004-03-29 at 15:04, Horacio Reyes wrote:
> 
> I am using scp to copy large amount of small files between 2 servers
> with a firewall in the middle, but the copy takes all CPU, this is the
> situation:
> 
> - The files are copied in batch of 100 tif images, in a directory with
> more than 5 million files.

If you only need to copy them once, tar them up first (perhaps with gzip
as well), then scp.

If you need to copy them often, and not all the images change from last
copy, rsync over ssh is the answer.

-- 
Florin Andrei

http://florin.myip.org/





More information about the fedora-list mailing list