multi-threaded rsync or rcp with large gzip file

[Chern Jian Leaw]

Hi,
I'm wanting to transfer a huge gzip file i.e. approximately 6GB over the WAN. I would like to initiate a multi-threaded rsync or rcp for this single gzip file to be transferred.

Is there a way which I can "split" such large gzip file to be transferred with multiple threads/connections?

Could someone kindly help me out?

Thanks

[Stefan Farrelly]

Im not aware of any way of doing this. I think you will have to transfer it in one go. Use ftp - its more reliable and faster than rcp.

[Systeemingenieurs Infoc]

imho, you could "split" (man split) the files, and then "cat" them back in 1 piece after the transport.

prealloc testfile 1000000
split -b 100k testfile testfile.
ls testfile.*|
while read fname
do
rcp $fname machineB:$fname &
done

after it is done you can exec
remsh machineB cat testfile.*>testfile

if you want to wait in your script for the rcp's to finish, you can user pid[$fname]=$!
and then use wait pid[$fname] in a for loop.

hecou