SCP the big file <80 GB [Urgent]

[bruceedgar]

Hi Gurus

I need to transfer the tar file which is in size of 80GB from one unix server to another using SCP . After 100% completion its giving error file size too large , please give a short and faster why to transfer it.

[spex]

How about ftp or nfs? But depending on the cause of the error, these may fail as well. If the destination filesystem is vxfs, are large files enabled? Is there enough free space?

[bruceedgar]

Hi
Thanks for your quick reply , There is no error its bcas of zise only it gets failed , I dont have facility to do ftp and nfs activities.

[Sandman!]

If the source and destination devices are on the same array (and I'm assuming that you are on a high-end array subsystem like XP) you could use back-end storage utilities to move the data from one device to another i.e. go thru the HBA instead of the NIC. Make sure that your destination device has enough room, largefiles is enabled etc.

~hope it helps

[A. Clay Stephenson]

Since you seem to be saying that scp is your only option, then to avoid having to retry the entire file, I would:

On source host:
split -b 1024m mybigfill /aaa/bbb/mbf

This will split your 80GiB file into 1GiB files /aaa/bbb/mbfaa, /aaa/bbb/mbfab, /aaa/bbb/mbfac ...

Now scp these /aaa/bbb/mbf* files to the destination host.

On destination host:
cat /aaa/bbb/mbf* > mybigfile

Man split for details. Split will avoid the all your eggs in one basket problem.

[rick jones]

I think that spex's question about large files being enabled still stands - is the target filesystem of the scp configured to allow large files? Have you tried say a local dd of /dev/random to create an 80 GB file in the target filesystem to make sure it can take an 80 GB file?

[boomer_2]

hi,
U check out as rick said on target machine whether largefilesystem option is enabled or not...by
mksf -m /filesystem command...and then try....