1833323 Members
2879 Online
110051 Solutions
New Discussion

Re: moving large files

 
SOLVED
Go to solution
matthew mills
Frequent Advisor

moving large files

I am trying to move large files “directory” from one HPUX 11.00 server to another HPUX 11.00 server. I have tried using NFS but it is way to slow. I am now trying to use FTP to move them but I can only move one file a time. I can not zip up the files because I do not have the space to store such a large file. I need to do this on several directories. Is this the best method? What is wrong with this script? Here is my script:

ftp -n 55.55.55.55 <<-EOF | tee ftplog
user mickey mouse
binary
hash
cd /
mget /oradata
bye
E
8 REPLIES 8
Slawomir Gora
Honored Contributor

Re: moving large files

Hi,

you can use rcp.
Thierry Poels_1
Honored Contributor

Re: moving large files

Hi,

customize this one to your needs:

find . | cpio â ocB | compress | remsh server2 â cd /dir; uncompress | cpio â icvdumBâ

good luck,
Th
All unix flavours are exactly the same . . . . . . . . . . for end users anyway.
Rodney Hills
Honored Contributor
Solution

Re: moving large files

One technique I use is tar, compress, and remsh.

tar cf - . | compress -c | remsh myremote "zcat - | ( cd /tmp ; tar xf - )"

You can use ssh instead of remsh also.

This bundles up the files via tar, then compresses the data (for less data traffic across network), uncompresses on the remote server, and then untar.

HTH

-- Rod Hills
There be dragons...
Thierry Poels_1
Honored Contributor

Re: moving large files

hmmmz, what's that??? :(

second try:

find . | cpio -ocB | compress | remsh server2 "cd /dir; uncompress | cpio -icvdumB"

or with tar & gzip:

tar -cvhf - . | gzip -c | remsh server2 "cd /dir; gunzip -c | tar xvf -"

good luck,
Thierry Poels.
All unix flavours are exactly the same . . . . . . . . . . for end users anyway.
John Poff
Honored Contributor

Re: moving large files

Hi,

The problem is that ftp transfers files and not directories.

I've done this before using 'rcp'. You'll need host equivalence setup between the two servers (.rhosts). I used it to move several hundred gigabytes of Oracle files between systems and it worked just fine. Something like this should work:

rcp -pr host1:/oradata .

I'd suggest testing it with some small files and directories first to make sure it behaves like you expect.

JP
Rick Garland
Honored Contributor

Re: moving large files

Can use the dump utility. I find it faster than tar/cpio

/usr/sbin/vxdump 0f - /dev/vgXX/lvYY | remsh '(cd /; /usr/sbin/vxrestore -rf -)'
Prashant Zanwar_4
Respected Contributor

Re: moving large files

NFS mount the files DIR to the client server and do a copy. That shall be possible.

Thanks
Prashant
"Intellect distinguishes between the possible and the impossible; reason distinguishes between the sensible and the senseless. Even the possible can be senseless."
matthew mills
Frequent Advisor

Re: moving large files

thanks