topic Re: moving large files in Operating System - HP-UX

moving large files

matthew mills — Mon, 25 Oct 2004 13:32:17 GMT

I am trying to move large files “directory” from one HPUX 11.00 server to another HPUX 11.00 server. I have tried using NFS but it is way to slow. I am now trying to use FTP to move them but I can only move one file a time. I can not zip up the files because I do not have the space to store such a large file. I need to do this on several directories. Is this the best method? What is wrong with this script? Here is my script:

ftp -n 55.55.55.55 <<-EOF | tee ftplog
user mickey mouse
binary
hash
cd /
mget /oradata
bye
E

Re: moving large files

Slawomir Gora — Mon, 25 Oct 2004 13:35:58 GMT

Hi,

you can use rcp.

Re: moving large files

Thierry Poels_1 — Mon, 25 Oct 2004 13:36:12 GMT

Hi,

customize this one to your needs:

find . | cpio â ocB | compress | remsh server2 â cd /dir; uncompress | cpio â icvdumBâ

good luck,
Th

Re: moving large files

Rodney Hills — Mon, 25 Oct 2004 13:38:26 GMT

One technique I use is tar, compress, and remsh.

tar cf - . | compress -c | remsh myremote "zcat - | ( cd /tmp ; tar xf - )"

You can use ssh instead of remsh also.

This bundles up the files via tar, then compresses the data (for less data traffic across network), uncompresses on the remote server, and then untar.

HTH

-- Rod Hills

Re: moving large files

Thierry Poels_1 — Mon, 25 Oct 2004 13:39:34 GMT

Re: moving large files

John Poff — Mon, 25 Oct 2004 13:40:11 GMT

Hi,

The problem is that ftp transfers files and not directories.

I've done this before using 'rcp'. You'll need host equivalence setup between the two servers (.rhosts). I used it to move several hundred gigabytes of Oracle files between systems and it worked just fine. Something like this should work:

rcp -pr host1:/oradata .

I'd suggest testing it with some small files and directories first to make sure it behaves like you expect.

JP

Re: moving large files

Rick Garland — Mon, 25 Oct 2004 13:42:05 GMT

Can use the dump utility. I find it faster than tar/cpio

/usr/sbin/vxdump 0f - /dev/vgXX/lvYY | remsh '(cd /; /usr/sbin/vxrestore -rf -)'

Re: moving large files

Prashant Zanwar_4 — Mon, 25 Oct 2004 13:42:26 GMT

NFS mount the files DIR to the client server and do a copy. That shall be possible.

Thanks
Prashant

Re: moving large files

matthew mills — Mon, 25 Oct 2004 13:42:53 GMT

thanks