topic Best way to copy directories with big files (>8GB) in Operating System - HP-UX

Best way to copy directories with big files (>8GB)

noldi — Mon, 04 Oct 2004 10:59:11 GMT

Hello,

What is the best way to copy directories around
with large files (bigger than 8GB) on HP-UX 11.00
onwards on vxfs with largefiles support?
I would like to preserve
devs/links/perms/owner/times, etc.
All of tar/pax/cpio utilies seem to have
file size restrictions that prevent OOTB
operation and leave the big files behind.

Thank's & best Regards,
Arnold Sutter

Re: Best way to copy directories with big files (>8GB)

Prashant Zanwar_4 — Mon, 04 Oct 2004 11:04:48 GMT

I would say cpio or pax.

pax -rw olddir newdir

find . -xdev -print | cpio -pdmuv /targetdir

This shall be taking care of your query.
Also you can use fbackup, frecover combination for faster copy.

Thanks
Prashant

Re: Best way to copy directories with big files (>8GB)

A. Clay Stephenson — Mon, 04 Oct 2004 11:04:54 GMT

Fbackup/frecover is probably your best bet although it is HP-UX specific.

Re: Best way to copy directories with big files (>8GB)

Steven E. Protter — Mon, 04 Oct 2004 11:11:52 GMT

If you have network connectivity between the boxes, openssh/secureshell can do the job without size limitations.

http://software.hp.com/portal/swdepot/displayProductInfo.do?productNumber=T1471AA

scp -pr source destination

That will try to preserve permissions and do a recursive copy.

SEP

Re: Best way to copy directories with big files (>8GB)

noldi — Mon, 04 Oct 2004 11:12:35 GMT

pax seems to have 2 personalities,
cpio and ustar. Both seem to leave
big files behind (similar to vanilla
tar). Especially, files larger than
8GB were not copied.

On the other hand, fbackup/frecover
could be an alternative.

I usually use this command:
"cd /from; tar cf - . | (cd /to; tar xpf -)"

How would this command be translated
to fbackup/frecover?

Thank's again & Regards,

Arnold

Re: Best way to copy directories with big files (>8GB)

Rick Garland — Mon, 04 Oct 2004 11:32:53 GMT

If you are going to use cpio, get the GNU version. You won't have to worrt about files greater than 2GB

Re: Best way to copy directories with big files (>8GB)

Geoff Wild — Mon, 04 Oct 2004 12:07:24 GMT

How about with vxdump/vxrestore?

If between servers, then you would have to nfs mount.

Example:

vxdump -0 -f - -s 1000000 -b 16 /export/usr/sap/trans | (cd /mnt/usr/sap/trans ; vxrestore rf -)&

Rgds...Geoff

Re: Best way to copy directories with big files (>8GB)

lawrenzo — Mon, 04 Oct 2004 15:37:28 GMT

I looked into this and the following could be used:

fbackup -f /dev/rmt/x

There are several options that can be used so check out the man pages

use frecover to retrieve the data.

Also sam has a backup utility which uses fbackup.

hope this helps

Re: Best way to copy directories with big files (>8GB)

Sundar_7 — Mon, 04 Oct 2004 16:07:39 GMT

Try this Arnold,

# cd /target
# fbackup -vf - -i /source1 | frecover -rXvf -

Re: Best way to copy directories with big files (>8GB)

noldi — Tue, 05 Oct 2004 05:59:11 GMT

Thanks to all who replied.

The following command worked for us with
reasonable performance, regardless of file
size:

# cd /source
# fbackup -f - -i . | (cd /dest; frecover -rXf -)

Best Regards,

Anrold Sutter