Copying large amount of data to a NFS mounted directory.

[Mark Hoensheid]

I am running HPUX 11.11 on a L2000 box. We are looking to copy or mv a large number of data/files daily to a NFS mounted directory to another HPUX system. The cp right now takes about 3 Hrs. and I was wondering what the best way to cp just the files that have changed on a daily basis. This would help tremendously....

Thanks in advance...

[James R. Ferguson]

Hi:

My first thought is to leverage the incremental backup capabilities of 'fbackup'.

You could "collect" the updated files inot a directory of choice with 'frecover' and then copy only the "recovered" files. Something like:

# cd /realdir
# fbackup -1 ???i . ???f - | (cd /tempdir; frecover ???Xsrf

Have a look at the 'fbackup' man pages for more information.

Regards!

...JRF...

[Darren Prior]

Hi,

Here's an alternative to James' neat solution, this time using cpio:

You'd need to touch -t the file /tmp/nfsbackup with an appropriate time before you first used it.

cd /dir2backup
find . -newer /tmp/nfsbackup | cpio -pdmulv /backupdest
touch /tmp/nfsbackup

regards,

Darren.

[James R. Ferguson]

Hi (again):

Sorry, I dropped part of the command. It should be:

# cd /realdir
# fbackup -1 ???i . ???f - | (cd /tempdir; frecover ???Xsrf -)

...JRF...

[Mark Hoensheid]

Thanks James & Darren for your suggestions.

I think the CPIO will work just fine. I am running a test right now to see which will be quicker.

I couldn't get fbackup going to a mounted nfs directory before? I didn't spend a whole lot of time on it though..

Thanks again...

[Steven E. Protter]

Another probably inferior suggestion.

set $TmpDirList to location to check

set DAYS to 1 for anything modified in the last day.

find ${TmpDirList} -type f -mtime +${DAYS} -print > /tmp/filelist

You can read the filelist in a script and cpio tar your files into a backukp.

SEP

[Ed Mitchell_1]

fbackup -n to cross nfs mount points

[A. Clay Stephenson]

Plan C. Use rdist. It will take care of most of the decisions on which files need updating automatically. Man rdist for details.