Copy 50GB data

[hp_user_1]

Hello,

I need to copy 50GB of data from one file system to another on the same 7410 server running 11iv1. Both file systems are in DMX3, but in different LVM volume groups. I tried cp, but after copying ~2gb it became extremely slow (~3MB/min). I know cpio, rsync, tar, etc. are available, but need advice.

We also tried backup and restore with NetWorker and it took almost 15 hours, which is unacceptable to the customer.

Points will be awarded.

Thanks

[hp_user_1]

Hi,

Like to add some more info.

I tried with "cp -rp source destination" and was able to copy 2gb in about 2 hours. There were two instances where cp copied ~900MB in 2 minutes, otherwise the speed range was between 2MB and 10MB most of the time.

Thanks

[Venkatesh BL]

Did you try 'dd'? It may be faster. Try with a sample file first.

[Mark McDonald_2]

Is the 50Gb all of the data? If so, why not mirror it on the frame? Make the 2nd file system a BCV of the first?

[hp_user_1]

The BCV copy is not an option. Also this is one time requirement.

Only option available is to copy it at the OS level, as NetWorker is too slow. cp gets slower overtime, don't know why. I changed certain parameters on the destination fs with vxtunefs, but not luck.

Thanks

[TTr]

> I tried cp, but after copying ~2gb it became extremely slow (~3MB/min)
> 2gb in about 2 hours...
> cp copied ~900MB in 2 minutes

This fluctuation in your copying process may be the result a several scenarios
1. You may have soft or hard read/write errors that only manifest in certain times or disk areas. Check the server logs for any errors. Look for SCSI errors (lbolt) or read errors. Check your source copy area for read errors and your target copy area for write errors using dd commands.
2. Your LVM volumes/filessytems have hot i/o spots. This depends on the LV and PV layout on your server as well as the LUN setup in the disk array.
3. Your server may be running our of resources after the copying starts. Check you memory usage, disk and swap utilization etc. Use glance if you have it or top, sar, swapinfo etc.

[sujit kumar singh]

hi


can u give a try to fbackup / frecover using s config file!!!!!


regards
sujit

[Steven E. Protter]

Shalom,

Options:

1) scp -rp via the NIC card. That should not slow down.
2) Connect the arrays and use array utilities. (Not an option on the 7410 I think)
3) fbackup, carry the tape, frecover

SEP

[hp_user_1]

The source and destination file systems are both on the same server...

[Peter Nikitka]

Hi,

I think there is no much of tuning possible, when the two LVs do already exist.
Is the data you want to copy the whole content of the filesystem?

Always possible:
cd Parentdir
find dir | cpio -pud /target/directory

Whole filesystem:
cd /target/directory
vxdump 0f - /file/system | vxrestore xf -

mfG Peter