- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Copying the filesystem
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 04:26 AM
тАО05-17-2008 04:26 AM
Copying the filesystem
I have a filesystem of 27 GB which contains lot of tiny files which is 2 KB .
I know the copying will take long time . Suggest me the best and fast method for copying ? cpio / tar / dd / rsync?
Regards
AK
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 05:50 AM
тАО05-17-2008 05:50 AM
Re: Copying the filesystem
pipeline, but with 27GB you'd probably need
to use a better "tar" than the standard
HP-UX "tar". GNU "tar" should work. Add
compression, if the CPUs are faster than the
network.
For some examples (and excessive discussion),
try a forum search for:
tar pipeline
or:
tar pipeline rsync
If both ends are HP-UX, and you're doing the
whole file system, then vxdump+vxrestore may
be a better choice. Are there ACLs (or any
other OS-specific data) to preserve (which
"tar" may not do)?
Experiment is the most reliable way to
determine which method is fastest.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 06:49 AM
тАО05-17-2008 06:49 AM
Re: Copying the filesystem
> I know the copying will take long time . Suggest me the best and fast method for copying ? cpio / tar / dd / rsync?
Question:
Copying from where to where?
If it is from a local file system to local file system, then
cp -p -R
If it is from a local file system to a nfs mount point, then
tar -cvf /largefs/ALLFILE.TAR ./
gzip -S .Z /largefs/ALLFILE.TAR
cp /largefs/ALLFILE.TAR.Z
We can many other scenarios, please clarify what scenario is yours!
revert!
kind regards
Yogeeraj
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 08:03 AM
тАО05-17-2008 08:03 AM
Re: Copying the filesystem
dd if=/dev/vgsrc/rlvolsrc of=/dev/vgtrgt/rlvoltrgt bs=32768k ,
otherwise cpio or rsync. Rsync is the best if you need to synchronize file systems daily/weekly.
HTH
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 09:18 AM
тАО05-17-2008 09:18 AM
Re: Copying the filesystem
I have around small txt and html files for around 27 GB . So i started copying thru cpio but the data copying speed is less than a GB/hr .
Please let me know the inputs.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 09:43 AM
тАО05-17-2008 09:43 AM
Re: Copying the filesystem
For why this may be a very bad idea, try that
forum search suggested earlier.
> tar -cvf /largefs/ALLFILE.TAR ./
> gzip -S .Z /largefs/ALLFILE.TAR
> cp /largefs/ALLFILE.TAR.Z
If you have unlimited space for the (totally
unnecessary) temporary files. (And ".Z" is
normally used with "compress", ".gz" with
"gzip". Why work so hard to add potential
confusion?)
> We can many other scenarios, [...]
Are all your suggestions as clever as these?
> Rsync is the best if you need to
> synchronize file systems daily/weekly.
Is that what's happening here?
> [...] i am movinng the data from the old VG
to new VG .
On one system? Local disks or network?
"less than a GB/hr" sounds pretty slow to me,
and I'm accustomed to old, weak junk.
> So i started copying thru cpio [...]
How, exactly? (Actual command(s)?)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-17-2008 10:11 AM
тАО05-17-2008 10:11 AM
Re: Copying the filesystem
i have used the below command ..
find . -depth -print | cpio -pdlmv destination path
The above command copied 170 GB data in 18 hrs and due to the lack of time i have stopped coyping the data .
Again i have started copying the remaining 30 GB using the rsyn and it took 12 hrs still the data copying is not completed .
There are lot of tiny files of 1 KB size which rounds up to 30 GB.
After 12 hrs of copying iam still left with 6 GB data out of 30 GB
Regards
AK
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-18-2008 01:15 AM
тАО05-18-2008 01:15 AM
Re: Copying the filesystem
In the case when you need to copy your data to a new destination once, dd is the best, you can copy either all disk or only one logical volume. My experience with rp3440 and internal disk gives 45 minutes for 73 GB
HTH