- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Re: untar become slow after untarring 160000 files
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 07:19 AM
тАО04-09-2009 07:19 AM
System HP-UX 11.00 model n4000-44 with 4gb physical memory and two cpu @440Mhx.
Problem. When untarring a archive that contains more tha 160000 files it start to slow down after the 160k mark.
cpu usage is @ 80% then lower down to less than 20%. IO check show that it remain the same trough the whole process. Avwait 5 avserve less then 0.5.
command use to untar is tar xvf "file.tar"
Any idea why? Beside IO constrains.
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 07:25 AM
тАО04-09-2009 07:25 AM
Solutionhope this helps
UNIX because I majored in cryptology...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 07:33 AM
тАО04-09-2009 07:33 AM
Re: untar become slow after untarring 160000 files
Pete
Pete
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 07:44 AM
тАО04-09-2009 07:44 AM
Re: untar become slow after untarring 160000 files
Just a thought. check the patch level of tar. You might be using old version of tar.
#swlist -l patch |grep -i tar
Ganesh.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 08:15 AM
тАО04-09-2009 08:15 AM
Re: untar become slow after untarring 160000 files
Regardless of whether you are extracting a single file or not, 'tar' will read from the beginning of its archive until the end. That is, even if the file to be extracted is satisfied at the very beginning, 'tar' keeps reading (and potentially extracting again) until the end of the archive is reached!
Regards!
...JRF...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 09:55 AM
тАО04-09-2009 09:55 AM
Re: untar become slow after untarring 160000 files
Just as an ls command will be slow in a directory with that many files.
The reason why we can create sub directories is to avoid situations where simple operations like ls or your tar xvf will slow down to a crawl.
This is simply a fact of life for the OS, which is of course out of support. Same thing would happen with other OS' and newer versions of HP-UX.
SEP
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-09-2009 08:39 PM
тАО04-09-2009 08:39 PM
Re: untar become slow after untarring 160000 files
Not if these other OSes implement each directory as a btree or some such, like MPE/iX.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-10-2009 11:57 PM
тАО04-10-2009 11:57 PM
Re: untar become slow after untarring 160000 files
PHCO_20028 1.0 Cummulative tar(1) patch
PHCO_29229 1.0 Cumulative tar(1) patch.
But if it is limited due to the numebr of file it rying to extracts , why does the tarring is not affected? Just want to know if there is a different in archiving and extracting?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-11-2009 12:15 AM
тАО04-11-2009 12:15 AM
Re: untar become slow after untarring 160000 files
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-11-2009 12:25 AM
тАО04-11-2009 12:25 AM
Re: untar become slow after untarring 160000 files
That's the last tar patch for 11.00.
>if it is limited due to the number of file it trying to extracts, why does the tarring is not affected?
As asked above, where is it putting all of those files? In same directory?
>Just want to know if there is a different in archiving and extracting?
Extracting has to get the OS involved in allocating space and directory entries. But archiving only has to find and copy the data.
>also will adding more resources like memory help?
It depends on where the problem is. What does "swapinfo -tam" and glance show when you have this slowdown?
You may also want to try this on a supported HP-UX version to see if it has the same problem.