- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- HP-UX 11.11, wc -l on a BIG ASCII File is slow and...
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:07 PM
тАО02-16-2011 12:07 PM
HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
Today, on one of our few remaining HP-UX servers - we experienced (and continue to) weirdness with doing file reads specifically "wc -l" on "large files".
For instance, a 1GB File with ~12 million lines completes a "wc -l" process in over 30 minutes! Whilst runing - Glance shows the process is waiting on Cache.
sar -b (read stats shows varying 90 to 100 % stats)
Server in question is a SD vPar with 48GB of RAM, dbc_max of 10% (4.8GB Buffer Cache).
This only started happening today. And the size of the files (1 to 20 GB) being processed by a sort and wc -l process is no different than the previous years this system has been in existence.
Is there a known and rare cache coherency bug in 11.11? Is it time to allocate more Buf Cache? TLB issues perhaps since this is a vPar? Our other 11.11 Systems that are at the same rev of OS are not suffering the same issue and have even signifcantly smaller Caches.
The only change the server had undergone in recent days were new vPars having been carved. This particular server has been up for 10 days. New vPars were created a few days ago.
We've a case with HP and we've yet to receive any clues from them.
Wanted to try a "sync" but...
TIA!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:20 PM
тАО02-16-2011 12:20 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
Using the buffer cache for wc(1) on huge files isn't a particularly good idea, unless you want to do this several times in a row. And if you did, you should cache the previous size and lines and only read the new data at the end.
As to sort, it may be more helpful.
Unfortunately you don't have much user control.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:24 PM
тАО02-16-2011 12:24 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
I know -- shell utilities are cache centric / cache crazy and these files are new files so virgin reads. I've suggested to them in the past to use Perl or even C code to open the file cacheless or force direct io but change just is difficult to effect in a long stable system.
Still awaiting word from HP to see if there are other measures apart from a platform reboot.
Any other ideas?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:29 PM
тАО02-16-2011 12:29 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
Could you consider copying the file(s) in question to a mountpoint where you can disable the buffer cache (i.e mounting with 'mincahce=direct,convosync=direct')?
Regards!
...JRF...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:33 PM
тАО02-16-2011 12:33 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
Lot better but nowhere near the normal filesystem.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:48 PM
тАО02-16-2011 12:48 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
You may have run into a kind of ultraviolet cachestrophe (catastrophe). :-)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-16-2011 12:58 PM
тАО02-16-2011 12:58 PM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
This based on some file read routines (that uses the cache) I've done so far.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-18-2011 06:38 AM
тАО02-18-2011 06:38 AM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
One possibility I am looking at is to do a platform reboot. The SUperdome is one big nPar with many vPars. And the only recent change done was a couple of vPars was carved whilst this particular vPar was running.
I am suspecting Memory Locality or Fragmentation occured and could be alleviated by a platform reboot so all vPars wil be freshen'ed up..
Far out Crazy?
I've no other ideas 'cept to wait for HP to come up with other findings and thoeries.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-18-2011 06:55 AM
тАО02-18-2011 06:55 AM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
> The only change the server had undergone in recent days were new vPars having been carved. This particular server has been up for 10 days. New vPars were created a few days ago.
Then, as you suggested, if you can reboot, it seems like it might be informative. Perhaps before hand, HP Support might want to have a forced dump?
Regards!
...JRF...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-23-2011 07:03 AM
тАО02-23-2011 07:03 AM
Re: HP-UX 11.11, wc -l on a BIG ASCII File is slow and is in "Cache Wait"
The reboot of this affected server was originally meant to increase buffer cache allocation to address the cache wait issue (but nary an evidence exist in sar -b stats) as suggested and concurred by HP. After the cache addition the issue was actually worse. We went from ~ 5GB of cache to 20GB - as the hope is our 3 to 10GB files will have "ample" cache. BUt it turns out it was more of an issue as the OS is now agressive at caching everything and I/O simply went through the roof!
We've since brought it back and things appear to have returned to normal -- although another change was actually discovered (and that is thee was a erduction in I.O paths to the disks making up the lvol/.filesystem where these large files being sorted/wc'd reside)...