- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Re: Excessive page-outs, even after memory upgrade
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО12-31-2009 06:57 PM
тАО12-31-2009 06:57 PM
Re: Excessive page-outs, even after memory upgrade
Just out of curiosity, were you using secure path in contention with native load balancing provided in 11.31.
vxfsd is online jfs, I don't suppose you have any contention with raw logical volumes and online jfs file systems?
Since this is a HW product, HP will have to take full responsibility. Stop sweating it and throw it back as incompaitible / bugged.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 11:19 AM
тАО01-05-2010 11:19 AM
Re: Excessive page-outs, even after memory upgrade
--------------
If you are only using 24% of physical memory you do not have any pageouts.
You might have pageins which are ok but not pageouts. You may be misunderstanding the output of the vmstat memory report. You will not get pageouts unless you are low on memory and all of it is used.
--------------
I absolutely seeing seeing pageouts. Thousands per second, on a system with a low memory load but a very high I/O load.
Quote:
--------------
You might want to increase the amount of filecache_max
--------------
It's currently set at 10%, which is 3.2GB. Since the size of the transaction files that are being applied here seldom exceed 500MB, and the actual filecache size is hovering around 2.8-3GB depending on the time of day. Does it make sense to increase it when it isn't using everything it's already allowed to use?
Quote:
-------------
How is your oracle databases setup. JFS filesystem, RAC with CFS or Raw Lvs ?
-------------
Oracle data files on VXFS running over LVM on an EVA.
Quote:
-------------
These are separate/opposite. You could be up to 30% IO wait.
-------------
Yes, that's what I was describing. The CPU can't go past 70% because it's sitting around waiting on I/O.
Quote:
-------------
How do you know the page-outs are for these processes?
-------------
I don't know, that's what I'm trying to find out: what are the page-outs, and are they significant?
Quote:
-------------
Just out of curiosity, were you using secure path in contention with native load balancing provided in 11.31.
-------------
Interesting question, I wasn't aware SecurePath even ran on 11.31, we're using the native multipath I/O.
We aren't using any raw volumes, everything is on a filesystem. Is vxfsd known to become a bottleneck in heavily laden systems?
Quote:
-------------
Since this is a HW product, HP will have to take full responsibility. Stop sweating it and throw it back as incompaitible / bugged.
-------------
This statement confuses me. Are you suggesting I box it up and send it all back? Where do I transfer my workload?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 11:41 AM
тАО01-05-2010 11:41 AM
SolutionSo with 0 actual swap used and high page outs -- it sounds to me that you've got high file cache utilization, causing a large amount of dirty page pushout. (Clean pages wouldn't register as pageouts nor cause I/O -- they'd just get dropped). Increasing your file cache might help to some extent -- but at the rates you're talking about it sounds more like you have workloads chewing through and dirtying significantly more memory than your file cache. Still -- since you say you're only 25% utilized, it certainly would be worth a shot to raise filecache_max and let those dirty pages stay in the cache longer.
And just to settle that topic -- pseudo-swap never, ever gets any time of page-out. Remember that it is an accounting trick at the reservation layer, not some sort of device. The pageout mechanism simply proceeds through the pageable set -- and anything that is all reserved from pseudo-swap gets skipped in consideration, anything partial will be considered but if the actual swap allocation fails, the pager daemon moves along.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 11:48 AM
тАО01-05-2010 11:48 AM
Re: Excessive page-outs, even after memory upgrade
Thank you!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 12:01 PM
тАО01-05-2010 12:01 PM
Re: Excessive page-outs, even after memory upgrade
I think my question has been answered, thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 12:03 PM
тАО01-05-2010 12:03 PM
Re: Excessive page-outs, even after memory upgrade
Did you mention how much swapdisk you set up?
Can you provide the output for the following:
vmstat -nS 1 10
sar -v 1 10
swapinfo -tam
I'm also curious about parm values. You mentioned you have 32Gb mem and filecache_max set to 10%. What are the values for:
filecache_min
ninode
vx_ninode
Semmaphore parm values
shmmax (you mention 4Gb, could you post the exact value)
maxdsiz
/rcw
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 12:40 PM
тАО01-05-2010 12:40 PM
Re: Excessive page-outs, even after memory upgrade
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 12:41 PM
тАО01-05-2010 12:41 PM
Re: Excessive page-outs, even after memory upgrade
for standby databases which I presume are just doing redo apply (essentially a slow synchronous write as the redo arrives over the network followed by a faster synchronous read as the redo is applied, one wonders whether you are gaining much by using the filesystem cache at all for the redo log and archive redo log filesystems...
if you have online jfs you might want to try mounting those filesystems configured for direct io only (filesystem mount options mincache=direct,convosync=direct) and see if that changes anything... you could event try the filesystems with the datafiles as well (oracle doesn't usually benefit that much from filesystem cahce)
HTH
Duncan
I am an HPE Employee
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-05-2010 01:02 PM
тАО01-05-2010 01:02 PM
Re: Excessive page-outs, even after memory upgrade
The DBA's just shut down the instances to fiddle with something, so I don't have anything valid to give you for vmstat, sar, or swapinfo.
The rest:
filecache_min 1632595968 Default Auto
ninode 8192 Default
vx_ninode 0 Default Immed
shmmax 8192000000 8192000000 Immed
maxdsiz 1073741824 Default Immed
maxdsiz_64bit 4294967296 Default Immed
shmmax was increased from 4GB on a recommendation from Oracle.
Michael, I'll get something when they restart the databases.
Duncan,
There are three standby instances on this machine. One is a true standby that receives transactions from the primary asynchronously and applies them directly to the database.
The other two receive transaction logs from other machines via FTP, and then apply them directly to their respective standby instances. There are no redo or archive logs on this particular system, and the transaction logs are dumped onto the same filesystem as the standby database.
- « Previous
-
- 1
- 2
- Next »