1834013 Members
1922 Online
110063 Solutions
New Discussion

Kernel Tuning HP 5470

 
BLADE_1
Frequent Advisor

Kernel Tuning HP 5470

RP5470
HP UX 11.00
Dual CPU-750MHz
RAM 4GB
SWAP 8GB
RAID5
OS MIRRORED
Application - SAP4.0B 32 bit
Database - Oracle 8.0.5 64bit

Hi All,

We have shifted to this new server this week. I want to tune the kernel parameters accordingly. At present the parameters are same as that of our old system which had 2 GB Ram and 3 GB Swap.

parameter original changed

maxfiles 512 1024
dbc_pct_max 50% 10%
shmmax 2147483648 3221225472
maxtsiz_64bit 1073741824 2147483648
maxdsiz_64bit 17179869184 2147483648

After changing these parameters the system memory was exhausted and the application stalled.

I have attached kmtune file with this message..
thanx in advance..

rgds
nainesh


fortune favours the brave
12 REPLIES 12
Pete Randall
Outstanding Contributor

Re: Kernel Tuning HP 5470

I might as well say it before everyone else does:

The first thing you need to do is reduce your dbc_pct_max to something more like 10% 2%.

Pete

Pete
BLADE_1
Frequent Advisor

Re: Kernel Tuning HP 5470

dear pete,

I had done that...if u see in my message, that was one of the values i changed. i want to know which of these values might have resulted in the system memory problem. I couldn't even execute SAM.

To add to the changes..
i had also changed
maxfiles from 512 to 1024

rgds
nainesh..

fortune favours the brave
Ian Dennison_1
Honored Contributor

Re: Kernel Tuning HP 5470

SAP Note 85838

SAP 40B (32 bit) is only supported with Oracle 8.0.6 (64 bit). Oracle 8.0.5 (64 bit) requires SAP 40B (64 bit) on HP-UX.

Are you using Shared Memory Magic executables for SAP (HPUX_64 on sapserv?)

Share and Enjoy! Ian
Building a dumber user
BLADE_1
Frequent Advisor

Re: Kernel Tuning HP 5470

you r right we need to upgrade to 40b 64 bit..That we will be doing this weekend..migrate to Oracle 8.1.7 64bit and SAP 40B_com 64 bit.

No we are not using Shared memory Magic exe's...Should we?

nainesh
fortune favours the brave
Pete Randall
Outstanding Contributor

Re: Kernel Tuning HP 5470

Sorry, nainesh - I completely misread it.

:^(

Pete

Pete
Ian Dennison_1
Honored Contributor

Re: Kernel Tuning HP 5470

Nainesh,

If you are upgrading to 64 bit SAP soon then you will probably not need to use Shared Memory Magic (it use the memory quadrants slightly differently to fake having more memory than a 32 bit application would normally have).

Has anything changed on the Application levels (did you upgrade to 64 bit Oracle?) or did you just transfer the Application to the new Server?

My first place to look would be swap, to see if there is enough (remember the SAP rule of thumb - 3 x memory plus 500MB?)

Can you post a 'swapinfo -ta', and some 'vmstat' output?

Hope this helps, Ian
Building a dumber user
BLADE_1
Frequent Advisor

Re: Kernel Tuning HP 5470

dear Ian,

We did a System Copy and upgraded Oracle from 32 to 64 bit.

nothing has changed at application level..

Attached file..meminfo

rgds
nainesh
fortune favours the brave
Ian Dennison_1
Honored Contributor

Re: Kernel Tuning HP 5470

Nainesh,

Thats a lot of po (page outs) happening, for not a lot of memory used.

I am thinking that there might be a memory leak somewhere.

ipcs -ma
this will show the size of the Oracle SGA in memory (it should not have changed after the upgrade but won;t hurt to check).

ps -eafl
This will list all processes and their size (Column SZ). We sometimes have a problem with mib2agt running away with memory; check for any abnormally large SZ values.

Share and Enjoy! Ian
Building a dumber user
BLADE_1
Frequent Advisor

Re: Kernel Tuning HP 5470

hmm..

Oracle SGA is around 770M..

There are some high values i SZ between 8000-21000 but all are taken up for SAP processes.

rgds
nainesh
fortune favours the brave
Bill Hassell
Honored Contributor

Re: Kernel Tuning HP 5470

The parameters:

>> maxfiles 512 1024

This value is a soft value for users and can be changed using ulimit in the standard POSIX shell, but it has no effect on the kernel since it is simply a fence or limit to the number of files that can be opened by a single process.

>> dbc_pct_max 50% 10%

This is a good change. 10% for a 2Gb RAM system is 200 megs, about right for the buffer cache. However, running Oracle and SAP in 2Gb is strangling the applications! You need a minimum of 4Gb and ideally 6-8Gb for reasonable performance.

shmmax 2147483648 3221225472

For a 64bit application, this is fine and like maxfiles, has no effect on the kernel as it is a fence for the maximum shared memory size that can be obtained. For 32bit applications, it is meaningless since the maximum value allowed is 960megs (or 1750 megs for shared MAGIC executables). These 32bit executables are allowed to use an additional quadrant for shared memory--but that shared memory is part of a single shared memory area that ALL 32 bit applications must share.

>> maxtsiz_64bit 1073741824 2147483648

Do you really have an executable file that is 2000 megs in size? maxtsiz is the text or non-data area of the program and is fairly close to the size of the executable file itself. Most programs are just a few megs in size unless they have millions of lines of code. Like maxfiles and shmmax, this has no effect on the kernel as it is simply a fence. You can change it back or leave it as is.

>> maxdsiz_64bit 17179869184 2147483648

Another fence value. Was the original value actually 17Gb? This is no problem for a 64bit program but if usewd by a 64bit program, could cripple the tiny RAM you have in this machine. The new 2Gb value is more reasonable BUT I would add another 3-6Gb of temporary swap space to see if things start working. If so, processes will run extremely slowly since pageouts will be very high (indicating that you need a lot more RAM).

Oracle and SAP need enormous amounts of virtual memory for installation (8 to 10Gb). Since HP-UX is a virtual memory system, you can run 10 Gb of processes in 2Gb of RAM but you'll need at least 8Gb of swap space, 12Gb of swap space if you have swapmem_on=0. Swapping (paging) is a very bad thing for performance, but if you have lots of time on your hands and no money for RAM, then swapping is your only choice. Note that Oracle and SAP do NOT need dozens of Gb of swap space after they are loaded. The vendor docs fail to mention this and can be verified by running: swapinfo -tam

Be sure to get a copy of shminfo (as mentioned in many previous posts to the ITRC):

ftp://contrib:9unsupp8@hprc.external.hp.com/sysadmin/programs/shminfo/

Also mentioned is that ftp:\\ has a big bug in many version of IE (no problems in Netscape or Opera or lynx). Turn OFF folder view in IE using the Advanced options in Tools->Internet.


Bill Hassell, sysadmin
Ian Dennison_1
Honored Contributor

Re: Kernel Tuning HP 5470

Nainesh,

Have had a quick look at the OS Dependencies for SAP, and they recommend shmmax of 1,073,741,824. While it may not have an impact, I would still change it back from 2GB which it is set at now (SAP can be funny about these things).

Apart from that, I cannot see what could be going wrong. I can post a copy of our kernel config for our N Class with similar memory / CPUs if you wish. I have checked your parameters against these and cannot see any major differences. Are you patched up to the latest level?

A thought just occurred to me (Bill may be able to clarify this) that if it is paging out so much, kernel limits may be being reached before physical memory limits. Does the results of 'top' show a similar amount of memory free as the swapinfo?

Cheers, Ian Dennison
Building a dumber user
BLADE_1
Frequent Advisor

Re: Kernel Tuning HP 5470

dear bill,

Yesterday i had reverted back to the original setting and the system is working fine now..

Is it recommended to set the shmmax to 75-80 % of the toto physical ram. Our server has 4GB RAM and 8 GB Swap..If u see the vmstat output there is lot of free memory and still lot of paging..I think this is because of the SAP profile settings, i guess i have to fine tune those..

I think Ian is also right on this front...

We will be upgrading to 64 bit kernel for SAP and do some stress testing and fine tune both kernel and SAP parameters this weekend..

Thanx a lot guys..

cheers
nainesh
fortune favours the brave