Operating System - HP-UX
1745924 Members
4149 Online
108723 Solutions
New Discussion

Re: IA64 HP superdome server SD32B slow performance

 
SOLVED
Go to solution
Mohandas
Occasional Advisor

IA64 hp superdome server SD32B slow performance

 

Dear All,

 

   We have a superdome and we are running billing application for a telco company, we notice the server is running slow during billing process are running. Some suspect there is flaw in kernel parameters something like filecache parameter. Please advice us how to fine tune the system. Thanks.

 

 

lonsum01:/ # uname -a
HP-UX lonsum01 B.11.31 U ia64 0779768182 unlimited-user license

 

lonsum01:/ # machinfo
CPU info:
  8 Intel(R) Itanium 2 9100 series processors (1.6 GHz, 18 MB)
          533 MT/s bus, CPU version A1
          12 logical processors

Memory: 32635 MB (31.87 GB)

Firmware info:
   Firmware revision:  9.48
   FP SWA driver revision: 1.18
   IPMI is supported on this system.
   BMC firmware revision: 26.03

Platform info:
   Model:                  "ia64 hp superdome server SD32B"
   Machine ID number:      2e7a5176-9eaa-11de-bede-93f4816f1c99
   Machine serial number:  SGH4931071

OS info:
   Nodename:  lonsum01
   Release:   HP-UX B.11.31
   Version:   U (unlimited-user license)
   Machine:   ia64
   ID Number: 0779768182
   vmunix _release_version:
@(#) $Revision: vmunix:    B.11.31_LR FLAVOR=perf

 

 

11 REPLIES 11
Dennis Handly
Acclaimed Contributor

Re: IA64 HP superdome server SD32B slow performance

What does "swapinfo -tam" show?

What do you have for filecache_max(5) & filecache_min(5)?

Do you have glance/gpm installed?  Any networking or I/O bottlenecks?

Is your application multithreaded?

Mohandas
Occasional Advisor

Re: IA64 HP superdome server SD32B slow performance

 

Hi Dennis,

 

   Thanks for the respond, at this moment there is not much process are running, so the CPU and Memory Usage is below threshold. Anyway i'll give the output of the follwoing command. Hope it helps

 

 

 

Glance is installed.

 Not sure how to to get the output of filecache_min ? please give the commands.

Yes, there is I/O bottleneck for disk, saw that with "sar -d 1 5" command.

When i checked  "kcusage -h maxfiles_lim", its 100% used, does this contribute some problem ?

 

 

 

lonsum01:/ # swapinfo -tam
             Mb      Mb      Mb   PCT  START/      Mb
TYPE      AVAIL    USED    FREE  USED   LIMIT RESERVE  PRI  NAME
dev       32768       0   32768    0%       0       -    1  /dev/vg00/lvol2
reserve       -   20843  -20843
memory    31042   19798   11244   64%
total     63810   40641   23169   64%       -       0    -

 

 

lonsum01:/ # kcusage
Tunable                 Usage / Setting
=============================================
filecache_max      2203631616 / 3254961356
maxdsiz             532037632 / 1073741824
maxdsiz_64bit       147259392 / 4294967296
maxfiles_lim             4096 / 4096
maxssiz                196608 / 134217728
maxssiz_64bit          786432 / 268435456
maxtsiz              35868672 / 100663296
maxtsiz_64bit       218103808 / 1073741824
maxuprc                   415 / 3780
max_thread_proc           448 / 1200
msgmni                      2 / 4200
msgtql                      0 / 4200
nflocks                    25 / 4200
ninode                   1922 / 95648
nkthread                 2939 / 14716
nproc                     908 / 4200
npty                        0 / 60
nstrpty                     4 / 60
nstrtel                     0 / 60
nswapdev                    1 / 32
nswapfs                     0 / 32
semmni                     32 / 4200
semmns                   4696 / 8400
shmmax             4615913472 / 16106127360
shmmni                     14 / 512
shmseg                      3 / 300


lonsum01:/ # kcusage -h maxfiles_lim
Tunable:        maxfiles_lim
Setting:        4096
Time                           Usage      %
=============================================
Thu 08/18/11 14:30 MAL          4096  100.0
Thu 08/18/11 14:35 MAL          4096  100.0
Thu 08/18/11 14:40 MAL          4096  100.0
Thu 08/18/11 14:45 MAL          4096  100.0
Thu 08/18/11 14:50 MAL          4096  100.0
Thu 08/18/11 14:55 MAL          4096  100.0
Thu 08/18/11 15:00 MAL          4096  100.0
Thu 08/18/11 15:05 MAL          4096  100.0
Thu 08/18/11 15:10 MAL          4096  100.0
Thu 08/18/11 15:15 MAL          4096  100.0
Thu 08/18/11 15:20 MAL          4096  100.0
Thu 08/18/11 15:25 MAL          4096  100.0

Mohandas
Occasional Advisor

Re: IA64 HP superdome server SD32B slow performance

We are using OBRM Billing application.
Dennis Handly
Acclaimed Contributor

Re: IA64 HP superdome server SD32B slow performance

>Glance is installed.

 

Try running it when your system slows down.

 

>Not sure how to to get the output of filecache_min?

 

kctune filecache_max filecache_min

 

>When I checked  "kcusage -h maxfiles_lim", its 100% used, does this contribute some problem?

 

It might if some program is hitting that limit and spinning trying to handle that error?  Why not increase it?

 

memory    31042   19798   11244   64%
total     63810   40641   23169   64% 

 

No problems now.

 

lonsum01:/ # kcusage
Tunable                 Usage / Setting
filecache_max      2203631616 / 3254961356
maxfiles_lim             4096 / 4096

Mohandas
Occasional Advisor

Re: IA64 HP superdome server SD32B slow performance

 

Below is the output of the parameter :

 

lonsum01:/ # kctune filecache_max
Tunable             Value  Expression  Changes
filecache_max  3254961356  10%         Imm (auto disabled)

 

lonsum01:/ # kctune filecache_min
Tunable             Value  Expression  Changes
filecache_min  1627480678  5%          Imm (auto disabled)

 

 

How to check the above parameters whether its enough or otherwise ?

 

Any system impact in increasing filecache_max ? how much do you suggest ?

 

Any  way to find those processes thats consuming high CPU,Memory and Disk I/O  in the system ?

 

Cheers :)

 

 

 


 

Dennis Handly
Acclaimed Contributor
Solution

Re: IA64 HP superdome server SD32B slow performance

>Below is the output of the parameter :
filecache_max  3254961356  10%

filecache_min  1627480678  5%

>How to check the above parameters whether its enough or otherwise?

 

They don't see to be too too large.

 

>Any system impact in increasing filecache_max?

 

We don't know if that's a problem yet.

 

>Any way to find those processes that's consuming high CPU, Memory and Disk I/O  in the system?

 

That's what gpm does best.  Run it when it slows down.

Mohandas
Occasional Advisor

Re: IA64 HP superdome server SD32B slow performance

 

We  will try increase the filecache_max, filecache and maxfiles_lim parameter and monitor the system performance for now. Thanks for your advice.

Dennis Handly
Acclaimed Contributor

Re: IA64 HP superdome server SD32B slow performance

>We  will try increase the filecache_max, filecache

 

Careful, these may do the wrong thing and I would suggest you get data from glance before you do these two.

Pete Randall
Outstanding Contributor

Re: IA64 HP superdome server SD32B slow performance

I would suggest you start up Glance before you experience problems.  It could be difficult to start it up when your system is already under stress.


Pete