Operating System - HP-UX
1748081 Members
5118 Online
108758 Solutions
New Discussion

Re: filecache Utilization is very high on RX2660

 
Shibin_2
Honored Contributor

Buffer Cache Utilization is very high on RX2660

I have RX2660 server HP-UX Base OE ( 11.31 ); so no glance software available.

 

I have noticed that VM utilization is always 84% and above, but swap and memory utilization is below 30%.

 

             Mb      Mb      Mb   PCT  START/      Mb
TYPE      AVAIL    USED    FREE  USED   LIMIT RESERVE  PRI  NAME
dev        8192     210    7982    3%       0       -    1  /dev/vg00/lvol2
reserve       -     866    -866
memory    11667    3523    8144   30%
total     19859    4599   15260   23%       -       0    -

 

 

Below output taken on 1st of October.

 

      |          |      Sec  |Cache Mem   |     User |           |    Active |

Date        |  Time  |/Intvl |      Hit % |     Mem %|     Swap %|     VM %  |

                                   

10-01-12    |13:10:00|  300.0|      100.00|     30.75|      41.00|      83.90|

10-01-12    |13:15:00|  300.8|      100.00|     30.75|      41.00|      84.38|

10-01-12    |13:20:00|  300.0|      100.00|     30.75|      41.00|      84.23|

10-01-12    |13:25:00|  299.3|      100.00|     30.75|      41.00|      83.95|

10-01-12    |13:30:00|  300.0|      100.00|     30.75|      41.00|      84.19|

 

 

This system is using as Data Protector Cell server.    System has 12GB memory with 8GB Swap space configured. 

 

What could be the problem?  What's the solution?  Appreciate your valuable inputs.

Regards
Shibin
15 REPLIES 15
Dennis Handly
Acclaimed Contributor

Re: filecache Utilization is very high on RX2660

(I assume you mean filecache for 11.31.)

 

>Below output taken on 1st of October.

 

What produced this output?  And did the swapinfo occur at the same time?

 

>What could be the problem?

 

Why do you think there is a problem?  Something not working or slow with the system?

Shibin_2
Honored Contributor

Re: filecache Utilization is very high on RX2660

Hi Dennis,

 

Thanks for the response.  Yes.  This is HP-UX 11.31 BASE OE ( no glance available ) with Sept 2010 patch level.

 

The given report is taken from perf ( using OVPA extract tool ).   As you can see here, Cache memory and Virtual memory in its peak and the monthly performance report is ( graph ) is giving very bad report.

 

Any possible solution ?  I am thinking a patch level update; but I do not have relevent evidence to convey that patch update will resolve the issue.

 

Thanks in advance.

 

Regards
Shibin
Dennis Handly
Acclaimed Contributor

Re: filecache Utilization is very high on RX2660

>monthly performance report is (graph) is giving very bad report.

 

Again, why do you think this is bad?

Shibin_2
Honored Contributor

Re: filecache Utilization is very high on RX2660

It's DP cell server.   When all backup trigger during night time ( server time is CET ), Data Protector GUI becomes crawling. 

 

That's the simplest way I can explain.

Regards
Shibin
Dennis Handly
Acclaimed Contributor

Re: filecache Utilization is very high on RX2660

>Data Protector GUI becomes crawling.   That's the simplest way I can explain.

 

That's, that's more useful info.

 

Anything else running on the server?  You may need more memory.

Can you get the vmstat(1) output?  Are the po/pi values high?

Shibin_2
Honored Contributor

Re: filecache Utilization is very high on RX2660

Paging is very low level all the time. 

 

         procs           memory                   page                              faults       cpu
    r     b     w      avm    free   re   at    pi   po    fr   de    sr     in     sy    cs  us sy id
    2     0     0   325629  497473    0    0     7    1     0    0     0  37262  22620  8316   9  3 88
    2     0     0   325629  497242    0    0     4    0     0    0     0   1605  31237   272  20  3 77
    2     0     0   334296  497233    0    0     2    0     0    0     0   1594  32423   338  27  1 72
    2     0     0   334296  497217    0    0     0    0     0    0     0   1599  25125   344  27  0 73
    2     0     0   334296  497265    0    0     0    0     0    0     0   1621  19222   339  11  0 89

 

It's very strange, I think, and just virtual memory is high.  There are no other applicaiton installed other than Data Protector and HP OVO tools.

 

I am going to extract another report for this month to see the activity.  System has currently 12GB memory and suggestions came to add another 8GB.  However, I need to re-consider that option because if additional memory is not giving expected output, then the expenditure made will be in question.

Regards
Shibin
Dennis Handly
Acclaimed Contributor

Re: filecache Utilization is very high on RX2660

>Paging is very low level all the time.

 

Then it isn't a memory bottleneck.

 

>Data Protector GUI becomes crawling

 

What's crawling?  GUI updates?

Or backup progress?  If the latter, it could be I/O or networking bottlenecks?

 

>This system is using as Data Protector Cell server.

 

What exactly does a Cell server do?  (I.e. What resources does it use/need?)

The source (disks) to backup?

Something to collect data from other systems?

 

>because if additional memory is not giving expected output, then the expenditure made will be in question.

 

Here is where glance is important.  Do you have the trial version available?

Shibin_2
Honored Contributor

Re: filecache Utilization is very high on RX2660

Thanks for your response.  I have diverted my investigation to application level and found these lines in Omni debug.log file.

 

ipw_getaddrinfo(servername.domain.com) Network performance warning: took 15.000000 sec
ipw_getaddrinfo(servername.domain.com) Network performance warning: took 15.000000 sec
ipw_getaddrinfo(localhost) Network performance warning: took 20.000000 sec

 

Note: servername.domain.com - used here to hide original name.

 

Now, it seems more related to Network issue. 

 

But why just VM is above 85% and all other at normal ?

Regards
Shibin
Dennis Handly
Acclaimed Contributor

Re: filecache Utilization is very high on RX2660

>it seems more related to Network issue.

 

Yes.

 

>But why just VM is above 85% and all other at normal?

 

I think the title is "Active VM %", which I'm not sure what it means.  If it means "used", I'm not sure why it didn't say that.

I do find "Active VM" on a glance output in:

The HP-UX 11i v3 Memory Management Subsystem

h20000.www2.hp.com/bc/docs/support/SupportManual/c02465072/c02465072.pdf

 

Page 4 seems to imply that "active' means "belonging to a process that is running or has run in the last 20 seconds".

This could mean that 85% of the "USED" VM is active?