topic Re: monitoring system performance in Operating System - Linux

monitoring system performance

yongye_2 — Wed, 17 Aug 2005 08:10:44 GMT

Hi,

I want to design a system monitor solution. No biz management tools will be used. Just use UNIX command ps,sar,iostat,top,vmstat,uptime and shell script to archive the goal. But I am not familiar with the shell script. I wonder whether I can get the followed function through shell script,

1) monitor system performance.Like CPU usage, disk I/O usage, Swap usage, Memory usage and so on.
2) Ability to set and monitor predefined threshold.
3) Auto send notification after perdefined threshold are exceeded.
4) Ability check system log and auto send notification when error detected.

Any advice and reference are welcome.

Yongye

Re: monitoring system performance

Pedro Cirne — Wed, 17 Aug 2005 08:14:46 GMT

Hi,

Check man of the "sar" command. It's standard on all hp-ux servers and is able to collect and store all information you want.

Enjoy :)

Pedro

Re: monitoring system performance

Geoff Wild — Wed, 17 Aug 2005 08:29:27 GMT

You can script your own if you like...

Use commands like uptime, top -d 1, sar swapinfo -tam, etc...

Or download Big Brother:

http://www.bb4.org/

Rgds...Geoff

Re: monitoring system performance

Ernesto Cappello — Wed, 17 Aug 2005 08:32:47 GMT

Hi Yongye, looks this script:

#!/bin/sh
THRESHHOLD="7[0-9]%"
THRESHHOLD1="8[0-9]%"
THRESHHOLD2="9[0-9]%"
THRESHHOLD3="100%"

# BDF ON SERVER XXXXX#1
echo "#####################" > bdf_on_servers.txt
echo "# BDF ON XXXX#1 #" >> bdf_on_servers.txt
echo "#####################" >> bdf_on_servers.txt
echo "\n" >> bdf_on_servers.txt
echo "Filesystem kbytes used avail %used Mounted on \n" >> bdf_on_servers.txt
bdf -l | grep -e $THRESHHOLD -e $THRESHHOLD1 -e $THRESHHOLD2 -e $THRESHHOLD3 >> bdf_on_servers.txt

# BDF ON SERVER XXXXX#2
echo "#####################" > bdf_on_servers.txt
echo "# BDF ON XXXX#2 #" >> bdf_on_servers.txt
echo "#####################" >> bdf_on_servers.txt
echo "\n" >> bdf_on_servers.txt
echo "Filesystem kbytes used avail %used Mounted on \n" >> bdf_on_servers.txt
remsh XXXXX#2 -n "bdf -l | grep -e $THRESHHOLD -e $THRESHHOLD1 -e $THRESHHOLD2 -e $THRESHHOLD3" >> bdf_on_servers.txt

ux2dos bdf_on_servers.txt | mailx -s "BDF on UNIX SERVERS" yongye@xxx.com

# TOP ON SERVER XXXXX#1
echo "#####################" > top_on_servers.txt
echo "# TOP ON XXXX#1 #" >> top_on_servers.txt
echo "#####################" >> top_on_servers.txt
top >> top_on_servers_tmp.txt
more top_on_servers_tmp.txt | grep Memory >> top_on_servers.txt

ux2dos top_on_servers.txt | mailx -s "TOP on UNIX SERVERS" yongye@xxx.com

Where XXXX#1 are yopur servers.
Regards, Ernesto.

Re: monitoring system performance

Marvin Strong — Wed, 17 Aug 2005 08:33:02 GMT

You could create a shell script, more like applicaton. To do what you looking for, but its no small task. And since you have no scripting experience, the first thing you may want to do is get some shell books, or training.

Re: monitoring system performance

Victor Fridyev — Wed, 17 Aug 2005 08:57:34 GMT

Hi,

Look at the attached script. I hope it can do most of needed things.

Re: monitoring system performance

yongye_2 — Wed, 17 Aug 2005 23:31:35 GMT

Hi Fridyev and Ernesto,

Thank you very much for your help. I have already assigned point to you. The sample script really gives me a good start.
But I still wonder whether it is posible to get the function from shell script for auto send notification when threshold or error occured. Would you please give me more informaiton on this? Thanks.

Hi Geoff Wild, For the security and cost reason, either free ware or biz software are not allowed to use on our system.Thanks.

Hi Pedro Cirne and Marvin Strong, also thanks for your help.

Regards,
Yonyge

Re: monitoring system performance

Borislav Perkov — Thu, 18 Aug 2005 03:48:28 GMT

Hi,

You could solve your problem by adding monitors request in SAM like for filesystems' usage.

Resource Management>Event Monitoring Service
Actions>Add Monitoring Request...
choose in Resource Class system than filesystem, availMB. Than choose Resorce Instance like root, press OK. After you can set the monitorig parameters and the way how the notification would be sent.

Best Regards,
Borislav

Re: monitoring system performance

yongye_2 — Thu, 18 Aug 2005 04:10:03 GMT

Hi Borislav Perkov,

Thanks for your reply. I think you are right. EMS is a good tools to monitor the system status. But many of its function is to monitor the target for up and down status. For performance monitoring it does little. I will consider it as the tools used in the event management.

Thanks again.

Yongye

Re: monitoring system performance

Victor Fridyev — Thu, 18 Aug 2005 09:11:30 GMT

Hi Yongye,

AFAIK, the best and the simplest way to receive messages in case of some overloading is using of standard SNMP monitors (OV, CA, BigBrother, BigSister etc). Some of the are free e.g. Big Brother. But if you want to do this by yourself, you can analyze output of commands like sar or swapinfo.

You can see a part of such a script below.

/usr/sbin/sar -d 60 1 > $TMF
TEST=$(cat $TMF | cut -c10-|
awk '/c0t8d0/||/c0t10d0/ {if($2>85)fl=1}
END {if(fl)print "GO"; else print "STOP"}')

HTH

Re: monitoring system performance

yongye_2 — Mon, 22 Aug 2005 01:52:25 GMT

Hi,

Thanks for you all.

Now I want to find out what value I should set as threshold on CPU usage, memory utilization, disk I/O utilization and swapping/paging? Is there any adviced value on them or any reference?

Thanks.

Yongye