topic Re: Script for Failover Notification in Operating System - HP-UX

Script for Failover Notification

ricky2 — Tue, 02 Jun 2009 09:30:53 GMT

Hi,

I'm looking for a script which could send a email notification when ever a package failover happen.

Regards,
Ricky

Re: Script for Failover Notification

Matti_Kurkela — Tue, 02 Jun 2009 10:01:36 GMT

A package failover is a combination of two operations: halting the package on one node and starting it on another. If you want to perform an action at failover, you should add the action to either one of these operations.

Only the package start operation is guaranteed to happen: if the failover happens because the original node has crashed, lost power or even burnt to ashes, the failing node is obviously not going to perform any package shutdown actions.

The simplest method would be to add a command for sending the email to package startup actions:

mailx -s "Package startup on node $(hostname)" someone@company.example
This would send a message *every* time a package starts up. It would be the job of the receiver of the message to determine whether this was a failover or a pre-planned maintenance action.

(The example command above leaves the message content empty, as everything that needs to be said fits in the message subject.)

MK

Re: Script for Failover Notification

Basheer_2 — Wed, 03 Jun 2009 03:49:17 GMT

We set up in 2 ways

1) write a small script for cmviewl and cron it every 15 minutes

2) We had a maintenance script, that emailed whenever there was a failover

Re: Script for Failover Notification

ricky2 — Wed, 03 Jun 2009 12:37:47 GMT

Thanks Bashir,

Could you please share those scripts?

Regards,
Ricky

Re: Script for Failover Notification

Steven E. Protter — Wed, 03 Jun 2009 13:14:38 GMT

Shalom,

Build a a call to build an attachment into your cluster scripts.

http://www.hpux.ws/?p=7

That script will enable you to send out an email with an attachment.

SEP

Re: Script for Failover Notification

Mel Burslan — Wed, 03 Jun 2009 13:26:10 GMT

A very simple script I have written for an ex-colleague of mine who took over a couple of HPUX servers and not well versed in MCSG or posix shell programming. Hope it helps you. You can put it in crontab to run at whatever frequency you wish to do it.

#!/usr/bin/sh

# script name : cluster_mon
# script location : /etc/cmcluster
# prerequisites :
# ... run the following command prior to first run of this script
# ... cmviewcl > /etc/cmcluster/cluster_status.out
#

notify_list=me@mydomain.com

cmviewcl > /var/tmp/cluster_status.out

diff /etc/cmcluster/cluster_status.out /var/tmp/cluster_status.out > /dev/null
r=${?}

case $r in
0) echo "cluster is stable at $(date)" >> /var/adm/cluster_mon.log
exit 0
;;
1) echo "cluster status has changed since last check. $(date)" >> /var/adm/cluster_mon.log
echo "PREVIOUS CLUSTER STATUS\n" > /var/tmp/mailfile
cat /etc/cmcluster/cluster_status.out >> /var/tmp/mailfile
echo "\n\n\nCURRENT CLUSTER STATUS\n" >> /var/tmp/mailfile
cat /var/tmp/cluster_status.out >> /var/tmp/mailfile
echo "\n\n\n\nChanges found in the cluster status since the last check at $(date) >> /var/tmp/mailfile
cat /var/tmp/mailfile | mailx -s "Cluster Status Change ALERT !!" $notify_list
mv /var/tmp/cluster_status.out /etc/cmcluster/cluster_status.out
;;
*) MSG="Diff returned an unknown error while comparing cluster status files. Please investigate. $(date)"
echo $MSG >> /var/adm/cluster_mon.log
echo $MSG | mailx -s "ERROR while cheking cluster status" $notify_list
;;
esac

Re: Script for Failover Notification

ricky2 — Wed, 03 Jun 2009 13:57:46 GMT

Shalom Steven,

Could you be more clear about attachment into my cluster scripts?
How does it help me?

Regards,
Ricky

Re: Script for Failover Notification

Rick Garland — Wed, 03 Jun 2009 17:35:47 GMT

View the output from the cmviewcl command. If running SG version 11.17 or later you have the -f switch available.

Can use sudo to execute as a non-root user.

sudo /usr/sbin/cmviewcl -f line | grep owner | awk -F= '{print $2}'

This command will tell you who the owner is of a particular package.