EMS notification event on hpux

[Shivkumar]

Dear Sirs,

We get the alert as below:-

Message Text = E-Alert UXOS8004 ux EMS Event 9 12:37:19 BigGuy [1585]: ------ EMS Event Notification ------ Value: CRITICAL (5) for Resource: /storage/events/tapes/SCSI_tape/0_12_0_1.5.0 (Threshold: >= 3 )

What is the meaning of this ? How to find out the root cause and resolution for above.

Thanks,
Shiv

[Adisuria Wangsadinata_1]

Hi,

Check the file /var/opt/resmon/log/event.log for the same event timestamp.

Check also the ioscan, whether you find the NO_HW status on your tape devices or not.

# ioscan -nfCtape

If possible, please post the both information to us, to narrow down the investigation.

Hope this information can help you.

Cheers,
AW

[Arunvijai_4]

Do you have tape libraries attached with your server ? Check your /var/adm/syslog/syslog.log and /var/opt/resmon/log/event.log

-Arun

[Indira Aramandla · Accepted solution]

Hi Shivkumar,

Check the logs in /var/adm/syslog/syslog.log, /var/opt/resmon/log/event.log and /var/adm/messages for more details.

There you will find the Physical Device Path, Product ID, Firmware Version, Serial Number more details of the errors and causes.

Then you can do ioscan â fn to find the hardware path device.

The above logs will show if the problem is a warning message or critical error. Then log a call with HP and they will ask you to run CSTM (Support Tools Manager ) commands to get more details and they will tell you what to be done.


Indira A

[KVK]

The above Error is indicating as TAPE has some Either Cofiguration Changes or TAPE mechanism Faulty

Please Check the /var/adm/syslog/syslog.log the same error will be there . Read that line there one command mentioned to run it in system . If you run that u will get the EVENT details

Check the Tape mechanisms using

#ioscan -fnC tape
#ioscan -fn

Check some TAR or fbackup utility to check ur tape mechanisms

[Ranjith_5]

Hi Shiva,

Look at the /var/adm/syslog/syslog.log. here you will find an entry like "Execute the following command to obtain event details: /opt/resmon/bin/resdata -R --------"


Run that command to get the exact event detail, which will help you to idientify the problem.

Also look at /var/opt/resmon/log/event.log


Regards,
Syam

[AwadheshPandey]

Shiv,

check these links,
this is tape drive error, pls check for connectivity or due to defetive h/w

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=201626
http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=822449
http://www.tek-tips.com/viewthread.cfm?qid=888979&page=10
http://ftp.support.veritas.com/pub/support/products/NetBackup_Server/273908.pdf
http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=707826&admit=-682735245+1131609105466+28353475
http://docs.hp.com/en/4316/ems_quick.pdf

Awadhesh

[Raj D.]

Hi Shiv ,

It seems that error with the tape drive.

Check this :

1. # ioscan -fnC tape [ It should be in CLAIMED status. ]

2. # check /var/adm/syslog/syslog.log for any error.

3. # check EMS alert on /var/opt/resmon/log/event.log for details .

4. # /usr/sbin/cstm and check for the tape drive for any error.


Hope this will help you ,

Cheers,
Raj.

[Yogeeraj_1]

hi,

please find below the shortcut to the document which contains all the documentation on the EMS.
http://docs.hp.com/en/B7609-90022/B7609-90022.pdf

kind regards
yogeeraj

[Shivkumar]

Sirs,

Below is out of the "ioscan -fnC tape" command:-

[BigGuy]home/sksonkar $ ioscan -fnC tape
Class I H/W Path Driver S/W State H/W Type Description
======================================================================
tape 0 0/0/1/0.3.0 stape CLAIMED DEVICE HP C1537A
/dev/rmt/0m /dev/rmt/0mnb /dev/rmt/c0t3d0BESTn /dev/rmt/c0t3d0DDSb
/dev/rmt/0mb /dev/rmt/c0t3d0BEST /dev/rmt/c0t3d0BESTnb /dev/rmt/c0t3d0DDSn
/dev/rmt/0mn /dev/rmt/c0t3d0BESTb /dev/rmt/c0t3d0DDS /dev/rmt/c0t3d0DDSnb
tape 1 0/12/0/1.5.0 stape CLAIMED DEVICE QUANTUM DLT8000
/dev/rmt/1m /dev/rmt/1mn /dev/rmt/c6t5d0BEST /dev/rmt/c6t5d0BESTn
/dev/rmt/1mb /dev/rmt/1mnb /dev/rmt/c6t5d0BESTb /dev/rmt/c6t5d0BESTnb
[BigGuy]home/sksonkar $

Is this showing any issue ?

[saju_2]

Hi

The ioscan output shows the H/w path 0_12_0_1.5.0 to the DLT8000 tape drive. The device is "CLAIMED" as per the ioscan output. So currently the server is able to see the device properly. Why can't u try to fire a backup on that drive so that u can verify the drive is perfectly ok?

The error in syslog will be becasue of some momentary SCSI resetting or something. Verify whether any one removed or replaced the SCSI cables or terminetters of the drive.

Are u getting any continuous error in syslog? if not it seems to be OK

Regards
CS

[Raj D.]

Hi Shiv ,

Your ioscan output clearly shows that the tape drive is in CLAIMED status.

Check the drive status with this command :

1. # mt -f /dev/rmt0/mn status

2. Also put a tape on the drive and run this command.

3. Run a test backup .
# cd /tmp
# tar -cvf /dev/rmt0/mn *

4. After completion check with
# tar -tvf /dev/rmt0/mn


Check if it works , then tape drive is fine.

hth,
Raj.

[Indira Aramandla]

Hi Shivkumar,

From your ioscan -fnC tape the output shows the hardware path shown under (H/W Path) for 0_12_0_1.5.0 is QUANTUM DLT8000 tape drive and the device is "CLAIMED" status.
That means the server is can see the device attached to it.

What was in the /var/opt/resmon/log under the following sections

Summary:

Description of Error:

It could be that CRITICAL(5) is Media (tape) failure where the backup cannot be written onto the tape, or the tape is not being loaded properly into the tape drive,......something on those lines.

To find out more you can do few tests as other in the forum mentioned.

Check the status of the QUANTUM DLT8000 tape library using the utility mc (media changer manipulation utility)

And try to move the tape from the library slot into the tape drive and back to the slot using the utility mt (magnetic tape manipulating program) and mc utility

Then schedule any backup and see if the backup completes successfully.


Indira A

[AwadheshPandey]

No issue there, pls check ur media, and shedule a backup, check any mechanical fault with ur drive if problem continues.

Awadhesh

[Andrew Merritt_2]

Upgrade to the latest version of the OnlineDiags. The tape monitor (dm_stape) is no longer supported, so you won't get these messages anymore.

The recommended solution is the Library and Tape Tools - these are free from HP at http://h18006.www1.hp.com/products/storageworks/ltt/

The latest version of OnlineDiags is available online at http://h20293.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=B6191AAE
You should also install the latest patch for that version.

Andrew