error logs Mar 3 17:22:45 radha above message repeats 2 times Mar 4 08:55:34 radha : su : - tb fmg-root Mar 4 08:55:38 radha : su : + tb fmg-root Mar 6 08:49:09 radha : su : - tb hpadm-hcl Mar 6 10:22:23 radha : su : - 0 fmg-root Mar 6 10:22:28 radha : su : + 0 fmg-root Mar 6 10:51:47 radha : su : - tc hpadm-hcl Mar 6 11:19:26 radha : su : - 0 fmg-root Mar 6 11:19:31 radha : su : + 0 fmg-root Mar 6 11:43:13 radha : su : + 2 fmg-root Mar 6 11:45:42 radha : su : - tc hpadm-root Mar 6 11:46:17 radha : su : + tc hpadm-root Mar 6 11:58:05 radha : su : - 1 fmg-root Mar 6 11:58:10 radha : su : + 1 fmg-root Mar 6 12:02:51 radha : su : + 2 fmg-root Mar 6 12:05:15 radha : su : + 1 fmg-root Mar 6 12:06:16 radha diagmond[1315]: Exit due to user requested abort Mar 6 12:07:43 radha diagmond[10493]: started Mar 6 12:09:30 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.3" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 100663489 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.3 -n 698023937 -a Mar 6 12:09:32 radha EMS [10651]: ----- EMS Monitor Restart ----- Title: disk_em Command: /usr/sbin/stm/uut/bin/tools/monitor /disk_em Vendor: Hewlett-Packard Company Version: A.01.00 To obtain a list of currently monitored resources, execute the f ollowing: /opt/resmon/bin/resdata -M 1533300606 Mar 6 12:18:00 radha vmunix: DIAGNOSTIC SYSTEM WARNING: Mar 6 12:18:00 radha vmunix: The diagnostic logging facility is no longer receiving excessive Mar 6 12:18:00 radha vmunix: errors from the I/O subsystem. 141 I/O error entries were lost. Mar 6 14:25:05 radha : su : - 0 fmg-root Mar 6 14:25:10 radha : su : + 0 fmg-root Mar 6 14:36:24 radha : su : - 1 fmg-root Mar 6 14:36:29 radha : su : + 1 fmg-root Mar 6 17:26:43 radha : su : + 0 fmg-root Mar 7 12:03:02 radha : su : - tb hpadm-hcl Mar 7 12:03:10 radha : su : - tb hpadm-root Mar 7 12:03:17 radha : su : + tb hpadm-root Mar 7 17:33:34 radha : su : + tb hpadm-root Mar 7 18:39:51 radha : su : - 0 fmg-root Mar 7 18:39:56 radha : su : + 0 fmg-root Mar 10 08:10:52 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.1" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024049 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.1 -n 698023938 -a Mar 10 08:10:52 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.2" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024053 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.2 -n 698023939 -a Mar 10 08:10:52 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.3" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024057 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.3 -n 698023940 -a Mar 10 08:10:53 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.4" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024061 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.4 -n 698023941 -a Mar 10 08:10:53 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.5" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024065 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.5 -n 698023942 -a Mar 10 08:10:53 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.6" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024069 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.6 -n 698023943 -a Mar 10 08:10:53 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.7" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024073 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.7 -n 698023944 -a Mar 10 08:10:54 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024077 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.0 -n 698023945 -a Mar 10 08:10:54 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.1" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024081 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.1 -n 698023946 -a Mar 10 08:10:54 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.2" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024085 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.2 -n 698023947 -a Mar 10 08:10:54 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.3" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024089 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.3 -n 698023948 -a Mar 10 08:10:54 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.4" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024093 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.4 -n 698023949 -a Mar 10 08:10:55 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.5" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024097 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.5 -n 698023950 -a Mar 10 08:10:55 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.6" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024101 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.6 -n 698023951 -a Mar 10 08:10:55 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_5_0_0.8.0.255.0.0.7" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024105 -r /storage/events/disks/default/0_5_0_0.8.0.255.0.0.7 -n 698023952 -a Mar 10 08:27:07 radha : su : - td fmg-root Mar 10 08:27:15 radha : su : + td fmg-root Mar 10 08:36:02 radha : su : + te hpadm-root Mar 10 08:27:11 radha : su : - td fmg-root Mar 10 08:38:46 radha : su : - tf hpadm-root Mar 10 08:38:54 radha : su : + tf hpadm-root Mar 10 08:54:39 radha : su : + tf hpadm-root Mar 10 09:50:20 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_0_1_0.1.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 698024033 -r /storage/events/disks/default/0_0_1_0.1.0 -n 698023953 -a Mar 10 09:50:20 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_0_2_0.6.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 698024037 -r /storage/events/disks/default/0_0_2_0.6.0 -n 698023954 -a Mar 10 09:50:21 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_0_2_1.6.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 698024041 -r /storage/events/disks/default/0_0_2_1.6.0 -n 698023955 -a Mar 10 09:50:21 radha EMS [10651]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks /default/0_4_0_0.8.0.255.0.1.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bi n/resdata -R 698024045 -r /storage/events/disks/default/0_4_0_0.8.0.255.0.1.0 -n 698023956 -a Mar 10 10:03:31 radha : su : + console hpadm-root Mar 10 10:15:46 radha : su : + tf hpadm-root # /opt/resmon/bin/resdata -R 698024041 -r /storage/events/disks/default/0_0_2_1.6.0 -n 698023955 -a CURRENT MONITOR DATA: Event Time : Mon Mar 10 09:50:21 2003 Hostname : radha IP Address : 137.80.13.103 Event Id : 0x003e6c128500000000 Monitor : disk_em Event # : 3 Event Class : I/O Severity : CRITICAL Disk at hardware path 0/0/2/1.6.0 : Drive is not responding. Associated OS error log entry id(s): None Latest information on this event: http://docs.hp.com/hpux/content/hardware/ems/disk_em.htm#3 Description of Error: The drive failed to respond to a test unit ready command. Probable Cause / Recommended Action: This drive is not responding. Check cables, power supply, ensure the drive is powered ON, and if needed replace the drive. v-v-v-v-v-v-v-v-v-v-v-v-v D E T A I L S v-v-v-v-v-v-v-v-v-v-v-v-v Product/Device Identification Information: Logger ID.........: disc30; sdisk Product Identifier: Disk Product Qualifier.: SEAGATE ST318203LC SCSI Target ID....: 0x06 SCSI LUN..........: 0x00 Hardware Status: (not present in log record). SCSI Sense Data: (not present in log record) cmviewcl -v CLUSTER STATUS dtss_cl up NODE STATUS STATE krishna up running Network_Parameters: INTERFACE STATUS PATH NAME PRIMARY up 0/12/0/0/4/0 lan4 PRIMARY up 0/0/0/0 lan0 PRIMARY up 0/8/0/0 lan3 STANDBY up 1/2/0/0 lan5 PACKAGE STATUS STATE PKG_SWITCH NODE dtss up running enabled krishna Policy_Parameters: POLICY_NAME CONFIGURED_VALUE Failover min_package_node Failback manual Script_Parameters: ITEM STATUS MAX_RESTARTS RESTARTS NAME Subnet up 137.80.0.0 Node_Switching_Parameters: NODE_TYPE STATUS SWITCHING NAME Primary up enabled radha Alternate up enabled krishna (current) NODE STATUS STATE radha up running Network_Parameters: INTERFACE STATUS PATH NAME PRIMARY up 0/12/0/0/4/0 lan4 PRIMARY up 0/0/0/0 lan0 PRIMARY up 0/8/0/0 lan3 STANDBY up 1/2/0/0 lan5 ioscan output Class I H/W Path Driver S/W State H/W Type Description ================================================================================ disk 2 0/0/1/0.1.0 sdisk CLAIMED DEVICE HP DVD-ROM 6x/32x /dev/dsk/c0t1d0 /dev/rdsk/c0t1d0 disk 0 0/0/2/0.6.0 sdisk CLAIMED DEVICE SEAGATE ST318203LC /dev/dsk/c1t6d0 /dev/rdsk/c1t6d0 disk 1 0/0/2/1.6.0 sdisk CLAIMED DEVICE SEAGATE ST318203LC /dev/dsk/c2t6d0 /dev/rdsk/c2t6d0 disk 13 0/4/0/0.8.0.255.0.1.0 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d0 /dev/rdsk/c6t1d0 disk 14 0/4/0/0.8.0.255.0.1.1 sdisk CLAIMED DEVICE DGC C5300WDR1 /dev/dsk/c6t1d1 /dev/rdsk/c6t1d1 disk 15 0/4/0/0.8.0.255.0.1.2 sdisk CLAIMED DEVICE DGC C5300WDR1 /dev/dsk/c6t1d2 /dev/rdsk/c6t1d2 disk 16 0/4/0/0.8.0.255.0.1.3 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d3 /dev/rdsk/c6t1d3 disk 17 0/4/0/0.8.0.255.0.1.4 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d4 /dev/rdsk/c6t1d4 disk 18 0/4/0/0.8.0.255.0.1.5 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d5 /dev/rdsk/c6t1d5 disk 19 0/4/0/0.8.0.255.0.1.6 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d6 /dev/rdsk/c6t1d6 disk 20 0/4/0/0.8.0.255.0.1.7 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c6t1d7 /dev/rdsk/c6t1d7 disk 21 0/5/0/0.8.0.255.0.0.0 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d0 /dev/rdsk/c5t0d0 disk 22 0/5/0/0.8.0.255.0.0.1 sdisk CLAIMED DEVICE DGC C5300WDR1 /dev/dsk/c5t0d1 /dev/rdsk/c5t0d1 disk 23 0/5/0/0.8.0.255.0.0.2 sdisk CLAIMED DEVICE DGC C5300WDR1 /dev/dsk/c5t0d2 /dev/rdsk/c5t0d2 disk 24 0/5/0/0.8.0.255.0.0.3 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d3 /dev/rdsk/c5t0d3 disk 25 0/5/0/0.8.0.255.0.0.4 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d4 /dev/rdsk/c5t0d4 disk 26 0/5/0/0.8.0.255.0.0.5 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d5 /dev/rdsk/c5t0d5 disk 27 0/5/0/0.8.0.255.0.0.6 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d6 /dev/rdsk/c5t0d6 disk 28 0/5/0/0.8.0.255.0.0.7 sdisk CLAIMED DEVICE DGC C5300WDR10 /dev/dsk/c5t0d7 /dev/rdsk/c5t output of swlist swlist # Initializing... # Contacting target "radha"... # # Target: radha:/ # # # Bundle(s): # A4926A B.11.00.07 1000BaseSX PCI Gigabit Ethernet LAN Driver A5230A B.11.00.05 100BT/9000 PCI A5506A B.11.00.01 PCI 4 PORT 100BASE-T/9000 B1956DA A.02.55 HP OpenView OmniBack II A.02.55 B1957AA A.02.55 HP OpenView OmniBack II A.02.55 Documentation B2491BA B.11.00 MirrorDisk/UX B3701AA C.02.15.000 HP GlancePlus/UX Pak for s800 11.00 B3901BA B.11.01.07 HP C/ANSI C Developer's Bundle for HP-UX 11.00 (S800) B3919EA_2A5 B.11.00 Special Edition HP-UX Unlimited-User Lic B3935BA A.11.08 MC / Service Guard B5456CA C.01.17.00 HP-UX Development Kit for Java* B6323BA B.06.02 CXperf Performance Analyzer HPUXEng64RT B.11.00 English HP-UX 64-bit Runtime Environment HWE1100 B.11.00.0209.5 Hardware Enablement Patches for HP-UX 11.00, September 2002 Ignite-UX-11-00 B.2.4.307 HP-UX Installation Utilities for Installing 11.00 Systems J1607CA B.02.00.07 Netscape Fasttrack Server OnlineDiag B.11.00.13.16 HPUX 11.0 Support Tools Bundle PHSS15467PKG B.10.00.00.AA Complementary OmniBack A.02.55 Patch XSWGR1100 B.11.00.45 HP-UX Extension Pack, May 1999 XSWHWCR1100 B.11.00.49.3 HP-UX Hardware Enablement and Critical Patches, June 2000 # # Product(s) not contained in a Bundle: # NAVIAGENT 4.0.0.12.5 Navisphere Disk Array Management Tool (AGENT) NAVICLI 4.0.0.12.4 Navisphere Disk Array Management Tool (CLI) OMNIBACK-II A.02.55 HP OpenView OmniBack II PHCO_17792 1.0 cumulative SAM/ObAM patch PHCO_18685 B.11.00.04 HP Array Manager/60 cumulative patch PHKL_18490 1.0 diag0 handle more devices,fix data corrupton PHKL_19060 1.0 LVM Cumulative patch PHKL_19080 1.0 New tape support. Defect fix for 9840 tape. PHKL_21678 1.0 Disk sort algorithm fix for slow io response output of /etc/lvmtab # strings /etc/lvmtab /dev/vg00 /dev/dsk/c1t6d0 /dev/dsk/c2t6d0 /dev/vg02 /dev/dsk/c5t0d1 /dev/dsk/c6t1d1 /dev/vg04 /dev/dsk/c5t0d3 /dev/dsk/c6t1d3 /dev/vg03 /dev/dsk/c6t1d2 /dev/dsk/c5t0d2 /dev/vg05 /dev/dsk/c6t1d4 /dev/dsk/c6t1d6 /dev/dsk/c6t1d7 /dev/dsk/c5t0d4 /dev/dsk/c5t0d5 /dev/dsk/c5t0d6 /dev/dsk/c5t0d7 /dev/dsk/c6t1d5 /dev/vg01 /dev/dsk/c6t1d0 /dev/dsk/c5t0d0