isk at hardware path 1/0/4/1/0.11.0 : I/O request failed.

[elthox]

Hello All,

Suddenly I received these alarms from the system. vasstat1 sent Event Monitor notification information:

/storage/events/disks/default/1_0_4_1_0.11.0 is >= 1.
Its current value is CRITICAL(5).



Event data from monitor:

Event Time..........: Sat Sep 23 17:47:43 2006
Severity............: CRITICAL
Monitor.............: disk_em
Event #.............: 13
System..............: vasstat1

Summary:
Disk at hardware path 1/0/4/1/0.11.0 : I/O request failed.

After I executed ioscan -funC disk:

vasstat1:/# ioscan -funC disk
Class I H/W Path Driver S/W State H/W Type Description
===========================================================================
disk 1 1/0/0/3/0.6.0 sdisk CLAIMED DEVICE HP 36.4GST336754L C
/dev/dsk/c0t6d0 /dev/rdsk/c0t6d0
disk 0 1/0/0/3/1.2.0 sdisk CLAIMED DEVICE _NEC DVD_RW ND -3540A
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 2 1/0/1/1/0/1/1.6.0 sdisk CLAIMED DEVICE HP 36.4GST3367 54LC
/dev/dsk/c3t6d0 /dev/rdsk/c3t6d0
disk 3 1/0/4/1/0.0.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t0d0 /dev/rdsk/c4t0d0
disk 4 1/0/4/1/0.1.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t1d0 /dev/rdsk/c4t1d0
disk 5 1/0/4/1/0.2.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t2d0 /dev/rdsk/c4t2d0
disk 6 1/0/4/1/0.3.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t3d0 /dev/rdsk/c4t3d0
disk 7 1/0/4/1/0.4.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t4d0 /dev/rdsk/c4t4d0
disk 8 1/0/4/1/0.5.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t5d0 /dev/rdsk/c4t5d0
disk 9 1/0/4/1/0.8.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t8d0 /dev/rdsk/c4t8d0
disk 10 1/0/4/1/0.9.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t9d0 /dev/rdsk/c4t9d0
disk 11 1/0/4/1/0.10.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t10d0 /dev/rdsk/c4t10d0
disk 12 1/0/4/1/0.11.0 sdisk SCAN DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t11d0 /dev/rdsk/c4t11d0
disk 13 1/0/4/1/0.12.0 sdisk SCAN DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t12d0 /dev/rdsk/c4t12d0
disk 14 1/0/4/1/0.13.0 sdisk SCAN DEVICE COMPAQ BF07289BC 4
/dev/dsk/c4t13d0 /dev/rdsk/c4t13d0

I reexecuted it again and the SCAN labels were changed into CLAIMED.
vasstat1:/# ioscan -funC disk
Class I H/W Path Driver S/W State H/W Type Description
===========================================================================
disk 1 1/0/0/3/0.6.0 sdisk CLAIMED DEVICE HP 36.4GST336754LC
/dev/dsk/c0t6d0 /dev/rdsk/c0t6d0
disk 0 1/0/0/3/1.2.0 sdisk CLAIMED DEVICE _NEC DVD_RW ND-3540A
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 2 1/0/1/1/0/1/1.6.0 sdisk CLAIMED DEVICE HP 36.4GST336754LC
/dev/dsk/c3t6d0 /dev/rdsk/c3t6d0
disk 3 1/0/4/1/0.0.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t0d0 /dev/rdsk/c4t0d0
disk 4 1/0/4/1/0.1.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t1d0 /dev/rdsk/c4t1d0
disk 5 1/0/4/1/0.2.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t2d0 /dev/rdsk/c4t2d0
disk 6 1/0/4/1/0.3.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t3d0 /dev/rdsk/c4t3d0
disk 7 1/0/4/1/0.4.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t4d0 /dev/rdsk/c4t4d0
disk 8 1/0/4/1/0.5.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t5d0 /dev/rdsk/c4t5d0
disk 9 1/0/4/1/0.8.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t8d0 /dev/rdsk/c4t8d0
disk 10 1/0/4/1/0.9.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t9d0 /dev/rdsk/c4t9d0
disk 11 1/0/4/1/0.10.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t10d0 /dev/rdsk/c4t10d0
disk 12 1/0/4/1/0.11.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t11d0 /dev/rdsk/c4t11d0
disk 13 1/0/4/1/0.12.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t12d0 /dev/rdsk/c4t12d0
disk 14 1/0/4/1/0.13.0 sdisk CLAIMED DEVICE COMPAQ BF07289BC4
/dev/dsk/c4t13d0 /dev/rdsk/c4t13d0

After that they got SCAN again and so on continuing an infinite loop.

Please someone can help me?

[Joël Techer]

Hi,

It seems that your disk /dev/dsk/c4t11d0 /dev/dsk/c4t12d0 and /dev/dsk/c4t13d0 has io error when the system want to aaccess them .

A good test is to generate io to see if errors with dd if=/dev/dsk/c4t11d0 of=/dev/null bs=10k count=10000

Have a look on /var/adm/syslog/syslog.log file
and dmesg command to get further information

I think you have a san disk , so Check the status from "light" of the each disk, Fibre Channel card,cable.

Best regards

Jean-Louis

[Sandman!]

The reason is that the LUNs are mapped out to the HP-UX server as Windows-Luns i.e. COMPAQ. You need to switch the LUNs from Windows to HP-UX.

hope it helps!

[elthox]

Hello Guys,

Thanks for your replies. Also I would like to show to you some records in syslog.log that are generated very often.
Although the states provided by ioscan -funC disk are CLAIMED, there are these records in syslog that shows something goes wrong.
Sep 25 13:50:45 vasstat1 EMS [1904]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks/defaul
t/1_0_4_1_0.11.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 124780601
-r /storage/events/disks/default/1_0_4_1_0.11.0 -n 124781728 -a
Sep 25 13:49:32 vasstat1 vmunix: SCSI Ultra320 1/0/4/1/0 instance 4: IO Type : SCSI IO has timed-out. Target ID: 11, LUN ID: 0.
Inquiry Command - CDB: 12 00 00 00 80 00
Sep 25 13:50:45 vasstat1 above message repeats 4 times
Sep 25 13:50:44 vasstat1 vmunix: SCSI Ultra320 1/0/4/1/0 instance 4: IO Type : SCSI IO has timed-out. Target ID: 11, LUN ID: 0.
Test Unit Ready Command - CDB:
Sep 25 13:50:45 vasstat1 EMS [1904]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks/defaul
t/1_0_4_1_0.11.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 124780601
-r /storage/events/disks/default/1_0_4_1_0.11.0 -n 124781729 -a
Sep 25 13:50:45 vasstat1 EMS [1904]: ------ EMS Event Notification ------ Value: "CRITICAL (5)" for Resource: "/storage/events/disks/defaul
t/1_0_4_1_0.11.0" (Threshold: >= " 3") Execute the following command to obtain event details: /opt/resmon/bin/resdata -R 124780601
-r /storage/events/disks/default/1_0_4_1_0.11.0 -n 124781730 -a
Sep 25 13:51:32 vasstat1 vmunix: SCSI Ultra320 1/0/4/1/0 instance 4: IO Type : SCSI IO has timed-out. Target ID: 11, LUN ID: 0.
Read Command - CDB: 28 00 00 00 00 10 00 00 02 00
Sep 25 13:52:24 vasstat1 vmunix: SCSI Ultra320 1/0/4/1/0 instance 4: IO Type : SCSI IO has timed-out. Target ID: 11, LUN ID: 0.
Inquiry Command - CDB: 12 00 00 00 80 00

Thanks in advance