EMC array devices showing up as size zero

[anthony natale]

Hi all,

Working on an issue here.. I am trying to help out the SA and SAN guys to figure out what the issue is with some recently assigned drives showing up as zero, while others are fine.

Any help would be appreciated. The EMC array model is a bit old, mapping devices on it is not as straight forward as on newer arrays.

EMC Array info:
Model 8830

From the HPUX admin:
I cleaned up all of the device files. Rebooted edcwmst4 and six of the
devices are still showing a size of zero.

SCSI describe of /dev/rdsk/c10t0d7:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c10t1d1:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c10t1d2:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c10t1d3:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c15t2d0:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c15t2d1:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c15t2d2:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c15t2d3:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c15t2d4:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c15t2d5:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c6t0d7:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c6t1d1:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c6t1d2:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c6t1d3:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 70709760 Kbytes
bytes per sector: 512
SCSI describe of /dev/rdsk/c14t2d0:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c14t2d1:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c14t2d2:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c14t2d3:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c14t2d4:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0
SCSI describe of /dev/rdsk/c14t2d5:
vendor: EMC
product id: SYMMETRIX
type: direct access
size: 0 Kbytes
bytes per sector: 0

Everything that is a problem is on c14 and c15. Maybe the storage needs to
be unassigned and given new device numbers from the EMC side. Anything on
c6 or c10 are fine.

[S. Ney]

What is the HP system model and OS?
Has insf -e and ioscan been run on the system side?
What other system side diagnostics have been done like fcmsutil?
From the HP system what is the output of ioscan -funC disk? (11.11 &11.23) ioscan -funNC disk (11.31)

[anthony natale]

What is the HP system model and OS?
Model: rp4440
OS: HP-UX 11iv1 aka HP-UX 11.11

Has insf -e and ioscan been run on the system side?
ioscan -fnCdisk
insf
I did not run 'insf -e'.

What other system side diagnostics have been done like fcmsutil?
fcmsutil /dev/td0

Vendor ID is = 0x00103c
Device ID is = 0x001029
XL2 Chip Revision No is = 2.3
PCI Sub-system Vendor ID is = 0x00103c
PCI Sub-system ID is = 0x00128c
Topology = PTTOPT_FABRIC
Link Speed = 1Gb
Local N_Port_id is = 0x011c00
N_Port Node World Wide Name = 0x50060b00002cf8fb
N_Port Port World Wide Name = 0x50060b00002cf8fa
Driver state = ONLINE
Hardware Path is = 0/2/1/0
Number of Assisted IOs = 247555
Number of Active Login Sessions = 1
Dino Present on Card = NO
Maximum Frame Size = 2048
Driver Version = @(#) libtd.a HP Fibre Channel Tachyon TL/TS/XL2 Driver B.11.11.12 PATCH_11.11 (PHSS_31326) /ux/kern/kisu/TL/src/common/wsio/td_glue.c: Sep 5 2005, 10:14:40

fcmsutil /dev/td1

Vendor ID is = 0x00103c
Device ID is = 0x001029
XL2 Chip Revision No is = 2.3
PCI Sub-system Vendor ID is = 0x00103c
PCI Sub-system ID is = 0x00128c
Topology = PTTOPT_FABRIC
Link Speed = 1Gb
Local N_Port_id is = 0x011c00
N_Port Node World Wide Name = 0x50060b00002cf8fd
N_Port Port World Wide Name = 0x50060b00002cf8fc
Driver state = ONLINE
Hardware Path is = 0/6/1/0
Number of Assisted IOs = 246673
Number of Active Login Sessions = 1
Dino Present on Card = NO
Maximum Frame Size = 2048
Driver Version = @(#) libtd.a HP Fibre Channel Tachyon TL/TS/XL2 Driver B.11.11.12 PATCH_11.11 (PHSS_31326) /ux/kern/kisu/TL/src/common/wsio/td_glue.c: Sep 5 2005, 10:14:40

From the HP system what is the output of ioscan -funC disk? (11.11 &11.23) ioscan -funNC disk (11.31)
Class I H/W Path Driver S/W State H/W Type Description
===========================================================================
disk 0 0/0/3/0.0.0.0 sdisk CLAIMED DEVICE TEAC DV-28E-C
/dev/dsk/c0t0d0 /dev/rdsk/c0t0d0
disk 1 0/1/1/0.0.0 sdisk CLAIMED DEVICE HP 73.4GMAS3735NC
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0
disk 2 0/1/1/0.1.0 sdisk CLAIMED DEVICE HP 73.4GMAS3735NC
/dev/dsk/c2t1d0 /dev/rdsk/c2t1d0
disk 11 0/2/1/0.1.19.0.0.0.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t0d0 /dev/rdsk/c10t0d0
disk 45 0/2/1/0.1.19.0.0.0.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t0d1 /dev/rdsk/c10t0d1
disk 25 0/2/1/0.1.19.0.0.0.7 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t0d7 /dev/rdsk/c10t0d7
disk 26 0/2/1/0.1.19.0.0.1.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t1d1 /dev/rdsk/c10t1d1
disk 27 0/2/1/0.1.19.0.0.1.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t1d2 /dev/rdsk/c10t1d2
disk 28 0/2/1/0.1.19.0.0.1.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c10t1d3 /dev/rdsk/c10t1d3
disk 29 0/2/1/0.1.19.0.1.2.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d0 /dev/rdsk/c15t2d0
disk 30 0/2/1/0.1.19.0.1.2.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d1 /dev/rdsk/c15t2d1
disk 31 0/2/1/0.1.19.0.1.2.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d2 /dev/rdsk/c15t2d2
disk 32 0/2/1/0.1.19.0.1.2.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d3 /dev/rdsk/c15t2d3
disk 33 0/2/1/0.1.19.0.1.2.4 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d4 /dev/rdsk/c15t2d4
disk 34 0/2/1/0.1.19.0.1.2.5 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c15t2d5 /dev/rdsk/c15t2d5
disk 12 0/2/1/0.1.19.0.8.0.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d0 /dev/rdsk/c12t0d0
disk 13 0/2/1/0.1.19.0.8.0.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d1 /dev/rdsk/c12t0d1
disk 14 0/2/1/0.1.19.0.8.0.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d2 /dev/rdsk/c12t0d2
disk 15 0/2/1/0.1.19.0.8.0.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d3 /dev/rdsk/c12t0d3
disk 16 0/2/1/0.1.19.0.8.0.4 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d4 /dev/rdsk/c12t0d4
disk 17 0/2/1/0.1.19.0.8.0.5 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d5 /dev/rdsk/c12t0d5
disk 3 0/2/1/0.1.19.0.8.0.6 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d6 /dev/rdsk/c12t0d6
disk 18 0/2/1/0.1.19.0.8.0.7 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t0d7 /dev/rdsk/c12t0d7
disk 21 0/2/1/0.1.19.0.8.1.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t1d0 /dev/rdsk/c12t1d0
disk 22 0/2/1/0.1.19.0.8.1.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c12t1d1 /dev/rdsk/c12t1d1
disk 4 0/6/1/0.1.19.0.0.0.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t0d0 /dev/rdsk/c6t0d0
disk 46 0/6/1/0.1.19.0.0.0.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t0d1 /dev/rdsk/c6t0d1
disk 35 0/6/1/0.1.19.0.0.0.7 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t0d7 /dev/rdsk/c6t0d7
disk 36 0/6/1/0.1.19.0.0.1.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t1d1 /dev/rdsk/c6t1d1
disk 37 0/6/1/0.1.19.0.0.1.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t1d2 /dev/rdsk/c6t1d2
disk 38 0/6/1/0.1.19.0.0.1.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c6t1d3 /dev/rdsk/c6t1d3
disk 39 0/6/1/0.1.19.0.1.2.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d0 /dev/rdsk/c14t2d0
disk 40 0/6/1/0.1.19.0.1.2.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d1 /dev/rdsk/c14t2d1
disk 41 0/6/1/0.1.19.0.1.2.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d2 /dev/rdsk/c14t2d2
disk 42 0/6/1/0.1.19.0.1.2.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d3 /dev/rdsk/c14t2d3
disk 43 0/6/1/0.1.19.0.1.2.4 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d4 /dev/rdsk/c14t2d4
disk 44 0/6/1/0.1.19.0.1.2.5 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c14t2d5 /dev/rdsk/c14t2d5
disk 5 0/6/1/0.1.19.0.8.0.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d0 /dev/rdsk/c11t0d0
disk 6 0/6/1/0.1.19.0.8.0.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d1 /dev/rdsk/c11t0d1
disk 7 0/6/1/0.1.19.0.8.0.2 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d2 /dev/rdsk/c11t0d2
disk 8 0/6/1/0.1.19.0.8.0.3 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d3 /dev/rdsk/c11t0d3
disk 9 0/6/1/0.1.19.0.8.0.4 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d4 /dev/rdsk/c11t0d4
disk 10 0/6/1/0.1.19.0.8.0.5 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d5 /dev/rdsk/c11t0d5
disk 19 0/6/1/0.1.19.0.8.0.6 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d6 /dev/rdsk/c11t0d6
disk 20 0/6/1/0.1.19.0.8.0.7 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t0d7 /dev/rdsk/c11t0d7
disk 23 0/6/1/0.1.19.0.8.1.0 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t1d0 /dev/rdsk/c11t1d0
disk 24 0/6/1/0.1.19.0.8.1.1 sdisk CLAIMED DEVICE EMC SYMMETRIX
/dev/dsk/c11t1d1 /dev/rdsk/c11t1d1

[SUDHAKAR_18]

EMC Powerpath software installed ??

show me below command output
#powermt display

Check the lun size from storage end for below devices.
/dev/rdsk/c14t2d0
/dev/rdsk/c14t2d1
/dev/rdsk/c14t2d2
/dev/rdsk/c14t2d3
/dev/rdsk/c14t2d4
/dev/rdsk/c14t2d5

and #diskinfo /dev/rdsk/c14t2d0
for all mentioned devices

[anthony natale]

Just got this back from the SA, looks like those C14/15 paths are not looking right.. would a powermt restore fix that? not sure if the SA has run that yet.

powermt display dev=all
LSymmetrix ID=000185700506
Logical device ID=03CF
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.1.1 c10t1d1 FA 12bA active dead 0 1
6 0/6/1/0.1.19.0.0.1.1 c6t1d1 FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=03F2
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.1.2 c10t1d2 FA 12bA active dead 0 1
6 0/6/1/0.1.19.0.0.1.2 c6t1d2 FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=03FA
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.1.3 c10t1d3 FA 12bA active dead 0 1
6 0/6/1/0.1.19.0.0.1.3 c6t1d3 FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=0219
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.4 c10t0d4 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.4 c6t0d4 FA 5aA active alive 0 0
15 0/2/1/0.1.19.0.1.2.2 unknown FA 12bA active dead 0 1
14 0/6/1/0.1.19.0.1.2.2 unknown FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=0221
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.5 c10t0d5 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.5 c6t0d5 FA 5aA active alive 0 0
15 0/2/1/0.1.19.0.1.2.3 unknown FA 12bA active dead 0 1
14 0/6/1/0.1.19.0.1.2.3 unknown FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=026F
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.6 c10t0d6 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.6 c6t0d6 FA 5aA active alive 0 0
15 0/2/1/0.1.19.0.1.2.4 unknown FA 12bA active dead 0 1
14 0/6/1/0.1.19.0.1.2.4 unknown FA 5aA active dead 0 1

Logical device ID=002F
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.1 c10t0d1 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.1 c6t0d1 FA 5aA active alive 0 0

Symmetrix ID=000185700506
Logical device ID=00E1
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.2 c10t0d2 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.2 c6t0d2 FA 5aA active alive 0 0
15 0/2/1/0.1.19.0.1.2.0 unknown FA 12bA active dead 0 1
14 0/6/1/0.1.19.0.1.2.0 unknown FA 5aA active dead 0 1

Symmetrix ID=000185700506
Logical device ID=00E9
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
10 0/2/1/0.1.19.0.0.0.3 c10t0d3 FA 12bA active alive 0 0
6 0/6/1/0.1.19.0.0.0.3 c6t0d3 FA 5aA active alive 0 0
15 0/2/1/0.1.19.0.1.2.1 unknown FA 12bA active dead 0 1
14 0/6/1/0.1.19.0.1.2.1 unknown FA 5aA active dead 0 1

[anthony natale]

below command output
#powermt display
powermt display
Symmetrix logical device count=21
CLARiiON logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
6 0/6/1/0.1.19.0.0 degraded 10 4 - 0 4
10 0/2/1/0.1.19.0.0 degraded 10 4 - 0 4
11 0/6/1/0.1.19.0.8 optimal 10 0 - 0 0
12 0/2/1/0.1.19.0.8 optimal 10 0 - 0 0
14 0/6/1/0.1.19.0.1 failed 6 6 - 0 6
15 0/2/1/0.1.19.0.1 failed 6 6 - 0 6

Check the lun size from storage end for below devices.


and diskinfo for all devices below:

#diskinfo /dev/rdsk/c14t2d0
/dev/rdsk/c14t2d0
/dev/rdsk/c14t2d1
/dev/rdsk/c14t2d2
/dev/rdsk/c14t2d3
/dev/rdsk/c14t2d4
/dev/rdsk/c14t2d5
diskinfo: can't open /dev/rdsk/c14t2d0: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d0: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d1: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d2: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d3: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d4: No such file or directory
diskinfo: can't open /dev/rdsk/c14t2d5: No such file or directory

[SUDHAKAR_18]

powermt display output shows dead paths. please look at dead paths.

may be fibre connectivity issue or any failure.

diskinfo shows mentioned paths are not available. so the disk may be showing no hardware at ioscan output.

[anthony natale]

hi,

All devices are assigned from the array and appear to be fine on that end..

[S. Ney]

Any errors on the switch ports? Do they have the latest firmware? Power path indicates that device is unknown on particular paths and that the connection is dead.

Also there is another thread about bad disks that may be pertinent.

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1453760