PV unavailable

[vijay alur alur]

Hi All,

i have a VG, having 2 PV's c6t12d0 and c7t12d0. As per my knowledge these 2 disks are actually 1 physical disk and accessed by 2 paths since the t12 and d0 are same for both the PV. Also this VG has 2 PV group each disk making one PVG. The problem is that the disk c7t12d0 is unavailable in the vgdisplay o/p and pvdisplay o/p. when i give pvdisplay -v c7t12d0 it shows only some of the PE's as stale while rest of the PE's are current. I suspect that one of the two FC Link to the disk is failed. Just want to know how can i recover from this situation?

Please refer output of pvdisplay and vgdisplay

Please help.....

Regards,

Vijay

[Duncan Edmonstone]

>> As per my knowledge these 2 disks are actually 1 physical disk and accessed by 2 paths since the t12 and d0 are same for both the PV.

No. They are physically seperate disks/LUNs. If they were alternate links, the vgdisplay command on the volume group would indicate that, and it doesn't.

They are seperate disks, and the logical volume appears to be mirrored between them (you can see this as the LV has 2 x the physical extents to logical extents, and the pvdisplay shows exactly half the physical extents on the failing disk)

Are you sure these disks are out of FC controllers? You should identify the HW path of the failing disk using lssf:

lssf /dev/dsk/c7t12d0

and then try and see if that path is out of one of your FC controllers:

ioscan -funC fc

Then use fcmsutil to check if the FC controller is up and active or not:

fcmsutil /dev/td0

for example... you should also of course, consult the "When Good Disks Go Bad" technical paper:

http://bizsupport2.austin.hp.com/bc/docs/support/SupportManual/c01911837/c01911837.pdf

[vijay alur alur]

Hi Duncan,

Thanks very much for your reply.

Yes these disk come out of a FC Controller. Below is the output.

# lssf /dev/dsk/c7t12d0
sdisk card instance 7 SCSI target 12 SCSI LUN 0 section 0 at address 0/3/1/0/4/0.8.0.255.0.12.0 /dev/dsk/c7t12d0

# ioscan -fnCfc
Class I H/W Path Driver S/W State H/W Type Description
========================================================================
fc 0 0/2/1/0/4/0 fcd CLAIMED INTERFACE HP 2Gb PCI/PCI-X Fibre Channel FC/GigE Dual Port Combo Adapter
/dev/fcd0
fc 1 0/3/1/0/4/0 fcd CLAIMED INTERFACE HP 2Gb PCI/PCI-X Fibre Channel FC/GigE Dual Port Combo Adapter
/dev/fcd1

# /opt/fcms/bin/fcmsutil /dev/fcd1

Vendor ID is = 0x001077
Device ID is = 0x002312
PCI Sub-system Vendor ID is = 0x00103c
PCI Sub-system ID is = 0x0012c7
PCI Mode = PCI-X 133 MHz
ISP Code version = 3.2.171
ISP Chip version = 3
Topology = PRIVATE_LOOP
Link Speed = 2Gb
Local N_Port_id is = 0x000001
Previous N_Port_id is = 0x000001
Local Loop_id is = 125
N_Port Node World Wide Name = 0x50060b0000324d2f
N_Port Port World Wide Name = 0x50060b0000324d2e
Switch Port World Wide Name = N/A
Switch Node World Wide Name = N/A
Driver state = ONLINE
Hardware Path is = 0/3/1/0/4/0
Maximum Frame Size = 2048
Driver-Firmware Dump Available = NO
Driver-Firmware Dump Timestamp = N/A
Driver Version = @(#) libfcd.a HP Fibre Channel ISP 23xx Driver B.11.23.02 /ux/core/isu/FCD/kern/src/common/wsio/fcd_init.c:Aug 31 2004,13:48:17

The FC link is online, i suspect that the link through /dev/fcd1 had a fluctuation and after regaining connectivity this particular disk didn't ( c7t12d0 ) reinitialized and may need a reboot. What do you think?

is there any way i can probe and chk connectivity between /dev/fcd1 and c7t12do?? i guess there is a fcmsutil cmd for the same..

regards,

vijay

[Duncan Edmonstone]

vijay,

So the FC card is online, but is the disk?

Will it respond to a diskinfo command?

diskinfo /dev/rdsk/c7t12d0

Can you read from it?

dd if=/dev/rdsk/c7t12d0 of=/dev/null bs=8k count=1024

Can you read the whole thing (will take some time)

dd if=/dev/rdsk/c7t12d0 of=/dev/null bs=8k

If you get errors off that, are there other disks out this same controller in the same disk cab as c7t12d0 which are still working? We are trying to determine here if you have a failing disk, or failing controller on the disk cab (I'm guessing these a phyiscal disks and not LUNs give you are operating in private loop rather than on a point-to-point fabric)

[vijay alur alur]

hii Duncan,

Thanks again,

i am really enjoying this exchange of knowledge with you!!

diskinfo does not give the desired output.

# diskinfo /dev/rdsk/c7t12d0
diskinfo: can't open /dev/rdsk/c7t12d0: No such device or address

doing a dd on it wont cause any issue?? this disk is part of cluster.... do let me know if it is safe to do that?

Yes, the other disk connected to same controller are working fine.

i want you to have a look at this

disk 28 0/3/1/0/4/0.8.0.255.0.12.0 sdisk NO_HW DEVICE HP 36.4GST336607FC
/dev/dsk/c7t12d0 /dev/rdsk/c7t12d0

disk 27 0/2/1/0/4/0.8.0.255.0.12.0 sdisk CLAIMED DEVICE HP 36.4GST336607FC
/dev/dsk/c6t12d0 /dev/rdsk/c6t12d0

did you notice the hardware path above??its looks like same disk but through different FC path...

what are your thoughts??

Regards,

Vijay

[Torsten.]

You probably have a JBOD like DS2405 connected. To confirm, please send

# ioscan -fn

# echo "map" | cstm

[vijay alur alur]

Hi Torsten,

Thanks for replying.

It is a Disk array with FC Card. Dont know the complete details as the server is located at remote location.

I have attached the file with requested details.

Regards,

Vijay.

[Torsten.]

Could you now please do

 # echo "sel dev 37;info;wait;il" | cstm

 # echo "sel dev 58;info;wait;il" | cstm

to get more

information about the enclosure?

[vijay alur alur]

hi torsten,

just wanted to confirm these command wont cause any disruption to the running services??

Regards,

Vijay

[Torsten.]

No, this runs the information tool of the online diagnostics on the JBOD controllers.