LVM issue with SAN disk (Alternate link)

[OLIVA_1]

Hello,

For maintenance intervention we have stopped a L2000 server and disconnected 2 HBA cards... we reconnected the 2 HBA cards and restarted the server. Now I have some error with the Alternate Links when I use LVM command (see below) but I can see them with ioscan command.

How can I correct this issue ?


SOME COMMAND RESULTS BELOW:

cpiad3:/home/admin#strings /etc/lvmtab
/dev/vg00
@12]
/dev/dsk/c1t2d0
/dev/dsk/c2t2d0
/dev/vg01
/dev/dsk/c5t0d0
/dev/dsk/c5t0d1
/dev/dsk/c5t0d2
/dev/dsk/c7t0d0
/dev/dsk/c7t0d1
/dev/dsk/c7t0d2
/dev/vg02
/dev/dsk/c5t0d3
/dev/dsk/c5t0d4
/dev/dsk/c5t0d5
/dev/dsk/c7t0d3
/dev/dsk/c7t0d4
/dev/dsk/c7t0d5
/dev/dsk/c5t1d1
/dev/vg03
/dev/dsk/c5t0d6
/dev/dsk/c5t0d7
/dev/dsk/c5t1d0
/dev/dsk/c7t0d6
/dev/dsk/c7t0d7
/dev/dsk/c7t1d0
/dev/dsk/c5t1d2
/dev/dsk/c7t1d2
cpiad3:/home/admin#


Extract of "vgdisplay -v vg01"
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d1":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Name /dev/dsk/c5t0d1
PV Status available
Total PE 3472
Free PE 0

vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d1":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c7t0d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Name /dev/dsk/c5t0d2
PV Status available
Total PE 3472
Free PE 2392


cpiad3:/home/admin#

Ioscan command
cpiad3:/home/admin#ioscan -fnCdisk
Class I H/W Path Driver S/W State H/W Type Description
==================================================================================
disk 0 0/0/1/1.0.0 sdisk CLAIMED DEVICE SEAGATE ST318404LC
/dev/dsk/c1t0d0 /dev/rdsk/c1t0d0
disk 1 0/0/1/1.2.0 sdisk CLAIMED DEVICE HP 36.4GATLAS10K3_36_SCA
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 2 0/0/2/0.0.0 sdisk CLAIMED DEVICE SEAGATE ST318404LC
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0
disk 3 0/0/2/0.2.0 sdisk CLAIMED DEVICE HP 36.4GATLAS10K3_36_SCA
/dev/dsk/c2t2d0 /dev/rdsk/c2t2d0
disk 4 0/0/2/1.2.0 sdisk CLAIMED DEVICE HP DVD-ROM 305
/dev/dsk/c3t2d0 /dev/rdsk/c3t2d0
disk 5 0/3/0/0.20.3.0.0.0.0 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d0 /dev/rdsk/c5t0d0
disk 6 0/3/0/0.20.3.0.0.0.1 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d1 /dev/rdsk/c5t0d1
disk 7 0/3/0/0.20.3.0.0.0.2 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d2 /dev/rdsk/c5t0d2
disk 8 0/3/0/0.20.3.0.0.0.3 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d3 /dev/rdsk/c5t0d3
disk 9 0/3/0/0.20.3.0.0.0.4 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d4 /dev/rdsk/c5t0d4
disk 10 0/3/0/0.20.3.0.0.0.5 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d5 /dev/rdsk/c5t0d5
disk 11 0/3/0/0.20.3.0.0.0.6 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d6 /dev/rdsk/c5t0d6
disk 12 0/3/0/0.20.3.0.0.0.7 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t0d7 /dev/rdsk/c5t0d7
disk 13 0/3/0/0.20.3.0.0.1.0 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t1d0 /dev/rdsk/c5t1d0
disk 51 0/3/0/0.20.3.0.0.1.1 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t1d1 /dev/rdsk/c5t1d1
disk 53 0/3/0/0.20.3.0.0.1.2 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c5t1d2 /dev/rdsk/c5t1d2
disk 14 0/3/0/0.20.3.0.0.2.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t2d0 /dev/rdsk/c5t2d0
disk 15 0/3/0/0.20.3.0.0.3.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t3d0 /dev/rdsk/c5t3d0
disk 16 0/3/0/0.20.3.0.0.4.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t4d0 /dev/rdsk/c5t4d0
disk 17 0/3/0/0.20.3.0.0.5.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t5d0 /dev/rdsk/c5t5d0
disk 18 0/3/0/0.20.3.0.0.6.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t6d0 /dev/rdsk/c5t6d0
disk 19 0/3/0/0.20.3.0.0.7.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t7d0 /dev/rdsk/c5t7d0
disk 20 0/3/0/0.20.3.0.0.8.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t8d0 /dev/rdsk/c5t8d0
disk 21 0/3/0/0.20.3.0.0.9.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t9d0 /dev/rdsk/c5t9d0
disk 22 0/3/0/0.20.3.0.0.10.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t10d0 /dev/rdsk/c5t10d0
disk 23 0/3/0/0.20.3.0.0.11.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t11d0 /dev/rdsk/c5t11d0
disk 24 0/3/0/0.20.3.0.0.12.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t12d0 /dev/rdsk/c5t12d0
disk 25 0/3/0/0.20.3.0.0.13.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t13d0 /dev/rdsk/c5t13d0
disk 26 0/3/0/0.20.3.0.0.14.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t14d0 /dev/rdsk/c5t14d0
disk 27 0/3/0/0.20.3.0.0.15.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c5t15d0 /dev/rdsk/c5t15d0
disk 28 0/7/0/0.10.3.0.0.0.0 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d0 /dev/rdsk/c7t0d0
disk 29 0/7/0/0.10.3.0.0.0.1 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d1 /dev/rdsk/c7t0d1
disk 30 0/7/0/0.10.3.0.0.0.2 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d2 /dev/rdsk/c7t0d2
disk 31 0/7/0/0.10.3.0.0.0.3 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d3 /dev/rdsk/c7t0d3
disk 32 0/7/0/0.10.3.0.0.0.4 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d4 /dev/rdsk/c7t0d4
disk 33 0/7/0/0.10.3.0.0.0.5 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d5 /dev/rdsk/c7t0d5
disk 34 0/7/0/0.10.3.0.0.0.6 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d6 /dev/rdsk/c7t0d6
disk 35 0/7/0/0.10.3.0.0.0.7 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t0d7 /dev/rdsk/c7t0d7
disk 36 0/7/0/0.10.3.0.0.1.0 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t1d0 /dev/rdsk/c7t1d0
disk 52 0/7/0/0.10.3.0.0.1.1 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t1d1 /dev/rdsk/c7t1d1
disk 54 0/7/0/0.10.3.0.0.1.2 sdisk CLAIMED DEVICE HP OPEN-E
/dev/dsk/c7t1d2 /dev/rdsk/c7t1d2
disk 37 0/7/0/0.10.3.0.0.2.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t2d0 /dev/rdsk/c7t2d0
disk 38 0/7/0/0.10.3.0.0.3.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t3d0 /dev/rdsk/c7t3d0
disk 39 0/7/0/0.10.3.0.0.4.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t4d0 /dev/rdsk/c7t4d0
disk 40 0/7/0/0.10.3.0.0.5.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t5d0 /dev/rdsk/c7t5d0
disk 41 0/7/0/0.10.3.0.0.6.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t6d0 /dev/rdsk/c7t6d0
disk 42 0/7/0/0.10.3.0.0.7.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t7d0 /dev/rdsk/c7t7d0
disk 43 0/7/0/0.10.3.0.0.8.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t8d0 /dev/rdsk/c7t8d0
disk 44 0/7/0/0.10.3.0.0.9.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t9d0 /dev/rdsk/c7t9d0
disk 45 0/7/0/0.10.3.0.0.10.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t10d0 /dev/rdsk/c7t10d0
disk 46 0/7/0/0.10.3.0.0.11.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t11d0 /dev/rdsk/c7t11d0
disk 47 0/7/0/0.10.3.0.0.12.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t12d0 /dev/rdsk/c7t12d0
disk 48 0/7/0/0.10.3.0.0.13.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t13d0 /dev/rdsk/c7t13d0
disk 49 0/7/0/0.10.3.0.0.14.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t14d0 /dev/rdsk/c7t14d0
disk 50 0/7/0/0.10.3.0.0.15.0 sdisk CLAIMED DEVICE HP DISK-SUBSYSTEM
/dev/dsk/c7t15d0 /dev/rdsk/c7t15d0
cpiad3:/home/admin#



Thanks for your help,

[Massimo Bianchi]

Hi,
did you reconnect the SAME HBA in the SAME slots ?

I suspect there was some mis-inserting..

Check also in the dmesg, do you have any interesting message ?


TO correct this, i think that the fastest way is a vgscan.

mv /etc/lvmtab /etc/lvmtab.20040817
vgscan -av

Regards,
Massimo

[OLIVA_1]

The rebuilding of /etc/lvmtab file has succeded but the errors with vgdislpay command are always present.

Other idea ?

Thanks,

[Geoff Wild]

How about vgreduce /dev/dsk/c7t0dX, re-run ioscan, insf -e, then diskinfo /dev/rdsk/c7t0dX

After that, use your san tools (if EMC, run a syminq) to confirm that the disk is the same as other link.

Finally, vgextend those disks back in....

Rgds...Geoff

[OLIVA_1]

Idem :-(

cpiad3:/opt/fcms#vgreduce /dev/vg01 /dev/dsk/c7t0d0
vgreduce: Couldn't query physical volume "/dev/dsk/c7t0d0":
The specified path does not correspond to physical volume attached to
this volume group
cpiad3:/opt/fcms#vgreduce /dev/vg03 /dev/dsk/c7t0d6
vgreduce: Couldn't query physical volume "/dev/dsk/c7t0d6":
The specified path does not correspond to physical volume attached to
this volume group
cpiad3:/opt/fcms#

[Geoff Wild]

try the force:

vgreduce -f /dev/vg01


Rgds...Geoff

[Rgomes]

Reboot?

regards,
Richard

[OLIVA_1]

This server is critical and in production... I will try to manage a reboot.

Thanks,

[Massimo Bianchi]

dmesg says anything ?

reading from the disk works ? dd if=/dev/rdsk/c7t15d0 of=/dev/null count=1000

HTH,
Massimo

[Rgomes]

http://www1.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000074839913

regards,
Richard

[OLIVA_1]

The solution was:
vgchange -a y /dev/vg0x

This problem is known by HP.


Thanks for your help !!