problem with lvm and physical disk

[Murat SULUHAN]

I have 2 ux boxes with 2 ds2300 disk array system and I have 6 disks each array

So the problem is below

root:/ > vgdisplay -v /dev/vg01
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Volume groups ---
VG Name /dev/vg01
VG Write Access read/write
VG Status available, exclusive
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 4
Act PV 3
Max PE per PV 20000
VGDA 6
PE Size (Mbytes) 8
Total PE 13020
Alloc PE 13020
Free PE 0
Total PVG 2
Total Spare PVs 0
Total Spare PVs in use 0

vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Logical volumes ---
LV Name /dev/vg01/lvol1
LV Status available/stale
LV Size (Mbytes) 69440
Current LE 8680
Allocated PE 17360
Used PV 3


--- Physical volumes ---
PV Name /dev/dsk/c4t1d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t0d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t1d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On


--- Physical volume groups ---
PVG Name pvg1
PV Name /dev/dsk/c4t0d0
PV Name /dev/dsk/c4t1d0

PVG Name pvg2
PV Name /dev/dsk/c5t0d0
PV Name /dev/dsk/c5t1d0


root:/ > diskinfo -v /dev/rdsk/c4t0d0
SCSI describe of /dev/rdsk/c4t0d0:
vendor: HP 36.4G
product id: ST336607LC
type: direct access
size: 35566480 Kbytes
bytes per sector: 512
rev level: HPC5
blocks per disk: 71132960
ISO version: 0
ECMA version: 0
ANSI version: 3
removable media: no
response format: 2
(Additional inquiry bytes: (32)4a (33)41 (34)37 (35)45 (36)4a (37)54 (38)41 (39)20 (40)20 (41)20 (42)20 (43)20 (44)20 (45)20 (46)20 (47)20 (48)20 (49)20 (50)20 (51)f (52)0 (53)0 (54)60 (55)a (56)dc (57)b (58)59 (59)3 (60)1 (61)3 (62)22 (63)0 (64)0 (65)0 (66)0 (67)0 (68)0 (69)0 (70)0 (71)0 (72)0 (73)0 (74)0 (75)0 (76)0 (77)0 (78)0 (79)0 (80)0 (81)0 (82)0 (83)0 (84)0 (85)0 (86)0 (87)0 (88)0 (89)0 (90)0 (91)0 (92)43 (93)6f (94)70 (95)79 (96)72 (97)69 (98)67 (99)68 (100)74 (101)20 (102)28 (103)63 (104)29 (105)20 (106)32 (107)30 (108)30 (109)33 (110)20 (111)53 (112)65 (113)61 (114)67 (115)61 (116)74 (117)65 (118)20 (119)41 (120)6c (121)6c (122)20 (123)4 (124)3d (125)67 (126)20 (127)0 (128)0 (129)2 (130)0 (131)77 (132)fd (133)e0 (134)50 (135)77 (136)ff (137)5 (138)c4 )


root:/ > ioscan -funC disk
Class I H/W Path Driver S/W State H/W Type Description
======================================================================
disk 0 0/0/1/1.15.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c1t15d0 /dev/rdsk/c1t15d0
disk 1 0/0/2/1.15.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c3t15d0 /dev/rdsk/c3t15d0
disk 2 0/4/0/0.0.0 sdisk CLAIMED DEVICE HP 36.4GST336607LC
/dev/dsk/c4t0d0 /dev/rdsk/c4t0d0
disk 3 0/4/0/0.1.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c4t1d0 /dev/rdsk/c4t1d0
disk 4 0/4/0/0.2.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c4t2d0 /dev/rdsk/c4t2d0
disk 5 0/4/0/0.3.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c4t3d0 /dev/rdsk/c4t3d0
disk 11 0/4/0/0.4.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c4t4d0 /dev/rdsk/c4t4d0
disk 12 0/4/0/0.5.0 sdisk CLAIMED DEVICE HP 36.4GST336607LC
/dev/dsk/c4t5d0 /dev/rdsk/c4t5d0
disk 6 0/4/0/1.0.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c5t0d0 /dev/rdsk/c5t0d0
disk 7 0/4/0/1.1.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c5t1d0 /dev/rdsk/c5t1d0
disk 8 0/4/0/1.2.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c5t2d0 /dev/rdsk/c5t2d0
disk 9 0/4/0/1.3.0 sdisk CLAIMED DEVICE HP 36.4GMAS3367NC
/dev/dsk/c5t3d0 /dev/rdsk/c5t3d0
disk 14 0/4/0/1.4.0 sdisk CLAIMED DEVICE HP 36.4GST336607LC
/dev/dsk/c5t4d0 /dev/rdsk/c5t4d0
disk 15 0/4/0/1.5.0 sdisk CLAIMED DEVICE HP 36.4GST336607LC
/dev/dsk/c5t5d0 /dev/rdsk/c5t5d0

-*-*-*-*-**--*-*-*-*-*-*-*-*-*-*-*-*-
last rows from serviceguard log when I wanted to halt package


kill: 21152: The specified process does not exist.
ERROR: Function customer_defined_halt_cmds
ERROR: Failed to HALT customer commands
Jun 16 11:40:26 - Node "app2": Remove IP address 81.214.31.58 from subnet 81.214.31.0
Jun 16 11:40:26 - Node "app2": Unmounting filesystem on /dev/vg01/lvol1
Jun 16 11:40:27 - Node "app2": Deactivating volume group /dev/vg01
vgchange: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgchange: Warning: couldn't query all of the physical volumes.
vgchange: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgchange: Warning: couldn't query all of the physical volumes.
Deactivated volume group in Exclusive Mode.
Volume group "/dev/vg01" has been successfully changed.


-*-*-*-*-**--*-*-*-*-*-*-*-*-*-*-*-*-


root:/ > dd if=/dev/dsk/c4t0d0 of=/dev/null bs=1000000 count=50000
36420+1 records in
36420+1 records out
root:/ >


Any idea ?

Best Regards
Murat SULUHAN

[Joseph Loo]

hi,

u may need to rebuild your /etc/lvmtab:

# mv /etc/lvmtab /etc/lvmtab.old
# vgscan -v
to re-create lvmtab

try vgdisplay -v again.

regards.

[Pedro Cirne]

Hi,

Please post the output of:

strings /etc/lvmtab
pvdisplay /dev/dsk/c4t0d0

Pedro

[Murat SULUHAN]

Hi Joseph and Pedro

app2^root:/ > strings /etc/lvmtab
/dev/vg00
/dev/dsk/c1t15d0
/dev/dsk/c3t15d0
/dev/vg01
/dev/dsk/c4t0d0
/dev/dsk/c4t1d0
/dev/dsk/c5t0d0
/dev/dsk/c5t1d0
/dev/vg02
/dev/dsk/c4t2d0
/dev/dsk/c4t3d0
/dev/dsk/c5t2d0
/dev/dsk/c5t3d0



app2^root:/ > pvdisplay /dev/dsk/c4t0d0
pvdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t0d0":
The specified path does not correspond to physical volume attached to
this volume group
pvdisplay: Warning: couldn't query all of the physical volumes.
pvdisplay: Couldn't retrieve the names of the physical volumes
belonging to volume group "/dev/vg01".
pvdisplay: Cannot display physical volume "/dev/dsk/c4t0d0".


app2^root:/ > mv /etc/lvmtab /etc/lvmtab.old
app2^root:/ > vgscan -v
Creating "/etc/lvmtab".
vgscan: Couldn't access the list of physical volumes for volume group "/dev/vg00".
vgscan: Couldn't access the list of physical volumes for volume group "/dev/vg01".
vgscan: Couldn't access the list of physical volumes for volume group "/dev/vg02".


/dev/vg00
/dev/dsk/c1t15d0
/dev/dsk/c3t15d0


Following Physical Volumes belong to one Volume Group.
Unable to match these Physical Volumes to a Volume Group.
Use the vgimport command to complete the process.
/dev/dsk/c4t0d0
/dev/dsk/c4t5d0
/dev/dsk/c5t4d0
/dev/dsk/c5t5d0






/dev/vg01
/dev/dsk/c4t1d0
/dev/dsk/c4t4d0
/dev/dsk/c5t0d0
/dev/dsk/c5t1d0



/dev/vg02
/dev/dsk/c4t2d0
/dev/dsk/c4t3d0
/dev/dsk/c5t2d0
/dev/dsk/c5t3d0


Scan of Physical Volumes Complete.
app2^root:/ > vgdisplay -v /dev/vg01
Information in "/etc/lvmtab" differs from that in "/etc/lvmpvg".
Physical volume "/dev/dsk/c4t0d0" does not belong
to volume group "/dev/vg01".
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t4d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Volume groups ---
VG Name /dev/vg01
VG Write Access read/write
VG Status available, exclusive
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 4
Act PV 3
Max PE per PV 20000
VGDA 6
PE Size (Mbytes) 8
Total PE 13020
Alloc PE 13020
Free PE 0
Total PVG 1
Total Spare PVs 0
Total Spare PVs in use 0

vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t4d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Logical volumes ---
LV Name /dev/vg01/lvol1
LV Status available/stale
LV Size (Mbytes) 69440
Current LE 8680
Allocated PE 17360
Used PV 3


--- Physical volumes ---
PV Name /dev/dsk/c4t1d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t4d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t0d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t4d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t1d0
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c4t4d0":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

Thanks for your responses

Best Regards
Murat

[Joseph Loo]

hi,

from your serviceguard log, it seems that the volume group has been deactivated.

try this:

# vgchange -a y
to activate all volume group.


regards.

[Dietmar Konermann · Accepted solution]

Your vgdisplay output shows that the VG is active... however, not all PV ar attached to it:

Cur PV 4
Act PV 3

Since the PV c4t0d0 is accessible, you should simply try to attach the it by re-activating the VG:

# vgchange -a e vg01

This should solve your problem... otherwise please post the resulting error.

Best regards...
Dietmar.

[Murat SULUHAN]

Hi Dietmar

problem solved, thank you so much,

app2^root:/ > vgdisplay -v /dev/vg01
Information in "/etc/lvmtab" differs from that in "/etc/lvmpvg".
Physical volume "/dev/dsk/c4t0d0" does not belong
to volume group "/dev/vg01".
--- Volume groups ---
VG Name /dev/vg01
VG Write Access read/write
VG Status available, exclusive
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 4
Act PV 4
Max PE per PV 20000
VGDA 8
PE Size (Mbytes) 8
Total PE 17360
Alloc PE 17360
Free PE 0
Total PVG 1
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg01/lvol1
LV Status available/syncd
LV Size (Mbytes) 69440
Current LE 8680
Allocated PE 17360
Used PV 4


--- Physical volumes ---
PV Name /dev/dsk/c4t1d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c4t4d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t0d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On

PV Name /dev/dsk/c5t1d0
PV Status available
Total PE 4340
Free PE 0
Autoswitch On


I want to ask a question. I rebooted each server, after reboot my package has been activated and the package control script already have "vgchange -a e" line so why did I deal with this problem

Best Regards
Murat SULUHAN

[Dietmar Konermann]

Hmm... somthing's weird now. You posted your lvmtab contents and it showed c4t0d0. Now lvm complains about c4t0d0 not being part of vg01. And your vgdisplay output shows c4t4d0 instead!

Have you issued vgscan in the meantime? If yes, then I would suspect that now c4t4d0 is now listed for vg01 in lvmtab...

Could it be possible that the "old" c4t0d0 appears now as c4t4do? (E.g. because the disk modules have been swapped?).

That would of couse also explain the unattached PV. :-)

Best regards...
Dietmar.

[Murat SULUHAN]

Hi Dietmar

Thanks for your answers,

Maybe customer swapped the disk modules between arrays

Best Regards
Murat SULUHAN