Cannot execute LVM commands

[najibakiki]

Hey guys,

I have a two node cluster, NSS1 and NSS2, the cluster and package is up and runing no prblem at all, But im facing a problem on NSS1. The servers are rp3440 HP-UX 11.11

Im not able to execute any command related to LVM, i get the following errors:

NSS1:/# lvlnboot -v
lvlnboot: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vglock".
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vgmxp".


NSS1:/# vgdisplay
vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vglock".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgmxp".


NSS1:/# vgchange -a y vg00
vgchange: Couldn't set the unique id for volume group "vg00":
File exists



NSS1:/# vgreduce /dev/vg00 /dev/dsk/c2t1d0
vgreduce: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.


I have two disks that was mirrored now they are not, and when trying to do the mirror, when i arrive to the part:
lvextend -m 1 Iget the same error: couldn't query physical .....

These are additional information that may help

ll /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 13 04:38 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-rw-rw- 1 root sys 64 0x020000 Jul 13 10:29 /dev/vgmxp/group



strings etc/lvmtab

/dev/vg00
CB$$
/dev/dsk/c2t0d0
/dev/dsk/c2t1d0
/dev/vglock
/dev/dsk/c5t0d0
/dev/vgmxp
/dev/dsk/c5t1d0
/dev/dsk/c5t2d0
/dev/dsk/c5t3d0
/dev/dsk/c5t4d0
/dev/dsk/c5t5d0
/dev/dsk/c5t6d0
/dev/dsk/c5t7d0
/dev/dsk/c5t8d0
/dev/dsk/c4t1d0
/dev/dsk/c4t2d0
/dev/dsk/c4t3d0
/dev/dsk/c4t4d0
/dev/dsk/c4t5d0
/dev/dsk/c4t6d0
/dev/dsk/c4t7d0
/dev/dsk/c4t8d0


Appreciate your help, Thanks

[Noble Sebastian]

Hi

You can Check Physical disk /dev/dsk/c2t1d0

and give the out put of all boot logial volumes and volume display

vgdisplay -v /dev/vg00
lvdsipaly -v /dev/vg00/lvol1




Regards
Noble

[Steven E. Protter]

Shalom,

Seems to me a physical volume has gone missing.

Steps:
1) Identify it. Compare ioscan -fnC disk to your lvmtab output as a start.

2) You may need to do this:
cd /etc
mv lvmtab lvmtab.old
vgscan -a

Dangerous but also possibly needed:
vgreduce -f
# follow the instructions afterwareds.

What you have posted is the classic missing disk syndrome.

SEP

[najibakiki]

Hey guys

first of all i cheked all my disk
Diskinfo and i run the dd command
they are all fine.

And ioscan and /etc/lvmtab are matched

in ioscan -fnCdisk
i got the /dev/dsk/c2t0d0 claimed
and also /dev/dsk/c2t1d0 calimed

same server disk as mentioned in lvmtab
and sure the other disk on the external disk system for the cluster

i cannot execute any vgdisplay neither lvdisplay.

i tried doing vgreduce but as mention earlier i get error even with the -f option

But its critical to delete and lvmtab and do vgscan i might loose the OS

Thanks. any ideas

[Michael Steele_2]

Can you attach

ls -la /dev/vg*/group

vgdisply -v vg00 from both nodes.

[najibakiki]

Please find below teh following:

NSS1:

ll /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 13 04:38 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-rw-rw- 1 root sys 64 0x020000 Jul 13 10:29 /dev/vgmxp/group

vgdisplay -v /dev/vg00

vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".

NSS2:

l /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 12 23:00 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-r--r-- 1 root sys 64 0x020000 Jul 13 04:26 /dev/vgmxp/group

vgdisplay -v /dev/vg00

--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 8
Open LV 8
Max PV 16
Cur PV 2
Act PV 2
Max PE per PV 4350
VGDA 4
PE Size (Mbytes) 8
Total PE 8680
Alloc PE 3761
Free PE 4919
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/syncd
LV Size (Mbytes) 304
Current LE 38
Allocated PE 38
Used PV 1

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 16000
Current LE 2000
Allocated PE 2000
Used PV 1

LV Name /dev/vg00/lvol3
LV Status available/syncd
LV Size (Mbytes) 504
Current LE 63
Allocated PE 63
Used PV 1

LV Name /dev/vg00/lvol4
LV Status available/syncd
LV Size (Mbytes) 1000
Current LE 125
Allocated PE 125
Used PV 1

LV Name /dev/vg00/lvol5
LV Status available/syncd
LV Size (Mbytes) 1024
Current LE 128
Allocated PE 128
Used PV 1

LV Name /dev/vg00/lvol6
LV Status available/syncd
LV Size (Mbytes) 4000
Current LE 500
Allocated PE 500
Used PV 1

LV Name /dev/vg00/lvol7
LV Status available/syncd
LV Size (Mbytes) 2256
Current LE 282
Allocated PE 282
Used PV 1

LV Name /dev/vg00/lvol8
LV Status available/syncd
LV Size (Mbytes) 5000
Current LE 625
Allocated PE 625
Used PV 1


--- Physical volumes ---
PV Name /dev/dsk/c2t0d0
PV Status available
Total PE 4340
Free PE 579
Autoswitch On

PV Name /dev/dsk/c2t1d0
PV Status available
Total PE 4340
Free PE 4340
Autoswitch On


Thanks for ur help

[Michael Steele_2]

Here's your answer


http://www.docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf


vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number;
Please check and make sure the group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".
Cause:
This error has several possible causes:
a. There are multiple LVM group files with the same minor number.
b. Serviceguard was previously installed on the system, and the /dev/slvmvg device file still exists.
Recommended Action:
a. List the LVM group files. If there are any duplicate minor numbers, export one of the affected volume groups, create a new group file with a unique minor number, and re-import the volume group. If you are not familiar with this process, contact your HP support representative for assistance.
# ll /dev/*/group
# vgexport -m vgname.map -v -f vgname.file /dev/vgname
# mkdir /dev/vgname
# mknod /dev/vgname/group c 64 unique_minor_number
# vgimport -m vgname.map -v -f vgname.file /dev/vgname
b. Remove the /dev/slvmvg device file and recreate the /etc/lvmtab file using the following commands:
# rm /dev/slvmvg
# mv /etc/lvmtab /etc/lvmtab.old
# vgscan â v

[najibakiki]

Thanks but as u saw from th e output before:

a) the LVM group files DONT have the same minor number. So why exporting then importing. Also mention that cannot export then import VG00 as u know the problem im facing is on the root VG (vg00)


b) there was no serviceguard inststalled, its already installed and runing just fine

The problems im facing are on VG00

Thanks

[whiteknight]

Hi Najib,

Apparently the solution they given is correct

solution is:-
#mv /etc/lvmtab /etc/lvmtab.old
#vgscan -v

if you want to find out why, you need to log case to HP and provide them dump_lvmtab to check if there is any discrepancies.

WK

[najibakiki]

Ok guys,

I will try to do it tomorrow and let you know.

Also mention that when trying to take ignite:

Make_tape_recovery -vA

i get the same errors above
Wierd!

Anyway i'll let u know what will happen.
Thanks