topic Re: Cannot execute LVM commands in Operating System - HP-UX

Cannot execute LVM commands

najibakiki — Sun, 27 Jan 2008 14:46:27 GMT

Hey guys,

I have a two node cluster, NSS1 and NSS2, the cluster and package is up and runing no prblem at all, But im facing a problem on NSS1. The servers are rp3440 HP-UX 11.11

Im not able to execute any command related to LVM, i get the following errors:

NSS1:/# lvlnboot -v
lvlnboot: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vglock".
lvlnboot: Volume group not activated.
Cannot display volume group "/dev/vgmxp".

NSS1:/# vgdisplay
vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vglock".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgmxp".

NSS1:/# vgchange -a y vg00
vgchange: Couldn't set the unique id for volume group "vg00":
File exists

NSS1:/# vgreduce /dev/vg00 /dev/dsk/c2t1d0
vgreduce: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the
group minor number is unique.

I have two disks that was mirrored now they are not, and when trying to do the mirror, when i arrive to the part:
lvextend -m 1 Iget the same error: couldn't query physical .....

These are additional information that may help

ll /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 13 04:38 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-rw-rw- 1 root sys 64 0x020000 Jul 13 10:29 /dev/vgmxp/group

strings etc/lvmtab

/dev/vg00
CB$$
/dev/dsk/c2t0d0
/dev/dsk/c2t1d0
/dev/vglock
/dev/dsk/c5t0d0
/dev/vgmxp
/dev/dsk/c5t1d0
/dev/dsk/c5t2d0
/dev/dsk/c5t3d0
/dev/dsk/c5t4d0
/dev/dsk/c5t5d0
/dev/dsk/c5t6d0
/dev/dsk/c5t7d0
/dev/dsk/c5t8d0
/dev/dsk/c4t1d0
/dev/dsk/c4t2d0
/dev/dsk/c4t3d0
/dev/dsk/c4t4d0
/dev/dsk/c4t5d0
/dev/dsk/c4t6d0
/dev/dsk/c4t7d0
/dev/dsk/c4t8d0

Appreciate your help, Thanks

Re: Cannot execute LVM commands

Noble Sebastian — Sun, 27 Jan 2008 15:21:33 GMT

Hi

You can Check Physical disk /dev/dsk/c2t1d0

and give the out put of all boot logial volumes and volume display

vgdisplay -v /dev/vg00
lvdsipaly -v /dev/vg00/lvol1

Regards
Noble

Re: Cannot execute LVM commands

Steven E. Protter — Sun, 27 Jan 2008 15:29:36 GMT

Shalom,

Seems to me a physical volume has gone missing.

Steps:
1) Identify it. Compare ioscan -fnC disk to your lvmtab output as a start.

2) You may need to do this:
cd /etc
mv lvmtab lvmtab.old
vgscan -a

Dangerous but also possibly needed:
vgreduce -f
# follow the instructions afterwareds.

What you have posted is the classic missing disk syndrome.

SEP

Re: Cannot execute LVM commands

najibakiki — Sun, 27 Jan 2008 15:59:11 GMT

Hey guys

first of all i cheked all my disk
Diskinfo and i run the dd command
they are all fine.

And ioscan and /etc/lvmtab are matched

in ioscan -fnCdisk
i got the /dev/dsk/c2t0d0 claimed
and also /dev/dsk/c2t1d0 calimed

same server disk as mentioned in lvmtab
and sure the other disk on the external disk system for the cluster

i cannot execute any vgdisplay neither lvdisplay.

i tried doing vgreduce but as mention earlier i get error even with the -f option

But its critical to delete and lvmtab and do vgscan i might loose the OS

Thanks. any ideas

Re: Cannot execute LVM commands

Michael Steele_2 — Sun, 27 Jan 2008 16:50:57 GMT

Can you attach

ls -la /dev/vg*/group

vgdisply -v vg00 from both nodes.

Re: Cannot execute LVM commands

najibakiki — Sun, 27 Jan 2008 18:54:40 GMT

Please find below teh following:

NSS1:

ll /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 13 04:38 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-rw-rw- 1 root sys 64 0x020000 Jul 13 10:29 /dev/vgmxp/group

vgdisplay -v /dev/vg00

vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number; Please check and make sure the group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".

NSS2:

l /dev/*/group

crw-r----- 1 root sys 64 0x000000 Jul 12 23:00 /dev/vg00/group
crw-rw-rw- 1 root sys 64 0x010000 Oct 5 2005 /dev/vglock/group
crw-r--r-- 1 root sys 64 0x020000 Jul 13 04:26 /dev/vgmxp/group

vgdisplay -v /dev/vg00

--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 8
Open LV 8
Max PV 16
Cur PV 2
Act PV 2
Max PE per PV 4350
VGDA 4
PE Size (Mbytes) 8
Total PE 8680
Alloc PE 3761
Free PE 4919
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/syncd
LV Size (Mbytes) 304
Current LE 38
Allocated PE 38
Used PV 1

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 16000
Current LE 2000
Allocated PE 2000
Used PV 1

LV Name /dev/vg00/lvol3
LV Status available/syncd
LV Size (Mbytes) 504
Current LE 63
Allocated PE 63
Used PV 1

LV Name /dev/vg00/lvol4
LV Status available/syncd
LV Size (Mbytes) 1000
Current LE 125
Allocated PE 125
Used PV 1

LV Name /dev/vg00/lvol5
LV Status available/syncd
LV Size (Mbytes) 1024
Current LE 128
Allocated PE 128
Used PV 1

LV Name /dev/vg00/lvol6
LV Status available/syncd
LV Size (Mbytes) 4000
Current LE 500
Allocated PE 500
Used PV 1

LV Name /dev/vg00/lvol7
LV Status available/syncd
LV Size (Mbytes) 2256
Current LE 282
Allocated PE 282
Used PV 1

LV Name /dev/vg00/lvol8
LV Status available/syncd
LV Size (Mbytes) 5000
Current LE 625
Allocated PE 625
Used PV 1

--- Physical volumes ---
PV Name /dev/dsk/c2t0d0
PV Status available
Total PE 4340
Free PE 579
Autoswitch On

PV Name /dev/dsk/c2t1d0
PV Status available
Total PE 4340
Free PE 4340
Autoswitch On

Thanks for ur help

Re: Cannot execute LVM commands

Michael Steele_2 — Mon, 28 Jan 2008 00:58:20 GMT

Here's your answer

http://www.docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf

vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number;
Please check and make sure the group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".
Cause:
This error has several possible causes:
a. There are multiple LVM group files with the same minor number.
b. Serviceguard was previously installed on the system, and the /dev/slvmvg device file still exists.
Recommended Action:
a. List the LVM group files. If there are any duplicate minor numbers, export one of the affected volume groups, create a new group file with a unique minor number, and re-import the volume group. If you are not familiar with this process, contact your HP support representative for assistance.
# ll /dev/*/group
# vgexport -m vgname.map -v -f vgname.file /dev/vgname
# mkdir /dev/vgname
# mknod /dev/vgname/group c 64 unique_minor_number
# vgimport -m vgname.map -v -f vgname.file /dev/vgname
b. Remove the /dev/slvmvg device file and recreate the /etc/lvmtab file using the following commands:
# rm /dev/slvmvg
# mv /etc/lvmtab /etc/lvmtab.old
# vgscan â v

Re: Cannot execute LVM commands

najibakiki — Mon, 28 Jan 2008 05:00:48 GMT

Thanks but as u saw from th e output before:

a) the LVM group files DONT have the same minor number. So why exporting then importing. Also mention that cannot export then import VG00 as u know the problem im facing is on the root VG (vg00)

b) there was no serviceguard inststalled, its already installed and runing just fine

The problems im facing are on VG00

Thanks

Re: Cannot execute LVM commands

whiteknight — Mon, 28 Jan 2008 06:09:59 GMT

Hi Najib,

Apparently the solution they given is correct

solution is:-
#mv /etc/lvmtab /etc/lvmtab.old
#vgscan -v

if you want to find out why, you need to log case to HP and provide them dump_lvmtab to check if there is any discrepancies.

WK

Re: Cannot execute LVM commands

najibakiki — Mon, 28 Jan 2008 08:21:44 GMT

Ok guys,

I will try to do it tomorrow and let you know.

Also mention that when trying to take ignite:

Make_tape_recovery -vA

i get the same errors above
Wierd!

Anyway i'll let u know what will happen.
Thanks

Re: Cannot execute LVM commands

Michael Steele_2 — Mon, 28 Jan 2008 14:18:08 GMT

Actually, this solution is for /etc/slvmvg. Easy to miss though. I had to put my reading glasses on to catch it. :0

b. Remove the /dev/slvmvg device file and recreate the /etc/lvmtab file using the following commands:
# rm /dev/slvmvg

If you google slvmvg you'll get hits on same problem.

Good luck and let me know if how you recover.

Re: Cannot execute LVM commands

najibakiki — Mon, 28 Jan 2008 15:20:55 GMT

Hi just to be sure when doing the below:

# rm /dev/slvmvg
# mv /etc/lvmtab /etc/lvmtab.old
# vgscan -a -v

Do i loose the serviceguard configuration? my cluster will be affected yes or no and does slvmvg will recreated again like lvmtab after doing vgscan?

Thanks

Re: Cannot execute LVM commands

Michael Steele_2 — Mon, 28 Jan 2008 18:14:14 GMT

Follow this manufacturer's provided procedure. (* Do you know of a higher authority? Surely not here in the user's forum! *)

Here's your answer

http://www.docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf

vgdisplay: Couldn't query volume group "/dev/vg00".
Possible error in the Volume Group minor number;
Please check and make sure the group minor number is unique.
vgdisplay: Cannot display volume group "/dev/vg00".
Cause:
This error has several possible causes:
a. There are multiple LVM group files with the same minor number.
b. Serviceguard was previously installed on the system, and the /dev/slvmvg device file still exists.
Recommended Action:
a. List the LVM group files. If there are any duplicate minor numbers, export one of the affected volume groups, create a new group file with a unique minor number, and re-import the volume group. If you are not familiar with this process, contact your HP support representative for assistance.
# ll /dev/*/group
# vgexport -m vgname.map -v -f vgname.file /dev/vgname
# mkdir /dev/vgname
# mknod /dev/vgname/group c 64 unique_minor_number
# vgimport -m vgname.map -v -f vgname.file /dev/vgname
b. Remove the /dev/slvmvg device file and recreate the /etc/lvmtab file using the following commands:
# rm /dev/slvmvg
# mv /etc/lvmtab /etc/lvmtab.old
# vgscan Ã¢Â Â v

Re: Cannot execute LVM commands

najibakiki — Tue, 29 Jan 2008 15:19:29 GMT

Hey guys :)

Problem solved by the following:

mv /etc/lvmtab /etc/lvmtab.old
vgscan -v -a

Bu i faced a problem my etc/lvmtab file
lost all the cluster VG and its PV
So i had to export and then import back these VG

Thanks all for ur help