Unable to match these physical volumes to a volume group

[Shukor]

My rp2405 unable to boot up due to this error on "Unable to match these physical volumes to a volume group". I boot into maintenance mode lvm and here is my latest ouput.
# vgdisplay -v vg00
vgdisplay: Volume group "/dev/vg00" does not exist in the "/etc/lvmtab" file.
vgdisplay: Cannot display volume group "vg00".

# ioscan -fnC disk
Class I H/W Path Driver S/W State H/W Type Description
======================================================================
disk 0 0/0/1/1.15.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c1t15d0 /dev/rdsk/c1t15d0
disk 1 0/0/2/1.15.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c3t15d0 /dev/rdsk/c3t15d0

Need your help please. Thanks in adv.

[Basheer_2]

Do these

1) cp /etc/lvmtab /etc/lvmtab.old
2) vgscan -a -v
3) strings /etc/lvmtab
4) vgchange -a y vg00
5) vgchange -a y -q n vg00

[Shukor]

I did

1) cp /etc/lvmtab /etc/lvmtab.old

2) vgscan -a -v
# vgscan -pv
vgscan: Warning: couldn't query physical volume "/dev/dsk/c1t15d0":
The specified path does not correspond to physical volume attached to this volume group
vgscan: Warning: couldn't query physical volume "/dev/dsk/c3t15d0":
The specified path does not correspond to physical volume attached to this volume group
vgscan: Warning: couldn't query all of the physical volumes.
vgscan: The physical volume "/dev/dsk/c1t15d0" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c3t15d0" is already recorded in the "/etc/lvmtab" file.
Couldn't stat physical volume "/dev/dsk/c3t15d0":
Invalid argument

Following Physical Volumes belong to one Volume Group. Unable to match these Physical Volumes to a Volume Group. Use the vgimport command to complete the process.
/dev/dsk/c1t15d0

3) strings /etc/lvmtab
sh: strings: not found

4) vgchange -a y vg00
vgchange: Warning: Couldn't attach to the volume group physical volume "/dev/dsk/c3t15d0":
Device busy
vgchange: Warning: couldn't query physical volume "/dev/dsk/c3t15d0":
The specified path does not correspond to physical volume attached to this volume group
vgchange: Warning: couldn't query all of the physical volumes.
vgchange: Couldn't activate volume group "/dev/vg00":
Quorum not present, or some physical volume(s) are missing.

5) vgchange -a y -q n vg0
(not yet coz not serial connected to server)

[Torsten.]

You did only copy the lvmtab file, not move.

Both disk are already recorded in lvmtab, so there is likely no need to do a vgscan.

However one of the disks maybe bad.

Try

# dd if=/dev/rdsk/... of=/dev/null bs=4096

and see if this completes without error.

[Torsten.]

I would try to remove disk c3t15d0 and boot with quorum mode.
I assume your disks are mirrored.

[Sunny123_1]

Hi

move the lvmtab file to lvmtab.old not to copy.Then do vgscan as said earlier.

Regards
Sunny

[Shukor]

Hi,

In the maintenance mode, I did teh said steps but returned with errors.

# mv /etc/lvmtab.org /etc/lvmtab

# vgchange -a y -q n vg00
vgchange: Volume group "/dev/vg00" does not exist in the "/etc/lvmtab" file.

# vgscan -pv
vgscan: Couldn't access the list of physical volumes for volume group "/dev/vg00".
Couldn't stat physical volume "/dev/dsk/c3t15d0":
Invalid argument

vgscan: has no correspoding valid raw device file under /dev/rdsk.
Verification of unique LVM disk id on each disk in the volume group
/dev/vg00 failed.

# dd if=/dev/rdsk/c1t15d0 of=/dev/null bs=4096
sh: dd: not found

[Shukor]

This is first error logged by my application user.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/opt/hpws/tomcat/logs
# tail -f catalina.out
Starting service Tomcat-Standalone
Apache Tomcat/4.1
file IO Exception:java.io.IOException: I/O error
file IO Exception:java.io.IOException: I/O error
Stopping service Tomcat-Standalone
StandardEngine[null]: setJvmRoute=TOMCAT5
Starting service Tomcat-Standalone
Apache Tomcat/4.1
file IO Exception:java.io.IOException: I/O error
file IO Exception:java.io.IOException: I/O error
# ./apachectl startssl
Pid 21647 killed due to text modification or page I/O error
./apachectl[176]: 21647 Bus error(coredump)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Really appreciates your help guys..

[Bill Hassell]

> mv /etc/lvmtab.org /etc/lvmtab

You need to rename lvmtab -- it must not exist. Use the command exactly:

mv /etc/lvmtab /etc/lvmtab.org

Now lvmtab is gone. Now you can rebuild the file correctly:

vgscan -a

> vgchange -a y -q n vg00

vg00 does not exist -- if the vgscan works OK, then vgchange will work.

> vgscan: has no correspoding valid raw device file under /dev/rdsk.
> Verification of unique LVM disk id on each disk in the volume group /dev/vg00 failed.

You have some major problems.

> file IO Exception:java.io.IOException: I/O error

You have disk problems but there isn't much of HP-UX left for you to use:

strings not found
dd not found
etc...

Because your vg00 volume cannot be activated, /usr doesn't exist so the only commands you have are located in /sbin. This cripples any typical troubleshooting. You will probably have to use your most recent Ignite backup tape to restore the system.

[R.K. #]

Hi Shukor,

>>mv /etc/lvmtab.org /etc/lvmtab
DO NOT move lvmtab.org but move lvmtab and recreate it by "vgscan -av" as mentioned earlier.


>>sh: strings: not found
>>sh: dd: not found
Because in maintenence mode /usr will NOT be mounted.
Mount /usr and these will work.

Regds,
R.K.

[Shukor]

Bill,

Since this 2nd webserver server doesn't have ignite backup but has another 1st webserver running with the same model, OS and FS. should I using ignite backup of 1st server to restore? Or any better idea?

[Torsten.]

"vgscan: has no correspoding valid raw device file under /dev/rdsk."

Did you check this?

Again, are the disks mirrored?

[Shukor]

yes, I did check.

# vgscan -pv
vgscan: Couldn't access the list of physical volumes for volume group "/dev/vg00".
Couldn't stat physical volume "/dev/dsk/c3t15d0":
Invalid argument

Following Physical Volumes belong to one Volume Group.
Unable to match these Physical Volumes to a Volume Group.
Use the vgimport command to complete the process.
/dev/dsk/c1t15d0

The Volume Group /dev/vg00 was not matched with any Physical Volumes.

[Shukor]

and..my LV is mirrow copy.

[Torsten.]

vgscan will not work if one of the disks in the VG is not accessible.

What happens if you bring lvmtab file back in place, remove c3t15d0 and boot in quorum mode?

[Shukor]

I'll try later because just away from datacentre. I'll update later. TQ

[Shukor]

Hi Torsten,

Could you please post the steps and command on;

- Bring lvmtab file back in place
- Remove c3t15d0
- Boot in quorum mode

I'll be in DataCentre this morning to try my luck again. Thank alot.

[Torsten.]

- Bring lvmtab file back in place

If you did for example

# mv /etc/lvmtab /etc/lvmtab.old

you now need to reverse this action

# mv /etc/lvmtab.old /etc/lvmtab

- Remove c3t15d0

if this is a rp24xx server, remove the front cover, open the "door" and remove the lower disk

- Boot in quorum mode

stop at boot menu, boot from the remaining disk, interact with ISL and do

> hpux -lq