mount: No such device or address

[LawrenceLow]

In HP-UX 11i, I have two vg /dev/vgdb1 and /dev/vgdb2
Now I lost /dev/vgdb1
# vgdisplay -v /dev/vgdb1
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgdb1".
# vgchange -a y vg01
vgchange: Volume group "/dev/vg01" does not exist in the "/etc/lvmtab" file.
# vgchange -a y vgdb1
vgchange: Warning: Couldn't attach to the volume group physical volume "/dev/dsk/c20t0d0":
The path of the physical volume refers to a device that does not
exist, or is not configured into the kernel.
vgchange: Warning: couldn't query physical volume "/dev/dsk/c20t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgchange: Warning: couldn't query all of the physical volumes.
vgchange: Couldn't activate volume group "vgdb1":
Quorum not present, or some physical volume(s) are missing.

#


Please assist.

Thank you!!!

[Michal Kapalka (mikap)]

hi,

what exactly mean "Now I lost /dev/vgdb1"

you could send vgdisplay -v output.

mikap

[R.K. #]

HI ..

# vgchange -a y -q n /dev/vgdb1
then try..
# vgdisplay -v /dev/vgdb1

Some disks are not responding it seems.

[Basheer_2]

Hey Lawrence,

what does strings /etc/lvmtab return
(do you see vgs listed there)

if it has pvs for that vg, do
pvdisplay -v pv-name.

is it a serviceguard cluster.

[Bill Hassell]

> vgchange: Warning: couldn't query physical volume "/dev/dsk/c20t0d0"

This is a typical error for a disk failure. The vgchange command tries to read the LVM information from the beginning of the disk but the disk does not respond. It looks like a disk failure. You can try to read the disk with dd but I suspect you'll get a similar error:

dd if=/dev/rdskc20t0d0 of=/dev/null bs=1024 count=10

If dd works, then the LVM information may have been erased. You can try vgcfgrestore to put the LVM information back on the disk. However, more than just the LVM data may have been destroyed so the disk may be joined into the VG but rest of the data is not usable.

Also check /var/adm/syslog/syslog.log for disk error messages.

[LawrenceLow]

Hi Mikap,

I mean /dev/vgdb1 is missing.

# vgdisplay -v
--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 16
Open LV 16
Max PV 16
Cur PV 2
Act PV 2
Max PE per PV 4350
VGDA 4
PE Size (Mbytes) 8
Total PE 8680
Alloc PE 8670
Free PE 10
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/syncd
LV Size (Mbytes) 304
Current LE 38
Allocated PE 76
Used PV 2

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 6144
Current LE 768
Allocated PE 1536
Used PV 2

LV Name /dev/vg00/lvol3
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 64
Allocated PE 128
Used PV 2

LV Name /dev/vg00/lvol4
LV Status available/syncd
LV Size (Mbytes) 304
Current LE 38
Allocated PE 76
Used PV 2

LV Name /dev/vg00/lvol5
LV Status available/syncd
LV Size (Mbytes) 3000
Current LE 375
Allocated PE 750
Used PV 2

LV Name /dev/vg00/lvol6
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 64
Allocated PE 128
Used PV 2

LV Name /dev/vg00/lvol7
LV Status available/syncd
LV Size (Mbytes) 3000
Current LE 375
Allocated PE 750
Used PV 2

LV Name /dev/vg00/lvol8
LV Status available/syncd
LV Size (Mbytes) 6000
Current LE 750
Allocated PE 1500
Used PV 2

LV Name /dev/vg00/lvol9
LV Status available/syncd
LV Size (Mbytes) 2000
Current LE 250
Allocated PE 500
Used PV 2

LV Name /dev/vg00/lvol10
LV Status available/syncd
LV Size (Mbytes) 2904
Current LE 363
Allocated PE 726
Used PV 2

LV Name /dev/vg00/lvol11
LV Status available/syncd
LV Size (Mbytes) 2000
Current LE 250
Allocated PE 500
Used PV 2

LV Name /dev/vg00/lvol12
LV Status available/syncd
LV Size (Mbytes) 2000
Current LE 250
Allocated PE 500
Used PV 2

LV Name /dev/vg00/lvol13
LV Status available/syncd
LV Size (Mbytes) 2000
Current LE 250
Allocated PE 500
Used PV 2

LV Name /dev/vg00/lvol14
LV Status available/syncd
LV Size (Mbytes) 1000
Current LE 125
Allocated PE 250
Used PV 2

LV Name /dev/vg00/lvol15
LV Status available/syncd
LV Size (Mbytes) 1000
Current LE 125
Allocated PE 250
Used PV 2

LV Name /dev/vg00/lvol16
LV Status available/syncd
LV Size (Mbytes) 2000
Current LE 250
Allocated PE 500
Used PV 2


--- Physical volumes ---
PV Name /dev/dsk/c0t6d0
PV Status available
Total PE 4340
Free PE 5
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c3t6d0
PV Status available
Total PE 4340
Free PE 5
Autoswitch On
Proactive Polling On

#

[LawrenceLow]

Hi R.K,

Output as below:-

# vgchange -a y -q n /dev/vgdb1
vgchange: Warning: Couldn't attach to the volume group physical volume "/dev/dsk/c20t0d0":
The path of the physical volume refers to a device that does not
exist, or is not configured into the kernel.
vgchange: Warning: couldn't query physical volume "/dev/dsk/c20t0d0":
The specified path does not correspond to physical volume attached to
this volume group
vgchange: Warning: couldn't query all of the physical volumes.
vgchange: Couldn't activate volume group "/dev/vgdb1":
Quorum not present, or some physical volume(s) are missing.

# vgdisplay -v /dev/vgdb1
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgdb1".
#

[SoorajCleris]

Hi

Please post the below

1. #strings /etc/lvmtab
2. #ioscan -funC disk
3. #ioscan -fnC disk
4. #diskinfo dev/rdsk/c20t0d0

Regards,
Sooraj

[R.K. #]

Hi Lawrence,

Was there any changes made to the server after which this issue started?
Is this the only VG that is affected or any other VG facing similar issue (eg. vg01)?

Run vgscan in preview mode and compare it with existing lvmtab.
# vgscan -pav

Also,
# pvdisplay -v dev/dsk/c20t0d0
and see what VG and lvols are part of this disk. It should have vgdb1.

[LawrenceLow]

Hi Sooraj,

Output as below:-

# strings /etc/lvmtab
/dev/vg00
7|9+@k
/dev/dsk/c0t6d0
/dev/dsk/c3t6d0
/dev/vgdb1
7|9+C
/dev/dsk/c20t0d0
/dev/vgdb2
7|9+C
/dev/dsk/c20t0d1
/dev/vgdb3
7|9+C
/dev/dsk/c20t0d2
/dev/vgdb4
7|9+C
/dev/dsk/c20t0d3
/dev/vgdb6
7|9+J
/dev/dsk/c21t0d2
/dev/vgdb7
7|9+J
/dev/dsk/c21t0d3
/dev/vgdb8
7|9+J
/dev/dsk/c21t0d4
/dev/vgdb5
7|9+J
/dev/dsk/c21t0d1


# ioscan -funC disk
Class I H/W Path Driver S/W State H/W Type Description
===========================================================================
disk 0 1/0/0/3/0.6.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c0t6d0 /dev/rdsk/c0t6d0
disk 1 1/0/0/3/1.2.0 sdisk CLAIMED DEVICE HP DVD-ROM 305
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 2 1/0/1/0/0/1/1.6.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c3t6d0 /dev/rdsk/c3t6d0
disk 9 1/0/14/0/0.1.0.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d1 /dev/rdsk/c21t0d1
disk 11 1/0/14/0/0.1.0.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d2 /dev/rdsk/c21t0d2
disk 13 1/0/14/0/0.1.0.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d3 /dev/rdsk/c21t0d3
disk 15 1/0/14/0/0.1.0.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d4 /dev/rdsk/c21t0d4
disk 8 1/0/14/0/0.1.11.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d1 /dev/rdsk/c23t0d1
disk 10 1/0/14/0/0.1.11.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d2 /dev/rdsk/c23t0d2
disk 12 1/0/14/0/0.1.11.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d3 /dev/rdsk/c23t0d3
disk 14 1/0/14/0/0.1.11.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d4 /dev/rdsk/c23t0d4


# ioscan -fnC disk
Class I H/W Path Driver S/W State H/W Type Description
===========================================================================
disk 0 1/0/0/3/0.6.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c0t6d0 /dev/rdsk/c0t6d0
disk 1 1/0/0/3/1.2.0 sdisk CLAIMED DEVICE HP DVD-ROM 305
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 2 1/0/1/0/0/1/1.6.0 sdisk CLAIMED DEVICE HP 36.4GST336753LC
/dev/dsk/c3t6d0 /dev/rdsk/c3t6d0
disk 9 1/0/14/0/0.1.0.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d1 /dev/rdsk/c21t0d1
disk 11 1/0/14/0/0.1.0.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d2 /dev/rdsk/c21t0d2
disk 13 1/0/14/0/0.1.0.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d3 /dev/rdsk/c21t0d3
disk 15 1/0/14/0/0.1.0.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c21t0d4 /dev/rdsk/c21t0d4
disk 8 1/0/14/0/0.1.11.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d1 /dev/rdsk/c23t0d1
disk 10 1/0/14/0/0.1.11.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d2 /dev/rdsk/c23t0d2
disk 12 1/0/14/0/0.1.11.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d3 /dev/rdsk/c23t0d3
disk 14 1/0/14/0/0.1.11.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d4 /dev/rdsk/c23t0d4



# diskinfo dev/rdsk/c20t0d0
diskinfo: can't open dev/rdsk/c20t0d0: No such device or address
#

[LawrenceLow]

R.K,

# vgscan -pav
vgscan: The physical volume "/dev/dsk/c0t6d0" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c3t6d0" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c21t0d1" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c21t0d2" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c21t0d3" is already recorded in the "/etc/lvmtab" file.
vgscan: The physical volume "/dev/dsk/c21t0d4" is already recorded in the "/etc/lvmtab" file.
Couldn't stat physical volume "/dev/dsk/c1t2d0":
Invalid argument


/dev/vg00
/dev/dsk/c0t6d0
/dev/dsk/c3t6d0



/dev/vgdb5
/dev/dsk/c21t0d1
/dev/dsk/c23t0d1



/dev/vgdb6
/dev/dsk/c21t0d2
/dev/dsk/c23t0d2



/dev/vgdb7
/dev/dsk/c21t0d3
/dev/dsk/c23t0d3



/dev/vgdb8
/dev/dsk/c21t0d4
/dev/dsk/c23t0d4


The Volume Group /dev/vgdb1 was not matched with any Physical Volumes.
The Volume Group /dev/vgdb2 was not matched with any Physical Volumes.
The Volume Group /dev/vgdb3 was not matched with any Physical Volumes.
The Volume Group /dev/vgdb4 was not matched with any Physical Volumes.
#
# pvdisplay -v dev/dsk/c20t0d0
pvdisplay: Couldn't find the volume group to which
physical volume "dev/dsk/c20t0d0" belongs.
pvdisplay: Cannot display physical volume "dev/dsk/c20t0d0".
#

[SoorajCleris]

Hi,

Please do

#insf -eC disk

Currently there is no device like c2t0d0 exisiting


check what is the "mpt" number of that C2 - controller. Then check

#mptconfig and then /dev/mptx
then check what shows in target 0

Regards,
Sooraj

[Viktor Balogh]

># pvdisplay -v dev/dsk/c20t0d0
>pvdisplay: Couldn't find the volume group to >which
>physical volume "dev/dsk/c20t0d0" belongs.
>pvdisplay: Cannot display physical volume >"dev/dsk/c20t0d0".
>#

a / is missing in front of the path. try this way:

# pvdisplay -v /dev/dsk/c20t0d0

[LawrenceLow]

Sooraj,

# insf -eC disk
insf: Installing special files for sdisk instance 0 address 1/0/0/3/0.6.0
insf: Installing special files for sdisk instance 1 address 1/0/0/3/1.2.0
insf: Installing special files for sdisk instance 2 address 1/0/1/0/0/1/1.6.0
insf: Installing special files for sdisk instance 9 address 1/0/14/0/0.1.0.0.0.0.1
insf: Installing special files for sdisk instance 11 address 1/0/14/0/0.1.0.0.0.0.2
insf: Installing special files for sdisk instance 13 address 1/0/14/0/0.1.0.0.0.0.3
insf: Installing special files for sdisk instance 15 address 1/0/14/0/0.1.0.0.0.0.4
insf: Installing special files for sdisk instance 8 address 1/0/14/0/0.1.11.0.0.0.1
insf: Installing special files for sdisk instance 10 address 1/0/14/0/0.1.11.0.0.0.2
insf: Installing special files for sdisk instance 12 address 1/0/14/0/0.1.11.0.0.0.3
insf: Installing special files for sdisk instance 14 address 1/0/14/0/0.1.11.0.0.0.4
# pvdisplay -v /dev/dsk/c20t0d0
pvdisplay: Warning: couldn't query physical volume "/dev/dsk/c20t0d0":
The specified path does not correspond to physical volume attached to
this volume group
pvdisplay: Warning: couldn't query all of the physical volumes.
pvdisplay: Couldn't retrieve the names of the physical volumes
belonging to volume group "/dev/vgdb1".
pvdisplay: Cannot display physical volume "/dev/dsk/c20t0d0".
#

[R.K. #]

Hi Lawrence,

Time to forget c20t0d0 as it no longer exists.
Check if you have mapfiles of VGs.

If you have mapfile of vgdb1, you can try to import it.

# mv /etc/lvmtab /tmp/lvmtab.orig
# vgscan -v
# vgimport -p -v -s -m vgdb1
then
# vgimport -v -s -m vgdb1

[Vishu · Accepted solution]

Hi Lawrence,

in IOSCAN, it is clear that there is no disk coming from c20 controller. But you have some disk coming from c23 controller, those are:-

disk 8 1/0/14/0/0.1.11.0.0.0.1 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d1 /dev/rdsk/c23t0d1
disk 10 1/0/14/0/0.1.11.0.0.0.2 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d2 /dev/rdsk/c23t0d2
disk 12 1/0/14/0/0.1.11.0.0.0.3 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d3 /dev/rdsk/c23t0d3
disk 14 1/0/14/0/0.1.11.0.0.0.4 sdisk CLAIMED DEVICE HP HSV300
/dev/dsk/c23t0d4 /dev/rdsk/c23t0d4

Now, check if these are the multipathed disks for c21 controller disks. If they are the multipathed disks for C21 disks, then dont touch them. But if they are not, you can use them for your lost VGs.

If they are not the alternate path for c21, then check the LVM headers of those disks to see if they already have a VGID on it.

Actually, These disks are LUNs coming from the storage. has there any recent change been performed on this server/any controller replacement/ OR storage reconnected through a different controller?

[LawrenceLow]

Dear All,

The problem has been resolved. In fact, there is a battery faulty on my EVA controller. After changing the battery and restart the controller, everything back to normal.

Thanks for your help!! :)

[LawrenceLow]

Resolve.