Mirrored root disk failure

[nishith]

We have a mirrored root hard disk of 18GB. One HDD failed. I replaced with new one of 36GB (same type). After replacing the hot swappable disk online my ioscan output shows CLAIMED status.
Now when I give vgcfgrestore command to place the LVM headers to new disk I get the below message:

cluster1#vgcfgrestore -n /dev/vg00 /dev/rdsk/c1t0d0
vgcfgrestore: Cannot restore Physical Volume "/dev/dsk/c1t0d0",
Detach the PV or detactivate the VG, before restoring the PV.
vgdisplay output shows the new disk as unavailable.

Now my question is why I’m getting this error for vgcfgrestore command. Should I unattached the PV i.e., break the mirror (lvreduce,vgreduce) & start from a new mirroring.
Can I not perform the mirror restoration jus using the below procedure,
Vgcfgrestore –n /dev/vg00 /dev/rdsk/c1t0d0
Vgchange –a y vg00
Vgsync vg00

[Pete Randall · Accepted solution]

I would suggest reviewing this document for the exact steps you need to follow:

http://docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf


Pete

[Sanjay_6]

Hi,

Did you try a vgchange -a y to activate the disk after a vgcfgrestore.

vgcfgrestore could complain , but vgchange -a y could activate the disk and then vgdisplay should show the disk as available.

There is no reason for you to do lvreduce to reduce the mirror and vgreduce to reduce the disk from vg00 and start all over again.

Hope this helps.

regds

[Sivakumar TS]

Dear Nishith,

Was the new disk part of any VG before ?

You can do

#pvcreate -f /dev/rdsk/c1t0d0

and prceed with vgcfgrestore.

With Regards,

Siva.

[Andrew Rutter]

hi,

after you replaced the disk did you do a full ioscan, not just ioscan of disk devices?
Also did you re-create the device files after this?

if you did and you still cannot do the vgcfgrestore, is it possible that the disk has prevously been used in a system?
If so you may need to do a pvcreate -f on the disk to wipe it and make it clean for use.

you should beable to replace disk, wait a minute for disk to spin up and do a full ioscan
#ioscan
then
#insf -e
to create new device files
then #ioscan again before doing any lvm work.

Andy

[nishith]

hii all,
i have done every step as you have advised.

below is the steps

cluster1#pvcreate -f /dev/rdsk/c1t0d0
pvcreate: The physical volume "/dev/dsk/c1t0d0" is already recorded in the "/etc
/lvmtab" file.
You have mail in /var/mail/root
cluster1#ioscan
H/W Path Class Description
===================================================
root
0 ioa System Bus Adapter (582)
0/0 ba Local PCI Bus Adapter (782)
0/0/0/0 lan HP PCI 10/100Base-TX Core
0/0/1/0 ext_bus SCSI C896 Fast Wide LVD
0/0/1/0.7 target
0/0/1/0.7.0 ctl Initiator
0/0/1/0.9 target
0/0/1/0.9.0 disk HP 73.4GATLAS10K3_73_SCA
0/0/1/0.11 target
0/0/1/0.11.0 disk HP 73.4GST373405LC
0/0/1/0.13 target
0/0/1/0.13.0 disk HP 73.4GST373307LC
0/0/1/0.15 target
0/0/1/0.15.0 disk HP 73.4GST373307LC
0/0/1/1 ext_bus SCSI C896 Ultra Wide Single-Ended
0/0/1/1.0 target
0/0/1/1.0.0 disk HP 36.4GMAN3367MC
0/0/1/1.2 target
0/0/1/1.2.0 disk FUJITSU MAJ3364MC
0/0/1/1.7 target
0/0/1/1.7.0 ctl Initiator
0/0/2/0 ext_bus SCSI C87x Ultra Wide Single-Ended
0/0/2/0.2 target
0/0/2/0.2.0 disk HP 36.4GMAN3367MC
0/0/2/0.7 target
0/0/2/0.7.0 ctl Initiator
0/0/2/1 ext_bus SCSI C87x Ultra Wide Single-Ended
0/0/2/1.7 target
0/0/2/1.7.0 ctl Initiator
0/0/4/0 tty PCI Serial (103c1048)
0/0/5/0 tty PCI Serial (103c1048)
0/1 ba Local PCI Bus Adapter (782)
0/2 ba Local PCI Bus Adapter (782)
0/3 ba Local PCI Bus Adapter (782)
0/4 ba Local PCI Bus Adapter (782)
0/5 ba Local PCI Bus Adapter (782)
0/6 ba Local PCI Bus Adapter (782)
0/7 ba Local PCI Bus Adapter (782)
0/7/0/0 ba PCItoPCI Bridge
0/7/0/0/4/0 lan HP A5506B PCI 10/100Base-TX 4 Port
0/7/0/0/5/0 lan HP A5506B PCI 10/100Base-TX 4 Port
0/7/0/0/6/0 lan HP A5506B PCI 10/100Base-TX 4 Port
0/7/0/0/7/0 lan HP A5506B PCI 10/100Base-TX 4 Port
8 memory Memory
160 processor Processor
cluster1#insf -C
insf: option requires an argument -- C
usage: insf [-d driver | -C class] [-H hw_path] [-I instance] [-D dir] [-q|-v]
[-e] [-n npty] [-p first_cart:last_cart] [-s nstrpty]
cluster1#insf -C disk
insf: Installing special files for sdisk instance 6 address 0/0/1/1.0.0
insf: Installing special files for sdisk instance 7 address 0/0/2/0.2.0
cluster1#
cluster1#
cluster1#vgcfgrestore -n /dev/vg00 /dev/rdsk/c1t0d0
vgcfgrestore: Cannot restore Physical Volume "/dev/dsk/c1t0d0",
Detach the PV or detactivate the VG, before restoring the PV.
cluster1#vgchange -a y n
vgchange: Volume group "/dev/n" does not exist in the "/etc/lvmtab" file.
cluster1#vgchange -a y vg00
Volume group "vg00" has been successfully changed.
cluster1#vgdisplay -v vg00
--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 9
Open LV 9
Max PV 16
Cur PV 2
Act PV 2
Max PE per PV 4350
VGDA 4
PE Size (Mbytes) 8
Total PE 8680
Alloc PE 8106
Free PE 574
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/stale
LV Size (Mbytes) 304
Current LE 38
Allocated PE 76
Used PV 2

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 4096
Current LE 512
Allocated PE 1024
Used PV 2

LV Name /dev/vg00/lvol3
LV Status available/stale
LV Size (Mbytes) 200
Current LE 25
Allocated PE 50
Used PV 2

LV Name /dev/vg00/lvol4
LV Status available/stale
LV Size (Mbytes) 200
Current LE 25
Allocated PE 50
Used PV 2

LV Name /dev/vg00/lvol5
LV Status available/stale
LV Size (Mbytes) 24
Current LE 3
Allocated PE 6
Used PV 2

LV Name /dev/vg00/lvol6
LV Status available/stale
LV Size (Mbytes) 5000
Current LE 625
Allocated PE 1250
Used PV 2

LV Name /dev/vg00/lvol7
LV Status available/stale
LV Size (Mbytes) 8000
Current LE 1000
Allocated PE 2000
Used PV 2

LV Name /dev/vg00/lvol8
LV Status available/stale
LV Size (Mbytes) 4600
Current LE 575
Allocated PE 1150
Used PV 2

LV Name /dev/vg00/lvol9
LV Status available/stale
LV Size (Mbytes) 10000
Current LE 1250
Allocated PE 2500
Used PV 2


--- Physical volumes ---
PV Name /dev/dsk/c1t2d0
PV Status available
Total PE 4340
Free PE 287
Autoswitch On

PV Name /dev/dsk/c1t0d0
PV Status unavailable
Total PE 4340
Free PE 287
Autoswitch On


cluster1#

[nishith]

but still problem persists

[Raj D.]

Hi nishith ,

vgcfgrestore should work after pvcreate.

Here are the steps to remirror the faulty root mirror disk.

# pvcreate -B /dev/rdsk/c1t0d0
# vgcfgrestore -n /dev/vg00 /dev/rdsk/c1t0d0
# vgchange -a y /dev/vg00
# mkboot -a /dev/rdsk/c1t0d0
# mkboot -a "hpux -lq" /dev/rdsk/c1t0d0
# lvlnboot -R
# lvlnboot -v #(check).
# vgsync
# setboot #(check)
& check after rebooting.


Hope this will help,

hth,
Raj.

[Clifford Chi]

Hi nishith,

I think you might want to use the following procedure. Note: downtime required, you need to reboot the system to single-user mode

Replacing a mirrorred boot disk

ISL> hpux -is -lq

# mountall
# pvcreate -B -f /dev/rdsk/c1t0d0
# vgcfgrestore -n vg00 /dev/dsk/c1t0d0
# mkboot -l /dev/rdsk/c1t0d0
# mkboot -a "hpux -lq" /dev/rdsk/c1t0d0
# vgchange -a y /dev/vg00
# vgdisplay -v vg00
# lvdisplay -v /dev/vg00/lvol1 <--- to check each there is any stale
# lvdisplay -v /dev/vg00/lvol2
# lvdisplay -v /dev/vg00/lvol3

Note that the physical extents on primary boot disk are still stale. Resync them.
# vgsync vg00

# vgdisplay -v vg00
# lvdisplay -v /dev/vg00/lvol1 <--- to check each there is any stale
# lvdisplay -v /dev/vg00/lvol2
# lvdisplay -v /dev/vg00/lvol3

# lvlnboot -v <--- to verify you are seeing two root disks

[Shameer.V.A]

Hi nishith,

Please find the following thread. There is a procedure ( as pdf attachment) to replace the failed disk which was not failed while activating the vg.

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=986443


Hope this will help you,

Regards,

Shameer.V.A

[nishith]

i got some useful info that helped me solve the problem. thanking everyone's effort.