unable to break mirror on drive? physical volumes are not responding

[Jerry_109]

Hello HP,

We have a drive ( c3t2d0 ) which was reported by isee, and HP recommended the drive be replaced. We attempted to break the mirror, but lvreduce hangs for hours.

It seems this morning the lvreduce command completed, but as forecasted the autobackup failed accessing drive
/dev/rdsk/c3t2d0. So no need to reboot because of hung lvreduce. I attempted to use hp's command ( lvreduce -A n -k -m 0 /dev/vg00/tmp /dev/dsk/c3t2d0 ) to avoid the autobackup
portion, but it failed with physical volumes are not responding. Please advise.


#######################################
root@hohp117[/root]
# lvreduce -m 0 /dev/vg00/home
Logical volume "/dev/vg00/home" has been successfully reduced.
lvlnboot: Logical Volume has no extents.
lvlnboot: Logical Volume has no extents.
lvlnboot: Logical Volume has no extents.


vgcfgbackup: IO error on Physical Volume device /dev/rdsk/c3t2d0: I/O error
You have mail in /var/mail/root
######################################

root@hohp117[/sbin/init.d]
# lvreduce -A n -k -m 0 /dev/vg00/tmp /dev/dsk/c3t2d0
Physical extents on remaining physical volumes are stale or
Remaining physical volumes are not responding.
lvreduce: The LVM device driver failed to reduce mirrors on
the logical volume "/dev/vg00/tmp".
######################################
System info :

root@hohp117[/sbin/init.d]
# uname -a ; model
HP-UX hohp117 B.11.11 U 9000/800/rp3440


root@hohp117[/sbin/init.d]
# /etc/ioscan -nfkC disk
Class I H/W Path Driver S/W State H/W Type Description
=========================================================================
disk 0 0/0/2/0.0.0.0 sdisk CLAIMED DEVICE TEAC DW-224E
/dev/dsk/c0t0d0 /dev/rdsk/c0t0d0
disk 1 0/1/1/0.0.0 sdisk CLAIMED DEVICE HP 146 GST3146807LC
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0
disk 2 0/1/1/0.1.0 sdisk CLAIMED DEVICE HP 146 GST3146807LC
/dev/dsk/c2t1d0 /dev/rdsk/c2t1d0
disk 3 0/1/1/1.2.0 sdisk CLAIMED DEVICE HP 146 GMAP3147NC
/dev/dsk/c3t2d0 /dev/rdsk/c3t2d0



root@hohp117[/root]
# lvlnboot -v
Boot Definitions for Volume Group /dev/vg00:
Physical Volumes belonging in Root Volume Group:
/dev/dsk/c2t0d0 (0/1/1/0.0.0) -- Boot Disk
/dev/dsk/c2t1d0 (0/1/1/0.1.0) -- Boot Disk
/dev/dsk/c3t2d0 (0/1/1/1.2.0)
Boot: stand on: /dev/dsk/c2t0d0
/dev/dsk/c3t2d0
Root: root on: /dev/dsk/c2t0d0
/dev/dsk/c3t2d0
Swap: swap on: /dev/dsk/c2t0d0
/dev/dsk/c3t2d0
Dump: swap on: /dev/dsk/c2t0d0, 0



root@hohp117[/root]
# pvdisplay -v /dev/dsk/c2t0d0 | more
--- Physical volumes ---
PV Name /dev/dsk/c2t0d0
VG Name /dev/vg00
PV Status available
Allocatable yes
VGDA 2
Cur LV 20
PE Size (Mbytes) 32
Total PE 4374
Free PE 0
Allocated PE 4374
Stale PE 0
IO Timeout (Seconds) default
Autoswitch On
Proactive Polling On

--- Distribution of physical volume ---
LV Name LE of LV PE for LV
/dev/vg00/scif 7 7
/dev/vg00/home 64 64
/dev/vg00/stand 13 13
/dev/vg00/swap 128 128
/dev/vg00/opt 69 69
/dev/vg00/tmp 64 64
/dev/vg00/usr 128 128
/dev/vg00/crash 128 128
/dev/vg00/var 128 128
/dev/vg00/appl 32 32
/dev/vg00/varmqm 313 313
/dev/vg00/varmqmlog 32 32
/dev/vg00/varmqmerror 32 32
/dev/vg00/root 32 32
/dev/vg00/u01 313 313
/dev/vg00/optmqm 63 63
/dev/vg00/u98 312 312
/dev/vg00/filler2 2171 2171
/dev/vg00/u99 313 313
/dev/vg00/firstlogic 32 32



--- Physical volumes ---
PV Name /dev/dsk/c2t1d0
VG Name /dev/vg00
PV Status available
Allocatable yes
VGDA 2
Cur LV 6
PE Size (Mbytes) 32
Total PE 4374
Free PE 19
Allocated PE 4355
Stale PE 0
IO Timeout (Seconds) default
Autoswitch On
Proactive Polling On

--- Distribution of physical volume ---
LV Name LE of LV PE for LV
/dev/vg00/opt 13 13
/dev/vg00/varmqmlog 128 128
/dev/vg00/filler1 480 480
/dev/vg00/u00 1499 1499
/dev/vg00/filler2 2171 2171
/dev/vg00/firstlogic 64 64


root@hohp117[/root]
# pvdisplay -v /dev/dsk/c3t2d0 | more
--- Physical volumes ---
PV Name /dev/dsk/c3t2d0
VG Name /dev/vg00
PV Status unavailable
Allocatable yes
VGDA 2
Cur LV 21
PE Size (Mbytes) 32
Total PE 4374
Free PE 19
Allocated PE 4355
Stale PE 188
IO Timeout (Seconds) default
Autoswitch On
Proactive Polling On

--- Distribution of physical volume ---
LV Name LE of LV PE for LV
/dev/vg00/scif 7 7
/dev/vg00/home 64 64
/dev/vg00/stand 13 13
/dev/vg00/swap 128 128
/dev/vg00/opt 82 82
/dev/vg00/tmp 64 64
/dev/vg00/usr 128 128
/dev/vg00/crash 128 128
/dev/vg00/var 128 128
/dev/vg00/appl 32 32
/dev/vg00/varmqm 313 313
/dev/vg00/varmqmlog 160 160
/dev/vg00/varmqmerror 32 32
/dev/vg00/root 32 32
/dev/vg00/u01 313 313
/dev/vg00/optmqm 63 63
/dev/vg00/filler1 480 480
/dev/vg00/u98 312 312
/dev/vg00/u00 1499 1499
/dev/vg00/u99 313 313
/dev/vg00/firstlogic 64 64

###################################################

[Torsten. · Accepted solution]

Normally there is no need to reduce the mirror copies, the command

# pvchange -a y /dev/dsk/c3t2d0

will make the disk unavailable to LVM and ready to pull.

Try if this helps.

This message doesn't look so well:

"Physical extents on remaining physical volumes are stale or ..."

Check if there are stale extends on the remaining disks (pvdisplay -v ...).

[Torsten.]

Sorry, should be

pvchange -a n

of course.

[Jerry_109]

root@hohp117[/etc/lvmconf]
# pvdisplay -v /dev/dsk/c2t0d0 | grep -i stale
Stale PE 0
root@hohp117[/etc/lvmconf]
# pvdisplay -v /dev/dsk/c2t1d0 | grep -i stale
Stale PE 0
root@hohp117[/etc/lvmconf]
# pvdisplay -v /dev/dsk/c3t2d0 | grep -i stale | wc -l
189

[Torsten.]

I would not reduce the mirror, but only prevent LVM access and exchange the drive.

Do you already know this?

http://docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf

[Jerry_109]

prevent lvm access? Is this the pvchange command you gave me before ?

[Torsten.]

Yes.

pvchange -a n /dev/...

From the wite paper:

"Devices that are hot-replaceable can be replaced online using the LVM OLR feature
without deactivating the volume group or changing the volume group configuration"

see also

man pvchange