cancel
Showing results for 
Search instead for 
Did you mean: 

Need Help - Urgent

 
S.S.
Super Advisor

Need Help - Urgent

Hi experts,

I have tried to extend the volume group.
For this, i have destroyed the unused 100gb volume group and have tried to extend that volume group to the required volume group 150gb current size.

After removing the vg test3working, i have extended those physical device files to the test4db4.
Here is the output i got:

# vgdisplay -v test4db4
--- Volume groups ---
VG Name /dev/test4db4
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 2
Act PV 2
Max PE per PV 65535
VGDA 4
PE Size (Mbytes) 32
Total PE 7998
Alloc PE 4799
Free PE 3199
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/test4db4/test4db4
LV Status available/syncd
LV Size (Mbytes) 153568
Current LE 4799
Allocated PE 4799
Used PV 1


--- Physical volumes ---
PV Name /dev/dsk/c4t2d2
PV Name /dev/dsk/c8t2d2 Alternate Link
PV Name /dev/dsk/c14t2d2 Alternate Link
PV Name /dev/dsk/c18t2d2 Alternate Link
PV Name /dev/dsk/c22t2d2 Alternate Link
PV Name /dev/dsk/c26t2d2 Alternate Link
PV Name /dev/dsk/c32t2d2 Alternate Link
PV Name /dev/dsk/c36t2d2 Alternate Link
PV Status available
Total PE 4799
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c4t1d5
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c32t1d5 Alternate Link
PV Status available
Total PE 3199
Free PE 3199
Autoswitch On
Proactive Polling On

The device files:

PV Name /dev/dsk/c4t1d5 Alternate Link
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c32t1d5 Alternate Link

are the destroyed volume group files which i have extended the required volume group test4db4.
After i tried to increase the size in sam but i have encountered the error.

vgcfgbackup: Invalid LVMREC on Physical Volume /dev/rdsk/c4t1d5

Due to that i have rechecked the vg device files, the device which i have extended are with the not available status.

After that i have performed the vgscan of /etc/lvmtab and now the vgdisplay is showing the following:


# vgdisplay -v /dev/test4db4
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c6t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c10t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c12t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c16t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c24t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c28t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c30t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c34t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Volume groups ---
VG Name /dev/test4db4
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 2
Act PV 1
Max PE per PV 65535
VGDA 2
PE Size (Mbytes) 32
Total PE 4799
Alloc PE 4799
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c6t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c10t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c12t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c16t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c24t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c28t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c30t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c34t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
--- Logical volumes ---
LV Name /dev/test4db4/test4db4
LV Status available/syncd
LV Size (Mbytes) 255936
Current LE 7998
Allocated PE 7998
Used PV 1


--- Physical volumes ---
PV Name /dev/dsk/c4t2d2
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c6t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c10t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c12t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c16t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c24t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c28t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c30t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query physical volume "/dev/dsk/c34t2d2":
The specified path does not correspond to physical volume attached to
this volume group
vgdisplay: Warning: couldn't query all of the physical volumes.
PV Name /dev/dsk/c8t2d2 Alternate Link
PV Name /dev/dsk/c14t2d2 Alternate Link
PV Name /dev/dsk/c18t2d2 Alternate Link
PV Name /dev/dsk/c22t2d2 Alternate Link
PV Name /dev/dsk/c26t2d2 Alternate Link
PV Name /dev/dsk/c32t2d2 Alternate Link
PV Name /dev/dsk/c36t2d2 Alternate Link
PV Status available
Total PE 4799
Free PE 0
Autoswitch On
Proactive Polling On


Kindly help me, now i am afraid what to do.

Waiting for your quick reply.

15 REPLIES
Kapil Jha
Honored Contributor

Re: Need Help - Urgent

did you reduce the volume properly
what i have understood from your post if
you removed one vg and extends the device to other VG.
What exact steps you followed?

BR,
Kapil+
I am in this small bowl, I wane see the real world......
S.S.
Super Advisor

Re: Need Help - Urgent

Hi experts,

Now, i switched back to original /etc/lvmtab file.
and the vgdisplay of test4db4 is looking fine and after that i have extended the vg with the device files and also i have created the alternate links also.

The output of vgdisplay test4db4 is:

# vgextend test4db4 /dev/dsk/c18t1d5 /dev/dsk/c14t1d5 /dev/dsk/c6t1d5# # vgdisplay -v test4db4 #
--- Volume groups ---
VG Name /dev/test4db4
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 4
Act PV 4
Max PE per PV 65535
VGDA 8
PE Size (Mbytes) 32
Total PE 14396
Alloc PE 14396
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/test4db4/test4db4
LV Status available/syncd
LV Size (Mbytes) 460672
Current LE 14396
Allocated PE 14396
Used PV 4


--- Physical volumes ---
PV Name /dev/dsk/c4t2d2
PV Name /dev/dsk/c8t2d2 Alternate Link
PV Name /dev/dsk/c14t2d2 Alternate Link
PV Name /dev/dsk/c18t2d2 Alternate Link
PV Name /dev/dsk/c22t2d2 Alternate Link
PV Name /dev/dsk/c26t2d2 Alternate Link
PV Name /dev/dsk/c32t2d2 Alternate Link
PV Name /dev/dsk/c36t2d2 Alternate Link
PV Status available
Total PE 4799
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c32t1d5
PV Status unavailable
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c36t1d5
PV Status unavailable
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c4t1d5
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Status available
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On


Two device files are showing as Unavailable PV status.
When i tried to reduce those device files the following error is encountered:

# vgreduce test4db4 /dev/dsk/c32t1d5
vgreduce: Physical volume "/dev/dsk/c32t1d5" could not be removed since some of its
physical extents are still in use.

Kindly help me how can we turn the status of pv to available.
The diskinfo output is showing correct info for above two device files and also those device files are in CLAIMED status of ioscan output.


Kapil Jha
Honored Contributor

Re: Need Help - Urgent

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=942766

This might help you point the missing step see the last post.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Kapil Jha
Honored Contributor

Re: Need Help - Urgent

as per my last post did you removed the LV earlier, destoyed old VG properly.

check all the lvdisplay -v lv
to see if this disk has any LVs spanned on it,
If yes move them with
pvmove -n lv_name disk_from disk_to

and reduce the VG.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
S.S.
Super Advisor

Re: Need Help - Urgent

Hi Kapil,

I have performed the following steps for this entire task.

# umount /dir_name



# vgchange -a n /dev/test3working



# vgexport /dev/test3working



# ll mapfile
# rm mapfile



# rm /dir_name
# cd /etc/lvmconf
# rm test3work*


Edited /etc/fstab file to remove the destroyed FS.




# strings /etc/lvmtab <==vg01 and it's associated disks has been removed from lvmtab file
# ll -d /dev/test3working <==System should prompt dir not found
# ll /dev/test3working/group <==System should prompt file not found


#vgextend test4db4


S.S.
Super Advisor

Re: Need Help - Urgent

Hi Kapil,

Except the unavailable pv links, still there should not be any data loss & can access this vg without any problem right because the alternative links are available.

Am i right?
Kapil Jha
Honored Contributor

Re: Need Help - Urgent

did you do pvcreate before adding to other VG.
I do not see in your steps.
BR,
Kapil+
I am in this small bowl, I wane see the real world......
S.S.
Super Advisor

Re: Need Help - Urgent

Hi Kapil,

I did the pvcreate command before extending the vg.

Used pvcreate -f
Kapil Jha
Honored Contributor

Re: Need Help - Urgent

ok so m so confused :)
if you want to reduce a disk from a VG it should not have any LV spanned on it
ie if you do
lvdisplay -v /dev/vg_name/lv*|grep disk_device

you should not get anything

reduce LV and remove VG and do pvcreate and use the disk anywhere else.

What you doing is exporting the VG and doing pvcrete and adding the PV to new VG.
So I suppose there should be noting wrong in what u doing.

Can you please let me know if my understaing is right and if yes in which steps out of above you facing issue.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
S.S.
Super Advisor

Re: Need Help - Urgent

Hi Kapil,

Thank you for advicing me.

I couldn't export the vg that unavailable disks are spanned to a LV.

Following are the outputs which would be very clear.


$ sudo /usr/sbin/vgdisplay -v test4db4|more
--- Volume groups ---
VG Name /dev/test4db4
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 16
Cur PV 4
Act PV 4
Max PE per PV 65535
VGDA 8
PE Size (Mbytes) 32
Total PE 14396
Alloc PE 14396
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/test4db4/test4db4
LV Status available/syncd
LV Size (Mbytes) 460672
Current LE 14396
Allocated PE 14396
Used PV 4


--- Physical volumes ---
PV Name /dev/dsk/c4t2d2
PV Name /dev/dsk/c8t2d2 Alternate Link
PV Name /dev/dsk/c14t2d2 Alternate Link
PV Name /dev/dsk/c18t2d2 Alternate Link
PV Name /dev/dsk/c22t2d2 Alternate Link
PV Name /dev/dsk/c26t2d2 Alternate Link
PV Name /dev/dsk/c32t2d2 Alternate Link
PV Name /dev/dsk/c36t2d2 Alternate Link
PV Status available
Total PE 4799
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c32t1d5
PV Status unavailable
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c36t1d5
PV Status unavailable
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c4t1d5
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Status available
Total PE 3199
Free PE 0
Autoswitch On
Proactive Polling On


$

$ sudo /usr/sbin/lvdisplay -v /dev/test4db4/test4db4|more
--- Logical volumes ---
LV Name /dev/test4db4/test4db4
VG Name /dev/test4db4
LV Permission read/write
LV Status available/syncd
Mirror copies 0
Consistency Recovery MWC
Schedule parallel
LV Size (Mbytes) 460672
Current LE 14396
Allocated PE 14396
Stripes 0
Stripe Size (Kbytes) 0
Bad block on
Allocation strict
IO Timeout (Seconds) default

--- Distribution of logical volume ---
PV Name LE on PV PE on PV
/dev/dsk/c4t2d2 4799 4799
/dev/dsk/c32t1d5 3199 3199
/dev/dsk/c36t1d5 3199 3199
/dev/dsk/c4t1d5 3199 3199


Kapil Jha
Honored Contributor

Re: Need Help - Urgent

I am sorry SS I still do not understand what problem you are facing.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Akif_1
Super Advisor

Re: Need Help - Urgent

Hi SS,

Be specific with your query and attach output file along with the reply.

#As i understand
#Remove VG space will be used for new VG / Existing VG

Clear above two points ...... I think KAPIl deserve for some ITRC points so assign whenever u get replies....

Rgd's
T(ogether) E(very one) A(chive) M(ore)
johnsonpk
Honored Contributor

Re: Need Help - Urgent

>>###### first VG display ........

VG Name /dev/test4db4
Cur PV 2 ******
Act PV 2
Total PE 7998 ******
Alloc PE 4799
Free PE 3199 ******
LV Name /dev/test4db4/test4db4
LV Size (Mbytes) 153568 ******
Current LE 4799 ******
Allocated PE 4799
Used PV 1 ******
PV Name /dev/dsk/c4t1d5
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c32t1d5 Alternate Link
PV Status available
Total PE 3199
Free PE 3199 *********



>>>######## Second Vg display .........


VG Name /dev/test4db4
Cur PV 4 ***********
Act PV 4
Total PE 14396 ********
Alloc PE 14396
Free PE 0

LV Name /dev/test4db4/test4db4
LV Status available/syncd
LV Size (Mbytes) 460672
Current LE 14396 ******
Allocated PE 14396
Used PV 4 *********

PV Name /dev/dsk/c32t1d5
PV Status unavailable
Total PE 3199 ****
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c36t1d5
PV Status unavailable
Total PE 3199 ******
Free PE 0
Autoswitch On
Proactive Polling On

PV Name /dev/dsk/c4t1d5
PV Name /dev/dsk/c28t1d5 Alternate Link
PV Name /dev/dsk/c24t1d5 Alternate Link
PV Name /dev/dsk/c18t1d5 Alternate Link
PV Name /dev/dsk/c14t1d5 Alternate Link
PV Name /dev/dsk/c6t1d5 Alternate Link
PV Status available
Total PE 3199 ********
Free PE 0


By closly comparing the two vgdisplay output you posted on two different posts , we can observe the below thing which seems to me Weird....

(see the lines with ***** on the vgdisplay output )

1) on the first vgdiplay , there was only two PV including the new one whcih you just extended and in the second output it becomes 4 and pvs listed are same
2)on the first vgdisplay /dev/dsk/c4t1d5 was primary and c6t1d5,c14t1d5,c18t1d5,c24t1d5,c28t1d5,c32t1d5 were all alternate link for that .. werein the second vgdisplay
/dev/dsk/c32t1d5 ,/dev/dsk/c36t1d5 & /dev/dsk/c4t1d5 are considered as separte PVs not just alternate links
3) LV size has bee increased from 153 GB to 460 GB, but you have only added 100GB LUN , This proves the above statement , (alternate links are considered as separate pvs)

4) the path /dev/dsk/c36t1d5 was not there in the first vgdisplay and on second it shows as a independent PV with out alternate links . was it added later ?
5) the second vgdisplay shows both the unavialable pV has used for the LV and,in that case you can not remove pV from VG untill the lv reduced from those PVS .

It is clear that there is some changes happened after adding the pv to that vg (other than lvextend) . What storage you have ? is it Hitachi ?Are you sure the old lvmtab is restored back ? whats is the O/S version ? do you have any LUN scanning software like powerpath/syminq/xpinfo/evainfo, try identifieing wwn number each pv.

Also, I would recommand you to take a back up of the LV before you play around with the situatiuon

Regards!
johnson

S.S.
Super Advisor

Re: Need Help - Urgent

Hi Johnson and Kapil,
Thank you for helping me.

I have totally destroyed the VG and have re-created it.
This problem got resolved.
S.S.
Super Advisor

Re: Need Help - Urgent

Problem solved.