lvextend: Not enough free physical extents available.

[Brent DeGennaro]

When attempting to extend an LV we're seeing this...


# lvextend -L 60000 /dev/vgdb1/opdat1

Warning: rounding up logical volume size to extent boundary at size "60416" MB for striping.

lvextend: Not enough free physical extents available.

Logical volume "/dev/vgdb1/opdat1" could not be extended.

lvextend: Couldn't retrieve the list of the physical volumes belonging to volume group "/dev/vgdb1".

Failure possibly caused by strict allocation policy



We recently added 22 additional luns to the VG so we could extend several LV's but so far we've been unable to.




# vgdisplay -v vgdb1
--- Volume groups ---
VG Name /dev/vgdb1
VG Write Access read/write
VG Status available, exclusive
Max LV 255
Cur LV 11
Open LV 11
Max PV 64
Cur PV 54
Act PV 54
Max PE per PV 1016
VGDA 108
PE Size (Mbytes) 16
Total PE 46872
Alloc PE 27360
Free PE 19512
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vgdb1/opohom
LV Status available/syncd
LV Size (Mbytes) 3072
Current LE 192
Allocated PE 192
Used PV 32

LV Name /dev/vgdb1/oparc1
LV Status available/syncd
LV Size (Mbytes) 13824
Current LE 864
Allocated PE 864
Used PV 32

LV Name /dev/vgdb1/opclrd1
LV Status available/syncd
LV Size (Mbytes) 1024
Current LE 64
Allocated PE 64
Used PV 32

LV Name /dev/vgdb1/opclrd2
LV Status available/syncd
LV Size (Mbytes) 1024
Current LE 64
Allocated PE 64
Used PV 32

LV Name /dev/vgdb1/oprbtp1
LV Status available/syncd
LV Size (Mbytes) 12288
Current LE 768
Allocated PE 768
Used PV 32

LV Name /dev/vgdb1/oprbtp2
LV Status available/syncd
LV Size (Mbytes) 12288
Current LE 768
Allocated PE 768
Used PV 32

LV Name /dev/vgdb1/opdat1
LV Status available/syncd
LV Size (Mbytes) 35328
Current LE 2208
Allocated PE 2208
Used PV 32

LV Name /dev/vgdb1/opdat2
LV Status available/syncd
LV Size (Mbytes) 78336
Current LE 4896
Allocated PE 4896
Used PV 32

LV Name /dev/vgdb1/opdat3
LV Status available/syncd
LV Size (Mbytes) 95232
Current LE 5952
Allocated PE 5952
Used PV 32

LV Name /dev/vgdb1/opdat4
LV Status available/syncd
LV Size (Mbytes) 95232
Current LE 5952
Allocated PE 5952
Used PV 32

LV Name /dev/vgdb1/opbak1
LV Status available/syncd
LV Size (Mbytes) 90112
Current LE 5632
Allocated PE 5632
Used PV 32


--- Physical volumes ---
PV Name /dev/dsk/c4t8d0
PV Name /dev/dsk/c6t8d0 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d1
PV Name /dev/dsk/c6t8d1 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d2
PV Name /dev/dsk/c6t8d2 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d3
PV Name /dev/dsk/c6t8d3 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d4
PV Name /dev/dsk/c6t8d4 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d5
PV Name /dev/dsk/c6t8d5 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d6
PV Name /dev/dsk/c6t8d6 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t8d7
PV Name /dev/dsk/c6t8d7 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d0
PV Name /dev/dsk/c6t9d0 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d1
PV Name /dev/dsk/c6t9d1 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d2
PV Name /dev/dsk/c6t9d2 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d3
PV Name /dev/dsk/c6t9d3 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d4
PV Name /dev/dsk/c6t9d4 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d5
PV Name /dev/dsk/c6t9d5 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d6
PV Name /dev/dsk/c6t9d6 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t9d7
PV Name /dev/dsk/c6t9d7 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d0
PV Name /dev/dsk/c6t10d0 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d1
PV Name /dev/dsk/c6t10d1 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d2
PV Name /dev/dsk/c6t10d2 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d3
PV Name /dev/dsk/c6t10d3 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d4
PV Name /dev/dsk/c6t10d4 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d5
PV Name /dev/dsk/c6t10d5 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d6
PV Name /dev/dsk/c6t10d6 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t10d7
PV Name /dev/dsk/c6t10d7 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d0
PV Name /dev/dsk/c6t11d0 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d1
PV Name /dev/dsk/c6t11d1 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d2
PV Name /dev/dsk/c6t11d2 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d3
PV Name /dev/dsk/c6t11d3 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d4
PV Name /dev/dsk/c6t11d4 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d5
PV Name /dev/dsk/c6t11d5 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d6
PV Name /dev/dsk/c6t11d6 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c4t11d7
PV Name /dev/dsk/c6t11d7 Alternate Link
PV Status available
Total PE 868
Free PE 13
Autoswitch On

PV Name /dev/dsk/c10t13d2
PV Name /dev/dsk/c11t13d2 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t13d3
PV Name /dev/dsk/c11t13d3 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t13d4
PV Name /dev/dsk/c11t13d4 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t13d5
PV Name /dev/dsk/c11t13d5 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t13d6
PV Name /dev/dsk/c11t13d6 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t13d7
PV Name /dev/dsk/c11t13d7 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d0
PV Name /dev/dsk/c11t14d0 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d1
PV Name /dev/dsk/c11t14d1 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d2
PV Name /dev/dsk/c11t14d2 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d3
PV Name /dev/dsk/c11t14d3 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d4
PV Name /dev/dsk/c11t14d4 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d5
PV Name /dev/dsk/c11t14d5 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d6
PV Name /dev/dsk/c11t14d6 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t14d7
PV Name /dev/dsk/c11t14d7 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d0
PV Name /dev/dsk/c11t15d0 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d1
PV Name /dev/dsk/c11t15d1 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d2
PV Name /dev/dsk/c11t15d2 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d3
PV Name /dev/dsk/c11t15d3 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d4
PV Name /dev/dsk/c11t15d4 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d5
PV Name /dev/dsk/c11t15d5 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d6
PV Name /dev/dsk/c11t15d6 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On

PV Name /dev/dsk/c10t15d7
PV Name /dev/dsk/c11t15d7 Alternate Link
PV Status available
Total PE 868
Free PE 868
Autoswitch On








# lvdisplay /dev/vgdb1/opdat1 | more
--- Logical volumes ---
LV Name /dev/vgdb1/opdat1
VG Name /dev/vgdb1
LV Permission read/write
LV Status available/syncd
Mirror copies 0
Consistency Recovery MWC
Schedule striped
LV Size (Mbytes) 35328
Current LE 2208
Allocated PE 2208
Stripes 32
Stripe Size (Kbytes) 1024
Bad block on
Allocation strict
IO Timeout (Seconds) default



Any ideas on what we're missing here?

[sujit kumar singh · Accepted solution]

Hi

your present LVs are all 32 Way striped and are striped LVs.

you shall need 32 new disks in order to faclitate this expansion, whereas you have added 22 new disks only in the VG.

regards
sujit

[R.K. #]

Hi Brent,

You have a total of 54 disks in this VG whereas striping is 32-way, so for LV expansion, you will need 32-22=10 more disks in VG.

[Brent DeGennaro]

Thanks for the replies. I'm assuming that in this instance the 32 disks we initially used in the LV don't have any space available to be evenly striped across. Based on that we need to add 10 additional disks taking us to 64 and we will be able to stripe across the 32 new disks. Yes?

[Patrick Wallek]

>>I'm assuming that in this instance the 32
>>disks we initially used in the LV don't have
>>any space available to be evenly striped
>>across.

Total PE 868
Free PE 13

Not true. Each of your original disks has 13 extents free, which equates to 208 MB free per disk (16 MB PE size * 13 free PEs) and a total of 6,656 MB across all 32 disks.

If you want to expand an LV by that amount or less, you are OK.


>>Based on that we need to add 10 additional
>>disks taking us to 64 and we will be able
>>to stripe across the 32 new disks. Yes?

Yes, that is correct!

[Brent DeGennaro]

Thank you Patrick.

One last question. I read in the man page for lvchange...


If a logical volume is striped, its scheduling policy is always parallel and its allocation policy is always strict and noncontiguous; these attributes cannot be changed with lvchange.


Does this always hold true?

[Patrick Wallek]

I think once an LV is striped, with the '-i' and '-I' options of lvcreate, it can't be "un-striped".

There's no way I know of to turn striping off, so once it is done you are stuck with it.

[shanmuhanandam]

Hi,
Once the lv is created with stripping, it can't be revert back. there is only option you need to recreate the lv.

Regards,
Shanmugam.