LVM / VxFS size limits?

[Satish K. Vanimisetti]

Hi,

I maintain a HP workstation that is connected to a disk array via a Fiber Channel controller. The disk array is 2TB in size, divided into 4 virtual disks. These disks are part of a volume group on the workstation. The workstation has three logical volumes configured. We recently had to reconfigure and rebuild the backend array. I am trying to restore a 1TB filesystem from backups, and the restore fails after about 75G are restored. After that, I cannot create files on that filesystem. dd, cat, et al fail with an I/O error message.

My question: Are there size limits to VxFS filesystems? (The workstation does have two other large VxFS filesystems. So there has to be a way to circumvent this limitation). What is the way to create very large VxFS filesystems?

Thanks,
-Satish

[erics_1]

What layout_version are the filesystems?
fstyp -v /dev/vgname/lvolname

You're looking for the number next to
version:

Eric

[A. Clay Stephenson]

What OS and what vxfs version?

Also, what are you using to restore. It sounds as though the restore program is the problem rather than the filesystem. Even very old vxfs filesystems would support 128GB and your problems are appearing well before that limit. You could be missing critical patches. You simply haven't included enough information.

[Satish K. Vanimisetti]

# foreach i ( `ls /dev/vg00/lvol?` )
foreach? echo -n "$i\t"
foreach? fstyp -v $i | grep version
foreach? end
/dev/tcvg/lvol0 version: 4
/dev/tcvg/lvol1 version: 4
/dev/tcvg/lvol2 version: 4


lvol0 is a 1TB filesystem. (No problems)
lvol1 is supposed to be 1TB (Only accepts 75G)
lvol2 is 500G filesystem. (No problems)

Thanks,
-Satish

[Satish K. Vanimisetti]

I did not include more information because my question was very general. Sorry.
Here are the specifics:
# uname -a
HP-UX uzu B.11.11 U 9000/785 2004243840 unlimited-user license

The VxFS versions are in the previous post.

I will post the output of swlist if you need it.


Thanks.

[Steven E. Protter]

If largefiles are not enabled:

Filesize limit is 2 GB

If largefiles are enabled, the limit is 2 TB.

Based on this post.

Have a good weekend.

SEP

[Satish K. Vanimisetti]

Largefiles is enabled.
That was one of the first things I checked.

Thanks.

[erics_1]

Can you give us specifics on the error messages?
What is the output of lvdisplay on lvol1?
What about bdf?


Thanks,
Eric

[Satish K. Vanimisetti]

# bdf | grep tcvg
/dev/tcvg/lvol2 574685184 534038400 40329312 93% /tcvg2
/dev/tcvg/lvol0 1073725440 1038422952 35047384 97% /fastt
/dev/tcvg/lvol1 1073725440 79836296 986124392 7% /tcvg1


# lvdisplay /dev/tcvg/lvol1
--- Logical volumes ---
LV Name /dev/tcvg/lvol1
VG Name /dev/tcvg
LV Permission read/write
LV Status available/syncd
Mirror copies 0
Consistency Recovery MWC
Schedule parallel
LV Size (Mbytes) 1048560
Current LE 65535
Allocated PE 65535
Stripes 0
Stripe Size (Kbytes) 0
Bad block on
Allocation strict
IO Timeout (Seconds) default

[A. Clay Stephenson]

Vxfs versions 3&4 support filesystems up to 1TB and files up to 1TB. If I were you, I would slightly reduce the LVOL to fall below this value. I am still leaning towards your restore method as the actual culprit.

[Satish K. Vanimisetti]

I ruled the restore out because I'm not even able to create files by hand.

I've been looking at the outputs of lvdisplay -v and pvdisplay -v and it seems to be like there may be physical extents on certain disks that are mapped to multiple logical volumes. Is something like that plausible? Or does the LVM make sure such inconsistencies do not occur.

If you guys want me to, I will post the outputs of lvdisplay -v and pvdisplay -v.

Thanks.

[Satish K. Vanimisetti]

Here's an example of what has me confused:
# pvdisplay -v /dev/dsk/c6t0d2 | grep 1000
1000 current /dev/tcvg/lvol0 5784
1000 current /dev/tcvg/lvol1 5579
1000 current /dev/tcvg/lvol1 5580
1000 current /dev/tcvg/lvol1 5581
1000 current /dev/tcvg/lvol1 5582
1000 current /dev/tcvg/lvol1 5583
1000 current /dev/tcvg/lvol1 5584
1000 current /dev/tcvg/lvol1 5585
1000 current /dev/tcvg/lvol1 5586
1000 current /dev/tcvg/lvol1 5587
1000 current /dev/tcvg/lvol1 5588
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1442 current /dev/tcvg/lvol1 1000
1443 current /dev/tcvg/lvol1 1000

The same PE "1000" is mapped to multiple LE on multiple LVs. Is this normal? Or am I reading the output wrong?

Thanks,
-Satish

[erics_1]

Hard to say what exactly went wrong but certainly looks like there's a problem. I'd suggest destroying the lvol and re-create again.

Eric

[Devesh Pant_1]

Satish,
Maximum filesystem size is 32 TB on v2 and 2TB on v1
Maximum file size is 2TB

thanks
Devesh

[Senthil Kumar .A_1]

Hi Satish,

Can u attach the output of

* vgdisplay -v vgXX
* lvdisplay -v /dev/vgXX/lvol* of those three LV's.

And the command you are using for restore (exact syntax).

would like to view has any LVM limits are exceeded as we are talking about TB over here..

Regards.