topic Re: File size limit exceeded in Operating System - Linux

File size limit exceeded

Informatikai Tanszekcso — Thu, 10 Mar 2005 02:29:37 GMT

On DL380R0 (RHEL AS 3.4) I tried to copy home partition:

[root@node3 root]# time cp -ax /mnt/d2/* /mnt/d1
File size limit exceeded

real 186m2.077s
user 0m44.660s
sys 30m15.290s
[root@node3 root]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/cciss/c0d0p2 31G 2.4G 27G 9% /
/dev/cciss/c0d0p1 193M 16M 168M 9% /boot
none 1004M 0 1004M 0% /dev/shm
/dev/vgnfshome/lvol1 468G 53G 391G 12% /mnt/d1
/dev/cciss/c1d2p1 134G 110G 18G 87% /mnt/d2

This message is strange, using dd I can make files with size of 5G without any problem.

Any hints?

Re: File size limit exceeded

Vitaly Karasik_1 — Thu, 10 Mar 2005 03:27:49 GMT

IMHO, it's just some problem with "cp" buffers;
try "tar" instead.

Re: File size limit exceeded

Paul Cross_1 — Thu, 10 Mar 2005 15:04:09 GMT

I would tend to agree, I always do something like:

tar cf - /mnt/d2 | (cd /mnt/d1 ; tar xf -)

Re: File size limit exceeded

Jamal Al-Hammadi — Wed, 03 Aug 2005 19:13:35 GMT

I want to use a data file that has size more than 2GB in hpux 11i.What can I do to increase file size limit.

Re: File size limit exceeded

Ivan Ferreira — Wed, 03 Aug 2005 23:52:59 GMT

If i'm not wrong, the default maximum file size for ext3 is 2TB, or at least 1TB.

There are some commands that still complains about the file size, ftp, smbclient, are examples, and maybe cp is in this category.

So, you don't need to do anything to support large files, instead use the recommendations above.

Re: File size limit exceeded

Steven E. Protter — Thu, 04 Aug 2005 02:45:11 GMT

Filesize limits are 2 GB and then it goes to the TB level. This issue can not be filesystem, and appears not to be a space issue.

ext3 is a journaled filesystem and I think its supposed to defragment itself, so I can't think of a technical cause other than the cp binary or system resouces.

SEP

Re: File size limit exceeded

Stuart Browne — Thu, 04 Aug 2005 03:56:54 GMT

To save over head (i.e. instead of doing a double tar), try something like:

cd /mnt/d2
find . -print | cpio -pduvm /mnt/d1/

BUt I'd agree with all the other posts.

The only real question I'd have in response is what filesystem type is '/mnt/d1' ?