1828456 Members
3794 Online
109978 Solutions
New Discussion

File size limit exceeded

 

File size limit exceeded

On DL380R0 (RHEL AS 3.4) I tried to copy home partition:

[root@node3 root]# time cp -ax /mnt/d2/* /mnt/d1
File size limit exceeded

real 186m2.077s
user 0m44.660s
sys 30m15.290s
[root@node3 root]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/cciss/c0d0p2 31G 2.4G 27G 9% /
/dev/cciss/c0d0p1 193M 16M 168M 9% /boot
none 1004M 0 1004M 0% /dev/shm
/dev/vgnfshome/lvol1 468G 53G 391G 12% /mnt/d1
/dev/cciss/c1d2p1 134G 110G 18G 87% /mnt/d2

This message is strange, using dd I can make files with size of 5G without any problem.

Any hints?
6 REPLIES 6
Vitaly Karasik_1
Honored Contributor

Re: File size limit exceeded

IMHO, it's just some problem with "cp" buffers;
try "tar" instead.
Paul Cross_1
Respected Contributor

Re: File size limit exceeded

I would tend to agree, I always do something like:

tar cf - /mnt/d2 | (cd /mnt/d1 ; tar xf -)

Jamal Al-Hammadi
Occasional Contributor

Re: File size limit exceeded

I want to use a data file that has size more than 2GB in hpux 11i.What can I do to increase file size limit.
Ivan Ferreira
Honored Contributor

Re: File size limit exceeded

If i'm not wrong, the default maximum file size for ext3 is 2TB, or at least 1TB.

There are some commands that still complains about the file size, ftp, smbclient, are examples, and maybe cp is in this category.

So, you don't need to do anything to support large files, instead use the recommendations above.
Por que hacerlo dificil si es posible hacerlo facil? - Why do it the hard way, when you can do it the easy way?
Steven E. Protter
Exalted Contributor

Re: File size limit exceeded

Filesize limits are 2 GB and then it goes to the TB level. This issue can not be filesystem, and appears not to be a space issue.

ext3 is a journaled filesystem and I think its supposed to defragment itself, so I can't think of a technical cause other than the cp binary or system resouces.

SEP
Steven E Protter
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com
Stuart Browne
Honored Contributor

Re: File size limit exceeded

To save over head (i.e. instead of doing a double tar), try something like:

cd /mnt/d2
find . -print | cpio -pduvm /mnt/d1/

BUt I'd agree with all the other posts.

The only real question I'd have in response is what filesystem type is '/mnt/d1' ?
One long-haired git at your service...