Online Expert Day - HPE Data Storage - Live Now
April 24/25 - Online Expert Day - HPE Data Storage - Live Now
Read more
System Administration
cancel
Showing results for 
Search instead for 
Did you mean: 

unable to create a file more than 2 GB

Pradep
Regular Advisor

unable to create a file more than 2 GB

hpux11.11 patch June2007

unable to create largefiles with using DD for test and even oracle database.

largefiles options is enabled for FS and mounted too.

fstyp -v /dev/vgdbbacktst/lvdbback
vxfs
version: 3
f_bsize: 8192
f_frsize: 2048
f_blocks: 92160000
f_bfree: 37307917
f_bavail: 36142301
f_files: 9346944
f_ffree: 9326976
f_favail: 9326976
f_fsid: 1075314689
f_basetype: vxfs
f_namemax: 254
f_magic: a501fcf5
f_featurebits: 0
f_flag: 16
f_fsindex: 7
f_size: 92160000


error during dd from /dev/zero
dd if=/dev/zero of=mountpoint bs=65535k
I/O error
32 records in
31 records out

following error where creating a 3GB database file from oracle

ORA-01119: error in creating database file
'/sngess01/u22/ORACLE/p116p/devp01.dbf'
ORA-27044: unable to write the header block of file
HP-UX Error: 22: Invalid argument

please help.
Points on the way once issue solved.
thanks.
20 REPLIES
Suraj K Sankari
Honored Contributor

Re: unable to create a file more than 2 GB

Kapil Jha
Honored Contributor

Re: unable to create a file more than 2 GB

Try to create a separate large file and see if that working, it should be cause, this seems to be something related to oracle not UNIX.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

dd is not working..so i would say its still at OS level, not oracle.

Kapil Jha
Honored Contributor

Re: unable to create a file more than 2 GB

you can create some tar files more than 2G.
And if thats working you should try to bounce the DB and then try creating addming Db file.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

if i am not wrong , Once you have create

lvcreate -L /dev//lvol

newfs -F vxfs -b 8192 -o largefiles /dev//r

Check attahment for limts,

Rgds,
Johnson
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

I am not sure if FS was created with largefiles option, but i did fsadm -o largfiles later and remounted the FS also, eventhough not needed.

but still cannot create largefiles using dd.

does Vxfs / Online JFS 3.3 supported largefile on hpux 11.11.

the patch level is June 2004.
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

may i know what is your lv size ? which you trying to create larger file ?
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

LV size is 180GB..100GB is free.
R.K. #
Honored Contributor

Re: unable to create a file more than 2 GB

Hi Pradep,

First of all your dd is working perfectly ok. Reason for getting I/O error is when you specify "if=/dev/zero" you are copying data from source having an infinite number of zero bytes. But your disk is finite, so the operation must stop somewhere.

Because the destination has completely filled up and the source still has data left (as it is infinite), dd thinks it to be an error. Hence you are getting IO error, which is quite normal.

Now, from fstyp o/p:
f_flag: 16 -- means largefiles is enabled

Also try creating a file with more than 2 GB size using dd (specify the count).

Just check how the FS is mounted in fstab.
Don't fix that what ain't broke
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

how about your bloack read size ?

newfs -F vxfs -b 8192 -o largefiles /dev//r

>>fstyp -v /dev/vgdbbacktst/lvdbback
vxfs
version: 3
f_bsize: 8192
f_frsize: 2048 --> can we make same and try agin dd?
<<<<
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

you mean recreate the FS with 8KB block size ?
dd read from /dev/zero is running fine till it reaches 2GB size. what can be the reason ?
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

>>dd read from /dev/zero is running fine till it reaches 2GB size. what can be the reason ?<,

Than you are able to create large files, no issue

so can you try to copy large files to /mount_points and check ?
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

dd is runs till file size reached 2 GB..after that it aborts with I/O error on terminal display.

does ulimit play any role in filezie limit ?
how can i make it unlimited for all.

ulimit -a
time(seconds) unlimited
file(blocks) 4194303
data(kbytes) 1048576
stack(kbytes) 16384
memory(kbytes) unlimited
coredump(blocks) 4194303
nofiles(descriptors) 6144
Matti_Kurkela
Honored Contributor

Re: unable to create a file more than 2 GB

Yes, JFS 3.3 and VxFS disk layout 3 on HP-UX 11.11 supports file sizes up to 2 TB.

http://docs.hp.com/en/5992-4023/5992-4023.pdf

But the default VxFS disk layout for 11.11 is 4, so this filesystem was probably created with an earlier version of HP-UX. If so, the "largefiles" option was not the default and may need to be switched on explicitly.

NOTE: using the "largefiles" mount option alone is not enough. You must either use the "-o largefiles" option at filesystem creation time, or convert the filesystem to largefiles mode with the fsadm command.

fsadm -F vxfs -o largefiles

If the filesystem was originally created with VxFS layout version 2 or earlier and then updated to layout 3, the inode format conversion step may have been missed too:

fsadm -F vxfs -c

MK
MK
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

>>does ulimit play any role in filezie limit ?<<

As per my knowledge NO,

you try fsadm has mentioned by >>MK<<
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

ulimit -f unlimited solved the issue for root only.

other users still get error like below:
$ ulimit -f unlimited
sh: ulimit: The specified value exceeds the user's allowable limit.

How to make it work for normal users?
which kernel parameter to change.

thanks
Dennis Handly
Acclaimed Contributor

Re: unable to create a file more than 2 GB

>does ulimit play any role in filesize limit?
file(blocks) 4194303

Ding ding! That's exactly it. This is 2 Gb.
I spent hours tracking this down, when some test automation set it to 2 Mb. Unfortunately I didn't learn my lesson and had to figure out all over.

>How can I make it unlimited for all.
>which kernel parameter to change.

You need to not set the limit, probably in /etc/profile. Or in ~/.profile.
It is set by the ulimit shell command.

>Johnson: As per my knowledge NO

Yes it does.
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

$ ulimit -f unlimited
sh: ulimit: The specified value exceeds the user's allowable limit


normal user is unable to do it.
It must be some kernel parm or Patch.
Johnson Punniyalingam
Honored Contributor

Re: unable to create a file more than 2 GB

>>>normal user is unable to do it.
It must be some kernel parm or Patch.<<<

Hi Pradeep,

Check the below thread, will help to explain

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=906322&admit=109447626+1256694391615+28353475

Rgds,
Johnson
Problems are common to all, but attitude makes the difference
Pradep
Regular Advisor

Re: unable to create a file more than 2 GB

got it.
I t was being set in /etc/profile. removed from there. still it was same after login.
so done "ulimit -H unlimited" from root account. now its ok for all users.
So kernel parm needed.

i also came across a thread that it is set for 2GB max in KSH shell, is some version/release of OS. and fixed by a patch in later releases.

thanks everybody.
Thread will be closed and points assigned.