topic Re: Maximum number of file descriptors per process? in Operating System - HP-UX

Maximum number of file descriptors per process?

Andrew Caballes — Mon, 07 Aug 2000 07:09:26 GMT

Hello all!

Is there a way to increase the maximum number of open file descriptor limit
in HPUX 11.0? On a related note, how high can this number be adjusted?

I've got a HP 9000 700 series machine with 1Gbyte of RAM.

Thanks!

Re: Maximum number of file descriptors per process?

Andy Monks — Mon, 07 Aug 2000 07:23:18 GMT

There are 2 parameters.

maxfiles and maxfiles_lim

The defaults are 60 and 1024 and the max is 2048 for both.

Re: Maximum number of file descriptors per process?

Vladislav Demidov — Mon, 07 Aug 2000 07:45:30 GMT

Don't forget about nfile(maximum file descriptors per system) parameter too....

Re: Maximum number of file descriptors per process?

CHRIS_ANORUO — Mon, 07 Aug 2000 07:51:10 GMT

Run sysdef to know the limits.

Re: Maximum number of file descriptors per process?

Andrew Caballes — Mon, 07 Aug 2000 07:52:04 GMT

Thanks!

Another related question:
Can this number be bumped up to around
10,000 file descriptors per process?

Re: Maximum number of file descriptors per process?

Vladislav Demidov — Mon, 07 Aug 2000 08:01:05 GMT

You cann't increase this parameter up to 10,000 per one process. you have to rewrite you application to use 5 processes.

Re: Maximum number of file descriptors per process?

Andy Monks — Mon, 07 Aug 2000 09:48:00 GMT

as the limit is 2048, then the answer is no!. Why would any application need to have 10,000 files open at the same time?

Re: Maximum number of file descriptors per process?

Rita C Workman — Mon, 07 Aug 2000 11:14:38 GMT

Increasing the 'nfile' parameter will increase the number of files that can be opened. Increasing 'nproc' parameter will increase the number of open processes. Both of these can be modified in SAM via /kernel/configurable parameters.
Once you change nproc you will notice that it will change (as needed) other parameters to account for the adjustment.

Re: Maximum number of file descriptors per process?

Andy Monks — Mon, 07 Aug 2000 11:31:12 GMT

Andrew, maxfiles/maxfiles_lim are per-process limits. nfile is a system wide limit. nfile is limited by physical memory.

Re: Maximum number of file descriptors per process?

Vladislav Demidov — Mon, 07 Aug 2000 11:39:40 GMT

Andy, nfile parameters should be bigger then 2048 or seral times 2048 otherwise several processes will not be able to seize 2048 file descriptors each.

Re: Maximum number of file descriptors per process?

Bill Hassell — Mon, 07 Aug 2000 12:09:32 GMT

The 2048 value is a hard limit in the kernel (maxfiles_lim). WHile a program can change the maxfiles value with a call to setrlimit(2), it cannot be increased beyond 2048.

Also, the default POSIX shell offers ulimit as a user interface to several 'soft' parameters such as maxfiles, core file limit, memory usage, processor time, etc. ulimit -a will listt the values that can changed. Once changed, all child proceses inherit the shell settings.

As an aside, one has to question the need to open 10,000 files at the same time. Even the Universe database program (which can use thousands of unique files) uses a file descriptor pool to limit simultaneous open files to a few hundred. As mentioned in a previous reply, if 20 copies of the same program were to open 10,000 files (the same 10,000 files), you would need nfile set to 200,000, a huge number indeed.

Re: Maximum number of file descriptors per process?

Andrew Caballes — Mon, 07 Aug 2000 22:31:07 GMT

Thank you all for your responses, they have been very helpful.

As for the 10,000 file descriptors, I was hoping to be able to
open that number of sockets, not files per se.

Again, my thanks.

Re: Maximum number of file descriptors per process?

Miguel Angel Ortega — Thu, 05 Oct 2000 09:33:08 GMT

The answer for your question is this:
edit the file containig the limits for kernel parameters:

vi /usr/conf/master.d/core-hpux

search the maxfiles and maxfiles_lim and modify the
range values (minimum , maximum) according to your
needs, then save file and make sam to recognize them
executing:

/usr/sam/lbin/getkinfo -b

Now the maximum and minimun range for the parameter
is set, and you can modify maxfile and maxfiles_lim
up to 10000 or whatever.
You can have your application runnig with many sockets
as you need.