Anyone have a partical limit to max number of files in a directory?

[Christopher LaPlante_1]

We have a mount point that has no directory structure with 120000 files in it. Is there pratical max number of files per directory to ensure good filesystem performance. I have been ask to provide this number such that the app owner can breakup this directory. Thanks in advance

[Stuart Abramson_2]

You must be using vxfs files. Everybody does nowadays.

In vxfs files the inode is contained on disk. Every time I try to access a file I search the inode table. The more files you have, the longer the search takes. Less files => better performance.

Also, backup times depend directly on the number of files per directory. This can have a bigger impact than pure GB. The backup software must process a record entry for every file in the directory. This single directory could take hours to backup.

I don't think that there is a single number, but you should get the user to consolidate the files in some kind of historical library directory like tar or pvcs or something. Then you'll get better performance, and backup faster.

[Christopher LaPlante_1]

Yes we are using vxfs. Is there a rule of thumb number? We have told them its not a good way of doing things and they have come back and ask for a max number so they can relayout the directory structure. The app in question is Winchill and its /vault directory

[Pete Randall]

Christopher,


Here's a few threads that deal with this subject:

http://forums.itrc.hp.com/cm/QuestionAnswer/1,,0xb35e35a43b46d71190080090279cd0f9,00.html
http://forums.itrc.hp.com/cm/QuestionAnswer/1,,0x14a293e260b0d611abdb0090277a778c,00.html
http://forums.itrc.hp.com/cm/QuestionAnswer/1,,0x14a293e260b0d611abdb0090277a778c,00.html
http://forums.itrc.hp.com/cm/QuestionAnswer/1,,0xe87a42308663d611abdb0090277a778c,00.html


Pete