- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - OpenVMS
- >
- Re: Maximum Directory Entries
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-07-2004 09:33 PM
тАО07-07-2004 09:33 PM
Re: Maximum Directory Entries
60.000 files in directory file of 19.000 blocks.
File creation with names starting with abc takes 0.1 second but every 5 files it takes 10 seconds. And the directory file is locked during that interval.
Jobs doing the dcl create in a loop pagefault at a rate of 75 per second (initial working set of 5800 pages, used about 1700).
Files starting with z have the same results.
Nice feature for a real time application ...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-07-2004 10:03 PM
тАО07-07-2004 10:03 PM
Re: Maximum Directory Entries
I think your observations can easily be explained:
1) doing dir/siz test.dir takes between 2 and 10 seconds
2) doing dir/tot/sin=15:30 takes about 10 minutes (acceptable, old machine)
I guess this has to do with caching.
The directory-file may need to be reread several times. Don't forget that access to indexf.sys is involved as well - for getting the size.
File creation with names starting with abc takes 0.1 second but every 5 files it takes 10 seconds. And the directory file is locked during that interval.
Jobs doing the dcl create in a loop pagefault at a rate of 75 per second (initial working set of 5800 pages, used about 1700).
Quite possible that each 5th file will need an extension of the directory file - and new (contiguous!) space has to be searched and allocated for the directory! And again, this requirs quite some extra IO.
It makes sense to do some redesign if timing gets critical.
Willem
OpenVMS Developer & System Manager
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-07-2004 11:21 PM
тАО07-07-2004 11:21 PM
Re: Maximum Directory Entries
Now I have 1 job active doing the creates and the directory file is about 20.000 blocks. The file names start with Z and are about 60 characters long.
dir/siz=all takes 15 seconds when the directory is expanded (108 blocks). These 108 blocks don't explain the delay of 15 seconds. There must be some reshuffling that takes time.
Files creation time is 0.5 - 2 seconds (why ?), thus longer than during the previous trial. The 15 seconds now only happen every few hundred files !
The pagefaults have increased to 700 per second !!!
Wim
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-08-2004 03:25 AM
тАО07-08-2004 03:25 AM
Re: Maximum Directory Entries
blocking time : 20 seconds when allocating 108 blocks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-08-2004 06:55 PM
тАО07-08-2004 06:55 PM
Re: Maximum Directory Entries
Pagefaults down to 200/sec.
Started a create starting with mmm.
20 seconds blockage every 5 files.
Started a create starting with a123.
22 seconds blockage every 5 files. Sometimes a file creation takes 0.1 seconds, sometimes 3 seconds.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-08-2004 07:08 PM
тАО07-08-2004 07:08 PM
Re: Maximum Directory Entries
When the 108 blocks must be allocated, the direcory is blocked for 30 seconds.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-09-2004 01:17 AM
тАО07-09-2004 01:17 AM
Re: Maximum Directory Entries
It is clear that big directory files can not be used by applications that frequently create files or by real time applications.
Now let's see how long delete will need ...
Wim
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-09-2004 01:36 AM
тАО07-09-2004 01:36 AM
Re: Maximum Directory Entries
I tried DFU 2.6 delete dev:dir/dir but I get
%DFU-I-PARSEDIR, Parsing directory tree OPS$MGR:[WVW.TEST]*.DIR;1
%DFU-W-NOSUBDIR, no subdirectories found in this tree
%DFU-I-CLEANUP, Deleting OPS$MGR:[WVW]TEST.DIR;1...
%DFU-E-READERR, Error reading directory OPS$MGR:[WVW]TEST.DIR;1,
%SYSTEM-F-BADPARAM, bad parameter value
%DFU-E-NOTDEL, Error deleting file TEST.DIR;1 ,
%SYSTEM-F-DIRNOTEMPTY, directory file is not empty
%DFU-I-READY, DELETE command ready
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-09-2004 01:40 AM
тАО07-09-2004 01:40 AM
Re: Maximum Directory Entries
I will see if I can find it.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО07-09-2004 02:26 AM
тАО07-09-2004 02:26 AM
Re: Maximum Directory Entries
All have the same problem.
The cluster will know what to do this WE.
Wim