unable to create file on the disk

[megat razizul]

I using vms 7.3-2 version and attach SAN storage as their logical disk. We have DSA1 as one of logical drive. What is major issue here unable to create or copy file into DSA1. We already check disk size but it still have lot free size. The error as above.

HSIBD3::D_CERT:> sh def
DSA1:[000000]
HSIBD3::D_CERT:> CREATE testmeg.DAT
%CREATE-E-OPENOUT, error opening DSA1:[000000]TESTMEG.DAT; as output
-RMS-E-CRE, ACP file create failed
-SYSTEM-W-IDXFILEFULL, index file is full
HSIBD3::D_CERT:> sh dev dsa1:/full

Disk DSA1:, device type HSV110, is online, mounted, file-oriented device,
shareable, available to cluster, error logging is enabled, device supports
bitmaps (no bitmaps active).

Error count 0 Operations completed 372439
Owner process "" Owner UIC [FIELD,SYSTEM]
Owner process ID 00000000 Dev Prot S:RWPL,O:RWPL,G:R,W
Reference count 10671 Default buffer size 512
Total blocks 41943040 Sectors per track 128
Total cylinders 2560 Tracks per cylinder 128
Logical Volume Size 41943040 Expansion Size Limit 48029696

Volume label "ALPHASYS" Relative volume number 0
Cluster size 41 Transaction count 1144
Free blocks 27195710 Maximum files allowed 499321
Extend quantity 5 Mount count 1
Mount status System Cache name "_DSA1:XQPCACHE"
Extent cache size 64 Maximum blocks in extent cache 2719571
File ID cache size 64 Blocks in extent cache 533
Quota cache size 0 Maximum buffers in FCP cache 7549
Volume owner UIC [1,1] Vol Prot S:RWCD,O:RWCD,G:RWCD,W:RWCD

[labadie_1]

Welcome to the OpenVMS forum

The index file on your disk is full, so you can't create more files.

When you initialize a disk, you have 2 important qualifiers
- maximum_files
- headers

A file can use one or more headers, so both qualifiers are important.

Now, in order to be able to create some more files, you need to delete some.

Maybe you can move some files from this disk to another, or some directories ?

Something like
$ bac/lo/del dsa1: dsa2:<*...>/owner=origi
if you have some space on dsa2:

The real solution is to backup dsa1 (for example, when no files are opened)
then
$ init/maximum=500000/headers=1000000... dsa1:
then
backup/noinit...backup_disk: dsa1:


See the doc, "using backup"
http://h71000.www7.hp.com/doc/82FINAL/aa-pv5mj-tk/aa-pv5mj-tk.HTMl

[Jan van den Ende]

Megat,

to begin with:

WELCOME to the ITRC VMS forum!

On your problem, the ]error message says it all:

>>>
-SYSTEM-W-IDXFILEFULL, index file is full
<<<

Look at
>>>
Maximum files allowed 499321
<<<

Is this limit reached?

I am afraid your only ways out of this are:

- Init another drive with /maxfiles={at least double} and /headers = {max}
( look at help INIT for the max values at your version, as you already have max for /LIMIT )

- BACKUP/IMAGE/NOINIT DSA1: {new DSA#:}

As you having DSA suggests shadowing; perhaps you can split off one member, init that, and use as target.
Adapt your Startup sequence to use the new DSA whereever you are now using DSA1; and off you go.

(If DSA1 is your current System Disk, then also change SYSGEN's SHADOW_SYS_UNIT; and reboot).

Second potential cause:
DSA1: is badly fragmented.
Now the above also is the long-term solution, but the shortterm way out MIGHT be to find a file with many headers, and delete that (or move it to another drive).
But that will only help for a short time!

hth

Proost.

Have one on me.

jpe

[Jim_McKinney]

> Maximum files allowed 499321


Others have already written of addressing the long term needs of the disk by changin it's attributes - perhsps for the short term (or maybe even the long term) you might just delete some files and free up a few headers in the INDEXF.SYS file - or perhaps you could delete lots and lots and lots of files - do you really need to keep nearly 500,000 files on the disk?

[Hein van den Heuvel]

I don't think this problem is caused by /maxfiles being exhausted.
/headers is more likely to be the problem.

The disk has default init attributes:
1 million clusters, 1/2 million files.

There are 27M blocks free. 13M used.
If each file had just one cluster then there would be (41943040 - 27195710) / 41 = 359690 in use and still 150,000 available.

Maybe there are lots of empty files?
Maybe there is an excessive amount of ACLs on the files, requirign lots of extention headers?
Maybe [000000]INDEXF.SYS can not longer be expanded?

Megat,

To understand where the hurt comes from, get yourself the DFU tool and REPORT on the volume. http://www.digiater.nl/dfu.html
Add Report output as .TXT attachment to future reply if need be

To work around the problem you need to remove files from the volume.
Maybe you can combine a bunch of little files in a BACKUP or ZIP container?
Maybe create an LD container file to hold lots of little file?

Hope this helps some,
Hein van den Heuvel (at gmail dot com)
HvdH Performance Consulting

[Jon Pinkley]

I agree with Hein, the most likely problem is that the indexf.sys file has been extended too many times, and it has filled its file header. INDEXF.SYS is one of the files that is not allowed to use an extension file header, so it is limited in the number of pieces the the file can be in.

If you have DFU V3.2, the following command will tell you a lot of useful info.

$ dfu indexf /anal sys$sysdevice

Disk and File Utilities for OpenVMS V3.2
%DFU-I-ANALDISK, Analyzing INDEXF and BITMAP...
%DFU-I-TOTAL, Maparea maps 135392 blocks in 4 fragments (6% used)
%DFU-I-FINDLBN, Largest free contiguous space 5104 blocks at LBN 12197656
%DFU-W-NOOPT, No optimization needed for INDEXF.SYS

%DFU-I-READY, INDEXF command ready
$

If you don't have DFU, you can at least look at the internal fragmentation of the indexf.sys file with:

$ dump/head/block=count:0 sys$sysdevice:[000000]indexf.sys

At the bottom of the report will be the retrieval pointers, each describing a contiguous piece of the file.

If you can not dismount the disk, your only option is to delete some files so the existing file headers can be reused.

Do download and install DFU as recommended by Hein.

If you can dismount the device clusterwide, and the disk has a reasonable amount of contiguous free space, then you may be able to recover by using the INDEXF defrag built into DFU V3.2.

$ dfu help indexf *

Disk and File Utilities for OpenVMS V3.2

DFU

INDEXF

Qualifiers


/ANALYZE

Displays information about the number of fragments in INDEXF.SYS
and the largest contiguous free space. If INDEXF.SYS can not be
defragmented a "%DFU-W-NOOPT" message will be displayed.

/DEFRAG

Starts a defragment operation on INDEXF.SYS. The disk must be
clusterwide dismounted before starting a defragment operation.

/EXTEND
/EXTEND=n (number of blocks)

Extends INDEXF.SYS with 'n' blocks in 1 new fragment. This is
equivalent to 'n' extra file headers. The disk must be clusterwide
dismounted before starting an extend operation.
The 'n' value will be rounded up to be a multiple of the device
cluster size.

/SHADOW_MEMBER
/SHADOW_MEMBER=device:

The physical member of the shadowset on which to perform an
EXTEND or DEFRAG operation. This qualifier is only required
in combination with /DEFRAG and /EXTEND. Example :

DFU> INDEXF/DEFRAG DSA0:/SHADOW_MEMBER=$1$DUA104:

/SHOW_POINTERS

Displays all mapping pointer information during the analyze phase.


/STATISTICS
/STATISTICS
/NOSTATISTICS (default)

Controls whether cpu and I/O consumption of the
command are shown.

/TRUNCATE

If possible the INDEXF.SYS file will be truncated back to
the end-of-file size. The disk must be dismounted to
perform this operation.


Topic? Exit
$

This is one reason for using the /headers=xxxxx switch when initializing a volume, it preextends the indexf.sys file so it will not need to be extended in small increments.

Good Luck,

Jon

[Robert Gezelter]

Megat,

If you have not installed DFU (or for some reason are reluctant to do so), the limited information needed at this instant can be obtained using the DUMP and DIRECTORY commands, to wit:

$ DIRECTORY/FULL DSA1:[000000]INDEXF.SYS

and

$ DUMP/HEADER/BLOCK=(START:0,END:0) DSA1:[000000]INDEXF.SYS

- Bob Gezelter, http://www.rlgsc.com

[Jon Pinkley]

After a bit more research, I now believe that MAXIMUM_FILES has been reached instead of the indexf.sys file header being full, since the error message for that is SYSTEM-W-HEADERFULL.

I have reproduced both types of errors using LDA devices.

If you really have 499321 files on this disk, as Hein has pointed out, there must be a large number of zero block files. (If each of these has 1 cluster allocated, that would use 499321*41 = 20472161 blocks, and only 14747330 have been used.)

So, find the zero sized files, and determine why they are being created, and delete the ones you don't need.

$ directory/size=alloc/sel=size:max:0 dsa1:[000000...]

If you really need these zero sized files, you will need to reinitialize your device with a larger value of /maximum_files and preferably a smaller /cluster_size. If you do reinitialize, I would recommend a cluster_size that is a power of 2 (i.e. 1,2,4,8,16,32,64...).

Jon

[Jon Pinkley]

Here's an example of the HEADERFULL error, and the fragmented INDEXF.SYS file.

Note the Map area words in use in the dump/header output (and the difference between Map area offset and Access control area offset).

$ cre lda3:[jon]abc.dat
%CREATE-E-OPENOUT, error opening LDA3:[JON]ABC.DAT; as output
-RMS-E-CRE, ACP file create failed
-SYSTEM-W-HEADERFULL, file header is full
$ sho dev lda3:

Device Device Error Volume Free Trans Mnt
Name Status Count Label Blocks Count Cnt
$4$LDA3: (SIGMA) Mounted 0 TEST 8889 1 1
$ dump/header/block=count:0 lda3:[000000]indexf.sys

Dump of file LDA3:[000000]INDEXF.SYS;1 on 24-MAR-2008 22:02:38.80
File ID (1,1,0) End of file block 99 / Allocated 99

File Header

Header area
Identification area offset: 40
Map area offset: 100
Access control area offset: 255
Reserved area offset: 255
Extension segment number: 0
Structure level and version: 2, 1
File identification: (1,1,0)
Extension file identification: (0,0,0)
VAX-11 RMS attributes
Record type: Fixed
File organization: Sequential
Record attributes:
Record size: 512
Highest block: 99
End of file block: 100
End of file byte: 0
Bucket size: 0
Fixed control area size: 0
Maximum record size: 512
Default extension size: 0
Global buffer count: 0
Directory version limit: 0
File characteristics: Contiguous best try
Caching attribute: Writethrough
Map area words in use: 154
Access mode: 0
File owner UIC: [FILSYS]
File protection: S:RWED, O:RWED, G:RE, W:
Back link file identification: (4,4,0)
Journal control flags:
Active recovery units: None
File entry linkcount: 0
Highest block written: 99
Client attributes: None

Identification area
File name: INDEXF.SYS;1
Revision number: 1
Creation date: 24-MAR-2008 21:13:04.63
Revision date: 24-MAR-2008 21:13:04.63
Expiration date:
Backup date:

Map area
Retrieval pointers
Count: 3 LBN: 0
Count: 1 LBN: 5027
Count: 21 LBN: 5006
Count: 1 LBN: 9999
Count: 1 LBN: 8191
Count: 1 LBN: 8190
Count: 1 LBN: 4095
Count: 1 LBN: 4094
Count: 1 LBN: 9998
Count: 1 LBN: 8189
Count: 1 LBN: 4093
Count: 1 LBN: 9997
Count: 1 LBN: 8188
Count: 1 LBN: 4092
Count: 1 LBN: 9996
Count: 1 LBN: 8187
Count: 1 LBN: 4091
Count: 1 LBN: 9995
Count: 1 LBN: 8186
Count: 1 LBN: 4090
Count: 1 LBN: 9994
Count: 1 LBN: 8185
Count: 1 LBN: 4089
Count: 1 LBN: 9993
Count: 1 LBN: 8184
Count: 1 LBN: 4088
Count: 1 LBN: 9992
Count: 1 LBN: 8183
Count: 1 LBN: 4087
Count: 1 LBN: 9991
Count: 1 LBN: 8182
Count: 1 LBN: 4086
Count: 1 LBN: 9990
Count: 1 LBN: 8181
Count: 1 LBN: 4085
Count: 1 LBN: 9989
Count: 1 LBN: 8180
Count: 1 LBN: 4084
Count: 1 LBN: 9988
Count: 1 LBN: 8179
Count: 1 LBN: 4083
Count: 1 LBN: 9987
Count: 1 LBN: 8178
Count: 1 LBN: 4082
Count: 1 LBN: 9986
Count: 1 LBN: 8177
Count: 1 LBN: 4081
Count: 1 LBN: 9985
Count: 1 LBN: 8176
Count: 1 LBN: 4080
Count: 1 LBN: 9984
Count: 1 LBN: 8175
Count: 1 LBN: 4079
Count: 1 LBN: 9983
Count: 1 LBN: 8174
Count: 1 LBN: 4078
Count: 1 LBN: 9982
Count: 1 LBN: 8173
Count: 1 LBN: 4077
Count: 1 LBN: 9981
Count: 1 LBN: 8172
Count: 1 LBN: 4076
Count: 1 LBN: 9980
Count: 1 LBN: 8171
Count: 1 LBN: 4075
Count: 1 LBN: 9979
Count: 1 LBN: 8170
Count: 1 LBN: 4074
Count: 1 LBN: 9978
Count: 1 LBN: 8169
Count: 1 LBN: 4073
Count: 1 LBN: 9977
Count: 1 LBN: 8168
Count: 1 LBN: 4072
Count: 1 LBN: 9976
Count: 1 LBN: 8167
Count: 1 LBN: 4071

Checksum: 63907
$

[Jon Pinkley]

megat razizul,

HEADERFULL wasn't your problem, but for anyone that does get that, here is an example of fixing with DFU. This is the same disk as my last note. Note the Map area in use drops to 8 words.

$ dfu indexf /anal lda3:

Disk and File Utilities for OpenVMS V3.2
%DFU-I-ANALDISK, Analyzing INDEXF and BITMAP...
%DFU-I-TOTAL, Maparea maps 99 blocks in 77 fragments (99% used)
%DFU-I-FINDLBN, Largest free contiguous space 3133 blocks at LBN 5034
%DFU-I-MOVE, 74 blocks can be defragmented (74 fragments)

%DFU-I-READY, INDEXF command ready
$ dism lda3:
$ dfu indexf /defrag lda3:

Disk and File Utilities for OpenVMS V3.2
%DFU-I-MOUNTING, Busy mounting disk LDA3:...
%DFU-I-ANALDISK, Analyzing INDEXF and BITMAP...
%DFU-I-TOTAL, Maparea maps 99 blocks in 77 fragments (99% used)
%DFU-I-FINDLBN, Largest free contiguous space 3133 blocks at LBN 5034
%DFU-I-MOVE, 74 blocks can be defragmented (74 fragments)
Continue to modify INDEXF.SYS ? (Y/N) [N] : y
%DFU-I-MOUNTFOR, Busy remounting disk LDA3: /FOREIGN...
%DFU-I-STARTDFR, Now copying fragments to new location...
%DFU-S-COPIED, 1 blocks copied (fragment 4)
%DFU-S-COPIED, 1 blocks copied (fragment 5)
%DFU-S-COPIED, 1 blocks copied (fragment 6)
%DFU-S-COPIED, 1 blocks copied (fragment 7)
%DFU-S-COPIED, 1 blocks copied (fragment 8)
%DFU-S-COPIED, 1 blocks copied (fragment 9)
%DFU-S-COPIED, 1 blocks copied (fragment 10)
%DFU-S-COPIED, 1 blocks copied (fragment 11)
%DFU-S-COPIED, 1 blocks copied (fragment 12)
%DFU-S-COPIED, 1 blocks copied (fragment 13)
%DFU-S-COPIED, 1 blocks copied (fragment 14)
%DFU-S-COPIED, 1 blocks copied (fragment 15)
%DFU-S-COPIED, 1 blocks copied (fragment 16)
%DFU-S-COPIED, 1 blocks copied (fragment 17)
%DFU-S-COPIED, 1 blocks copied (fragment 18)
%DFU-S-COPIED, 1 blocks copied (fragment 19)
%DFU-S-COPIED, 1 blocks copied (fragment 20)
%DFU-S-COPIED, 1 blocks copied (fragment 21)
%DFU-S-COPIED, 1 blocks copied (fragment 22)
%DFU-S-COPIED, 1 blocks copied (fragment 23)
%DFU-S-COPIED, 1 blocks copied (fragment 24)
%DFU-S-COPIED, 1 blocks copied (fragment 25)
%DFU-S-COPIED, 1 blocks copied (fragment 26)
%DFU-S-COPIED, 1 blocks copied (fragment 27)
%DFU-S-COPIED, 1 blocks copied (fragment 28)
%DFU-S-COPIED, 1 blocks copied (fragment 29)
%DFU-S-COPIED, 1 blocks copied (fragment 30)
%DFU-S-COPIED, 1 blocks copied (fragment 31)
%DFU-S-COPIED, 1 blocks copied (fragment 32)
%DFU-S-COPIED, 1 blocks copied (fragment 33)
%DFU-S-COPIED, 1 blocks copied (fragment 34)
%DFU-S-COPIED, 1 blocks copied (fragment 35)
%DFU-S-COPIED, 1 blocks copied (fragment 36)
%DFU-S-COPIED, 1 blocks copied (fragment 37)
%DFU-S-COPIED, 1 blocks copied (fragment 38)
%DFU-S-COPIED, 1 blocks copied (fragment 39)
%DFU-S-COPIED, 1 blocks copied (fragment 40)
%DFU-S-COPIED, 1 blocks copied (fragment 41)
%DFU-S-COPIED, 1 blocks copied (fragment 42)
%DFU-S-COPIED, 1 blocks copied (fragment 43)
%DFU-S-COPIED, 1 blocks copied (fragment 44)
%DFU-S-COPIED, 1 blocks copied (fragment 45)
%DFU-S-COPIED, 1 blocks copied (fragment 46)
%DFU-S-COPIED, 1 blocks copied (fragment 47)
%DFU-S-COPIED, 1 blocks copied (fragment 48)
%DFU-S-COPIED, 1 blocks copied (fragment 49)
%DFU-S-COPIED, 1 blocks copied (fragment 50)
%DFU-S-COPIED, 1 blocks copied (fragment 51)
%DFU-S-COPIED, 1 blocks copied (fragment 52)
%DFU-S-COPIED, 1 blocks copied (fragment 53)
%DFU-S-COPIED, 1 blocks copied (fragment 54)
%DFU-S-COPIED, 1 blocks copied (fragment 55)
%DFU-S-COPIED, 1 blocks copied (fragment 56)
%DFU-S-COPIED, 1 blocks copied (fragment 57)
%DFU-S-COPIED, 1 blocks copied (fragment 58)
%DFU-S-COPIED, 1 blocks copied (fragment 59)
%DFU-S-COPIED, 1 blocks copied (fragment 60)
%DFU-S-COPIED, 1 blocks copied (fragment 61)
%DFU-S-COPIED, 1 blocks copied (fragment 62)
%DFU-S-COPIED, 1 blocks copied (fragment 63)
%DFU-S-COPIED, 1 blocks copied (fragment 64)
%DFU-S-COPIED, 1 blocks copied (fragment 65)
%DFU-S-COPIED, 1 blocks copied (fragment 66)
%DFU-S-COPIED, 1 blocks copied (fragment 67)
%DFU-S-COPIED, 1 blocks copied (fragment 68)
%DFU-S-COPIED, 1 blocks copied (fragment 69)
%DFU-S-COPIED, 1 blocks copied (fragment 70)
%DFU-S-COPIED, 1 blocks copied (fragment 71)
%DFU-S-COPIED, 1 blocks copied (fragment 72)
%DFU-S-COPIED, 1 blocks copied (fragment 73)
%DFU-S-COPIED, 1 blocks copied (fragment 74)
%DFU-S-COPIED, 1 blocks copied (fragment 75)
%DFU-S-COPIED, 1 blocks copied (fragment 76)
%DFU-S-COPIED, 1 blocks copied (fragment 77)
%DFU-I-NEWTOTAL, New Maparea maps 99 blocks in 4 fragments
%DFU-S-REWRTIF, INDEXF.SYS File header rewritten !
%DFU-I-RBDBITMAP, Updating BITMAP.SYS...
%DFU-S-DONE, all operations succesfully completed

%DFU-I-DISMNT, Volume dismounted

%DFU-I-READY, INDEXF command ready
$ mou/ov=id lda3:
%MOUNT-I-MOUNTED, TEST mounted on _$4$LDA3: (SIGMA)
$ dump/header/block=count:0 lda3:[000000]indexf.sys

Dump of file LDA3:[000000]INDEXF.SYS;1 on 24-MAR-2008 22:14:33.99
File ID (1,1,0) End of file block 99 / Allocated 99

File Header

Header area
Identification area offset: 40
Map area offset: 100
Access control area offset: 255
Reserved area offset: 255
Extension segment number: 0
Structure level and version: 2, 1
File identification: (1,1,0)
Extension file identification: (0,0,0)
VAX-11 RMS attributes
Record type: Fixed
File organization: Sequential
Record attributes:
Record size: 512
Highest block: 99
End of file block: 100
End of file byte: 0
Bucket size: 0
Fixed control area size: 0
Maximum record size: 512
Default extension size: 0
Global buffer count: 0
Directory version limit: 0
File characteristics: Contiguous best try
Caching attribute: Writethrough
Map area words in use: 8
Access mode: 0
File owner UIC: [FILSYS]
File protection: S:RWED, O:RWED, G:RE, W:
Back link file identification: (4,4,0)
Journal control flags:
Active recovery units: None
File entry linkcount: 0
Highest block written: 99
Client attributes: None

Identification area
File name: INDEXF.SYS;1
Revision number: 1
Creation date: 24-MAR-2008 21:13:04.63
Revision date: 24-MAR-2008 21:13:04.63
Expiration date:
Backup date:

Map area
Retrieval pointers
Count: 3 LBN: 0
Count: 1 LBN: 5027
Count: 21 LBN: 5006
Count: 74 LBN: 5034

Checksum: 30522
$