topic Re: Fragmentation of disk drive in Operating System - OpenVMS

Fragmentation of disk drive

Mrityunjoy Kundu — Mon, 20 Nov 2006 05:00:12 GMT

How can i check the fragmentation of any disk drive,and is it possible to defrag the volume without dismounting the device.

Re: Fragmentation of disk drive

Ian Miller. — Mon, 20 Nov 2006 05:12:37 GMT

There are free utilities such as DFU and reporting programs that come with HP DFO.
Executive software also do a free fragmentation reporting utility - see
http://www.executive.com/freeware/freeware.asp

You can see if file fragmentation is having an affect by looking at window turns and split I/O rate in the MONITOR utility.

Re: Fragmentation of disk drive

Karl Rohwedder — Mon, 20 Nov 2006 05:15:00 GMT

The DFU utility (from HP, found on the freeware archives) can create reports on disk usage, containing fragmentation indexes for the files and for the free space.
It also allows for the defragmentation of individual files (more like COPY/CONTIG does).
To defragment complete disks under load you may use the HP product 'Disk File Optimizer',but that costs money.

regards Kalle

Re: Fragmentation of disk drive

Wim Van den Wyngaert — Mon, 20 Nov 2006 06:25:27 GMT

And note that open files are not defragmented. So, close as much as possible. Restart long running processes that are generating big log files as much as possible because they might lock small segments scattered all over the disk thus preventing free space consolidation.

Wim

Re: Fragmentation of disk drive

comarow — Mon, 20 Nov 2006 13:37:30 GMT

Almost all the defragmenters have a free tool that lets you check fragmentation.

This includes DFO.

Not all fragmentation is bad, since it uses the last freed block to use a block. Thus, some mixture of free space, contrary to popular wisdom, will improve performance.

Larger cluster sizes and RMS extent sizes will help prevent fragmentation and improve performance at the cost of some disk space.
Disk space is cheap. Cheaper than user time.

As mentioned, large log files are real killers. Especially if they do not pre-allocate space and are being written to a bit at a time. Closing the utilities associated with Accountng.dat, errlog.sys and operator.log can creating new versions of these file, with a larger extent can really help over time.

Re: Fragmentation of disk drive

Jim Lahman_1 — Mon, 20 Nov 2006 13:39:38 GMT

This might be a little off topic, but in the days before defrag utils, I'd perform a restore from an image backup. Doesn't this still apply?

Jim

Re: Fragmentation of disk drive

Jan van den Ende — Mon, 20 Nov 2006 14:18:49 GMT

@Jim,

>>>
This might be a little off topic, but in the days before defrag utils, I'd perform a restore from an image backup. Doesn't this still apply?
<<<

Yeah, it still applies... _IF_ you can afford the off-line time (of for system disk, Down time).
Many, many of the sites using VMS nowadays, are doing that BECAUSE of the 24*7, or 24*365 capabilities, and _THEN_ that option is a little bit out of the question.

Just my EUR 0,02

(notice, even the decimal COMMA is un-english!)

Proost.

Have one on me.

jpe

Re: Fragmentation of disk drive

Andy Bustamante — Mon, 20 Nov 2006 14:29:01 GMT

Before you start scheduling downtime, is fragmentation having an impact? Use monitor to check window turn rate and split transfer rates:

$ monitor fcp
$ monitor io

A disk can be severely fragmented and not create a performance issue if it doesn't create significant i/o. Purging log files is usually enough to defrag a system disk.

Andy

Re: Fragmentation of disk drive

Wim Van den Wyngaert — Tue, 21 Nov 2006 04:31:28 GMT

Don't forget to monitor the "maximum free extent" on the disk. This is what gives most problems (on my site anyway). Under 10000 blocks is a red alert here. And I have seen that during defragments, this value was VERY low, so a threat to the well being of the production environment.

Wim

Re: Fragmentation of disk drive

Ziggy Filek — Wed, 22 Nov 2006 20:26:19 GMT

You can directly check fragmentation state of any file by executing

$ PIPE DUMP/HEADER | TYPE SYS$INPUT /PAGE

and look for the list of retrieval pointers looking like this:

Map area
Retrieval pointers
Count: 36 LBN: 1280646

Each "Count ... LBN..." line is one fragment. Multiple "Count:..."lines mean fragmented file. I have seen files with hundreds and hundreds of pointers to fragments...

Ziggy

Re: Fragmentation of disk drive

Hein van den Heuvel — Wed, 22 Nov 2006 22:01:17 GMT

DFU is a really easy and effective tool here.

$define dfu$nosmg yes
$dfu sea/frag=min=100 sys$disk:

>> I have seen files with hundreds and hundreds of pointers to fragments...

I'll see your hundreds of pointers and raise you hundred fifty headers.

:-)

>> $ PIPE DUMP/HEADER | TYPE SYS$INPUT /PAGE

Too much work! Try this:

$ perl -e "foreach (`dump/head/bloc=cou=0 $ARGV[0]`) { $h++ if /^Check/; $m++ if /Count:/} print qq($h headers, $m pointers.\n)"

More :-)
Hein.