topic Re: Calculating file usage in Operating System - HP-UX

Calculating file usage

Tony Walker — Wed, 08 Jan 2003 12:05:53 GMT

Hi Guys,

I'm currently on a project to migrate an old K-class server to an NT box (I know - I wasn't impressed either). One of the filesystems is 117GB in size and I have been asked to get all files over 6months old, calculate how much space they all take up and then do it on a per user basis.

I have done a find /myfs -mtime +168 -exec ll {} \; > list.

What I wanted to do was add each of the size fields together ($5) which i attempted in a 'for' loop this has worked but tells me I can get rid of 88GB! This may be true but I want to check whether my figures are correct and also get suggestions on an easier/better way of doing this. Advice would also be appreciated for getting the amount each individual user is using.

Thanks in advance,

Ton

Re: Calculating file usage

Chris Wilshaw — Wed, 08 Jan 2003 12:20:18 GMT

You could try

TOTAL=`awk '{print (s+=$5/1073741824}' $FILENAME | tail -1

A bit shorter if nothing else.
(the 1073741824 is 1024*1024*1024)

Chris

Re: Calculating file usage

Pete Randall — Wed, 08 Jan 2003 12:23:29 GMT

Ton,

I ran a quick test and it came up with 5 when my manual calculations came up with 5.9 GB. I think I'd save the division for the end - it looks like it's rounding. In other words, eliminate the
(( i = (i / 1024) /1024)) line
and divide by 1024 again in the
GB=$(expr $TOTAL / 1024) line.

Pete

Re: Calculating file usage

Jerome Baron — Wed, 08 Jan 2003 12:26:11 GMT

Hi Ton,

Try find /myfs -type f -atime +168 -exec du -k {} \; > list

Regards,
Jerome

Re: Calculating file usage

Chris Wilshaw — Wed, 08 Jan 2003 12:26:58 GMT

That's the problem with using expr.

It only deals in integers.

expr 10 / 3
3

Re: Calculating file usage

Jose Mosquera — Wed, 08 Jan 2003 13:04:28 GMT

Hi,

Try this script:

TOTAL=0
SIZES=`find /myfs -mtime +168 -exec ll {} \;|awk '{ print $5 }'`
for SIZE in SIZES
do
TOTAL=`expr $TOTAL + $SIZE`
done
echo "Total Size: $TOTAL Bytes"

Rgds.

Re: Calculating file usage

Tony Walker — Wed, 08 Jan 2003 13:22:18 GMT

Pete, I tried this approach originaly but after adding about 7 large numbers together it started producin negative numbers!? Thats why I did the Mb conversion before the addition. I'm assuming that it is working correctly and that my logic is sound? Good point with the exec du -k {}\; - I'll give that a go....

Any thoughts on calculating it per user? This is what I have so far but it seems to product differing results (e.g 5user in a row have the same space then 1 has 17GB!?)

Cheers,

Tony

Re: Calculating file usage

harry d brown jr — Wed, 08 Jan 2003 17:49:59 GMT

Ton,

Here's a VERY simple "perl" program:

#!/opt/perl/bin/perl
$SYMBOLS=" KMGTP";
$totarr="";
while (<>) {
tr/ / /s;
($tmp1,$tmp2,$username,$grpname,$filesize,$tmp3) = split(/ /);
if ($username ne "") {
$totarr{$username} += $filesize;
}
}
foreach $username (sort keys %totarr) {
$filesizes=$totarr{$username};
$spaceinuse=0;
$spacesymbol="";
for ($i=0;$i < 6;$i++) {
if ($filesizes >= (1024**$i)) {
$spaceinuse=$filesizes/(1024**$i);
$spacesymbol=substr($SYMBOLS,$i,1);
}
}
printf("%9s %15.3f %sB, bytes is %s\n",$username,$spaceinuse,$spacesymbol,$totar
r{$username});

To use it, do something like this:

perlprogram.pl < yourfilelist

live free or die
harry

Re: Calculating file usage

harry d brown jr — Wed, 08 Jan 2003 18:07:10 GMT

I attached a commented and indented version

live free or die
harry

Re: Calculating file usage

Tony Walker — Thu, 09 Jan 2003 11:35:36 GMT

Harry,

Thanks for that - a good platform for me to start learning perl. I look forward to when I can call that VERY simple :) Thanks to everyone for your responses.

cheers,

Tony

Re: Calculating file usage

Tony Walker — Thu, 09 Jan 2003 11:58:25 GMT

Harry,

With my limited Perl knowledge I set about editing your script so that it would just produce the total amount of space taken up by all the files. The result is 152GB which I know cannot be right! Could you point me in the right direction?

Thanks,

Tony