topic Re: Awk problem - addition? in Operating System - HP-UX

Awk problem - addition?

Vassilios — Thu, 11 Sep 2008 11:32:32 GMT

Hello,
Would someone here know how to use awk to do an addition?

Here's what I'm trying to do:

if you do an ls -l, it prints out direcctory/file sizes. Right? So, let's say the column in which the directory falls is the 9th? I forget.. but its around the 9th,

so, I now want to add the TOTAL file sizes/sub directory sizes in a directory, that may contain 200 files or sub folders.

ls -l | swk '{print $9}' |

Thanks

Re: Awk problem - addition?

Deepak Kr — Thu, 11 Sep 2008 11:38:42 GMT

Hi,

Instead you can choose easier way !!

Use du -sk to take out size of directory including all sub dirs and files in it

#du -sk /tmp/dir
size in KB

MB=KB/1000

Re: Awk problem - addition?

James R. Ferguson — Thu, 11 Sep 2008 11:40:05 GMT

Hi:

# ls -l | awk '/^total/ {next};{SUM+=$5};END{printf "%10d\n",SUM}'

...note that this skips the "total" line returned by 'ls -l'.

Regards!

...JRF...

Re: Awk problem - addition?

TTr — Thu, 11 Sep 2008 11:53:05 GMT

You may want to include a grep after the ls command to capture only the files and exclude directories soft links and other special files. Such as
ls -l |grep ^- | awk...
Note that in the "ls -l" listing for a subdirectory line the size number does NOT represent the contents of the subdirectory but rather its file table. You may or may not want to exclude these. If you want to sum up the contents of subrirectories you have to use the df commnad as noted above.

Re: Awk problem - addition?

Deepak Kr — Thu, 11 Sep 2008 12:02:55 GMT

Also:

To find
a) The total number of files in a directory
b) The total filesize

#cd /dir
#ls -l | awk '$6{b+=$5;a+=1}END{print a,b}'

Re: Awk problem - addition?

James R. Ferguson — Thu, 11 Sep 2008 12:08:01 GMT

Hi (again):

I agree with TTr insofar as you probably want to exclude the space used for directories and for symbolic links. You don't need to add another process, namely 'grep', though since 'awk' easily does this too:

# ls -l | awk '!/^-/ {next};{SUM+=$5};END{printf "%10d\n",SUM}'

Now, if you truly want the size of all *files* in all of the subdirectories in your 'ls' path, you can add the '-R' switch to 'ls' to do:

# ls -lR | awk '!/^-/ {next};{SUM+=$5};END{printf "%10d\n",SUM}'

Regards!

...JRF...

Regards!

...JRF...

Re: Awk problem - addition?

Vassilios — Thu, 11 Sep 2008 12:09:48 GMT

Hi Thanks a lot. That's really good. But I'm just curious, what's wrong with this?

ls -l | awk '{sum += $5};END{printf "%d\n", sum"

It prints out the same result?? no? And then why did you skip the "Total" word.. how would awk "add" a word ?? I thought it would just skip it?

But you're in inspiration, and I'm giving u 8 points, and the nice lady above 2 points.

Re: Awk problem - addition?

Vassilios — Thu, 11 Sep 2008 12:18:06 GMT

I'm just curious about one thing. In a directory where there are long listings (i.e. 100's of files), whether I use my way, or your way, the figures change.

It doesn't seem to be stable when adding...

Why is that??

Try it out..

Here's my way:

ls -l | awk '{SUM += $5};END{printf "%d\n", SUM}'

Re: Awk problem - addition?

James R. Ferguson — Thu, 11 Sep 2008 12:26:30 GMT

Hi (again):

> But I'm just curious, what's wrong with this?

> ls -l | awk '{sum += $5};END{printf "%d\n", sum"

> It prints out the same result?? no? And then why did you skip the "Total" word.. how would awk "add" a word ?? I thought it would just skip it?

The answer is that there is no fifth (5th) column for the "total" heading line, so 'awk' adds zero as it were. I chose to explicitly skip the "total" line simply to be pure and rigorous.

> I'm just curious about one thing. In a directory where there are long listings (i.e. 100's of files), whether I use my way, or your way, the figures change.

I suspect that you have entries special files (character and block devices). Sockets have a size of zero so those wouldn't matter. My second suggestion confined the totals to only *regular* files --- not directories nor special files nor symbolic links.

If we want to be pedantic we should probably account for hard-linked files too :-))

Regards!

...JRF...

Re: Awk problem - addition?

Vassilios — Thu, 11 Sep 2008 12:45:16 GMT

thanks everyone. You were all brilliant. To whom do I owe the points?

Re: Awk problem - addition?

James R. Ferguson — Thu, 11 Sep 2008 12:50:14 GMT

Hi:

> thanks everyone. You were all brilliant. To whom do I owe the points?

Points can be awarded to everyone as you see fit. There is no limit to the overall number that can be assigned. Please read :

http://forums12.itrc.hp.com/service/forums/helptips.do?#34

Regards!

...JRF...

Re: Awk problem - addition?

TTr — Thu, 11 Sep 2008 21:12:06 GMT

The awk program is using 32-bit arithmetic so the suming in awk overflows at 2147483647. (2^31 - 1). It does not error out, it keeps adding but the sum does not change once you reach the above number. At least it did it on my 11.11 workstation. I did not check if there are any patches for awk.

An alternative to adding with awk would be to use bc or dc. I did it using a "while read" loop, I don't know how to do it with inline bc commands. Maybe a bc expert can offer a quicker solution.

I also added a comment to your other posting about "ps -ef | awk"