root file system 98% utilized

[prajul.keeriyat]

Hi All,

My server root file system is 98% utilized,
could you please help me...
sh# > find / -type f -xdev -print | xargs -e ll | sort -rn -k5 | head -n 10
-r-xr-xr-x 1 bin bin 29437860 Sep 7 2007 /etc/vx/static.d/build/vold.o
-rw------- 1 root root 10485760 Apr 9 09:31 /etc/emc/ppme/log.0000000001
-rw-r--r-- 1 root sys 9118400 Jun 29 13:56 /etc/log/agent.log
-rw------- 1 root sys 5797888 Jun 27 00:31 /etc/lvmconf/vg08.conf
-r-xr-xr-x 1 bin bin 5288456 Sep 7 2007 /etc/vx/type/static/vxconfigd
-r-xr-xr-x 1 root sys 5000459 Sep 30 2005 /nsr/jukebox/libvgalaxy.sl
-r-xr-xr-- 1 bin bin 3182592 Oct 19 2006 /etc/emc/bin/powermig_no
-r-xr-xr-x 1 bin bin 3006464 Mar 29 2004 /etc/opt/resmon/lbin/rdbmsmond
-r-xr-xr-x 1 bin bin 2990080 Mar 29 2004 /etc/opt/resmon/lbin/mibmond
-rw------- 1 root sys 2983936 Jan 4 21:45 /etc/lvmconf/vg01.conf

[Dennis Handly]

Do you have lots of logs in: /etc/emc/ppme/
Does /nsr/jukebox/ need to be in /?

[John Guster]

try zero the zise of the log files but not remove them as following:

#>etc/emc/ppme/log.0000000001
#>/etc/log/agent.log

it will free about 18MB

[Dennis Handly]

>John: try zero the size of the log files
#> /etc/emc/ppme/log.0000000001

For numbered logfiles, you typically can do something better for all but the active one.
Either remove them, or move them, or gzip and tar them. Or some combination of the last 3.

[Vijaykumar_1]

Hi,

This is not the right file,but even you can have a check on the old back-up's under lvmconf.

What is the size of the / FS ?

[Elmar P. Kolkman]

As for the /nsr filesystem: create a new lvol, shutdown networker, move /nsr to a temporary directory, make a mountpoint (empty directory), mount the new lvol (with a valid filesystem, of course) and move the necessary files to this new /nsr. Then start networker again.
(The placement of this shared lib is strange, btw. I've lots of networker experience and have never seen something like that installed there...)
Then you can remove the temporary /nsr and you have some more space.

If you don't use this machine as a networker server or storagenode anymore, you could remove the directory entirely (a shared lib from 2005 would mean you haven't upgraded recently... ;-) )

As for finding what's causing the problem: I usually do:
du -akx / | sort -n | tail

Sometimes a large number of small files can be as devastating as 1 large file. This way you have also directories containing lots of files in the output.

[Ishwar_1]

Output which you have posted shows that except /nsr all the file belong to /etc. As we know that /etc is static Filesystem which size does not change oftenly but their are log files to generating in the /etc/ which is not Good for /. Was their any Recent Activity after which you are having this problem or create a separate mount point for the /etc. You can also trim the Size of the Log File by "Ex" Editor or rename the log file and move it to diff mount point.

Hope this information helps you to find solution.

Regards
Ishwar

[Hakki Aydin Ucar]

Why do you backup old logfiles to the tape, and then zero the size of old/passive ones ?

[Suraj K Sankari]

Hi,
In you output I can see so many old files which are not updating now if those files are not required you can nullify those files
# > filename

It will reduce your file into 0 zero bytes.

Suraj