topic Re: root filesystem keep on increasing in Operating System - HP-UX

root filesystem keep on increasing

Ho Fei Wen — Tue, 14 May 2002 09:45:11 GMT

I have a pair of clustering HP-UX servers running on Oracle 8.1.6.

The root filesystem / is keep on increasing at the live server(from 22% used until now 88% used). when I shutdown my Oracle database, the / filesytem free space increase from 22% to 88%.

I have check with Oracle support, there is no log files written to / filesystem. Futhermore, there is no permission for Oracle user to write into / filesytem.

Now I am suspecting the MC Service Guard having problem.

Anybody encounter this before?

regards,
Fei Wen

Re: root filesystem keep on increasing

Pete Randall — Tue, 14 May 2002 09:49:19 GMT

This is one of the most common subjects of discussion on the forums. Just do a search on root +full and you'll come up with literally hundreds of answers.

HTH,
Pete

Re: root filesystem keep on increasing

Vijeesh CTK — Tue, 14 May 2002 09:49:51 GMT

hi

R u shutting down oracle with the control script. I have faced a similar problem like this . My oracle was writing the logs to /etc/cmcluster/"pkg name"/control.sh.log file. check the size of the control.sh.log file

CTK

Re: root filesystem keep on increasing

Sukant Naik — Tue, 14 May 2002 09:50:45 GMT

Hi Hoi,

When you are having MC Service Guard, please check the following

1. Check the /var/adm/syslog/syslog.log file. There are lot of messages being logged into it by MCSG.

2. Under the /etc/cmcluster directory, if you have got packages, check the /etc/cmcluster//control.sh.log file. Usually there will be a log file created for every package you create and it might occupy lots of space.

These are the two I could think of as of now. I shall post you more as I find something more.

-Sukant

Re: root filesystem keep on increasing

U.SivaKumar_2 — Tue, 14 May 2002 09:57:16 GMT

hi,
Check for huge core dump file under /
#ls core
if you suspect the MCSG.
regards,
U.SivaKumar

Re: root filesystem keep on increasing

harry d brown jr — Tue, 14 May 2002 10:30:13 GMT

Fei Wen,

If you don't already have "lsof" installed, get it from here and install it:

http://hpux.cs.utah.edu/hppd/hpux/Sysadmin/lsof-4.61/

Then use it to determine what processes have what files open under the ROOT filesystem.

Now the ROOT filesystem usually INCLUDES these directories:

/
/dev
/etc
/sbin
/stand

The /dev directory sometimes has "regular" files in it, which it shouldn't have! To find "regular" files that don't belong in /dev do this:

find /dev -type f -exec ls -l {} \;

The /etc directory should also never be used for logs or anything other than CONFIGURATION files.

Using lsof, and the PID of the orcale processes you can find what files they have open:

lsof -p PIDNUMBERHERE

live free or die
harry

Re: root filesystem keep on increasing

Trond Haugen — Tue, 14 May 2002 11:25:42 GMT

I don't have the answer but if I understand you right USED grows from 22% to 88% over time with Oracle running. But when you stopp Oracle if falls down to 22% again. This strongly suggests that Oracle have some temporary file in /.
If Oracle is stopped and started thru ServiceGuard I would suggest checking the package scripts.
Any filesystem swap on /?

Regards,
Trond