root filesystem keep on increasing

[Ho Fei Wen]

I have a pair of clustering HP-UX servers running on Oracle 8.1.6.

The root filesystem / is keep on increasing at the live server(from 22% used until now 88% used). when I shutdown my Oracle database, the / filesytem free space increase from 22% to 88%.

I have check with Oracle support, there is no log files written to / filesystem. Futhermore, there is no permission for Oracle user to write into / filesytem.

Now I am suspecting the MC Service Guard having problem.

Anybody encounter this before?

regards,
Fei Wen

[Pete Randall]

This is one of the most common subjects of discussion on the forums. Just do a search on root +full and you'll come up with literally hundreds of answers.

HTH,
Pete

[Vijeesh CTK]

hi

R u shutting down oracle with the control script. I have faced a similar problem like this . My oracle was writing the logs to /etc/cmcluster/"pkg name"/control.sh.log file. check the size of the control.sh.log file

CTK

[Sukant Naik]

Hi Hoi,

When you are having MC Service Guard, please check the following

1. Check the /var/adm/syslog/syslog.log file. There are lot of messages being logged into it by MCSG.

2. Under the /etc/cmcluster directory, if you have got packages, check the /etc/cmcluster//control.sh.log file. Usually there will be a log file created for every package you create and it might occupy lots of space.

These are the two I could think of as of now. I shall post you more as I find something more.

-Sukant

[U.SivaKumar_2]

hi,
Check for huge core dump file under /
#ls core
if you suspect the MCSG.
regards,
U.SivaKumar

[harry d brown jr]

Fei Wen,

If you don't already have "lsof" installed, get it from here and install it:

http://hpux.cs.utah.edu/hppd/hpux/Sysadmin/lsof-4.61/

Then use it to determine what processes have what files open under the ROOT filesystem.

Now the ROOT filesystem usually INCLUDES these directories:

/
/dev
/etc
/sbin
/stand

The /dev directory sometimes has "regular" files in it, which it shouldn't have! To find "regular" files that don't belong in /dev do this:

find /dev -type f -exec ls -l {} \;

The /etc directory should also never be used for logs or anything other than CONFIGURATION files.

Using lsof, and the PID of the orcale processes you can find what files they have open:

lsof -p PIDNUMBERHERE

live free or die
harry

[Trond Haugen]

I don't have the answer but if I understand you right USED grows from 22% to 88% over time with Oracle running. But when you stopp Oracle if falls down to 22% again. This strongly suggests that Oracle have some temporary file in /.
If Oracle is stopped and started thru ServiceGuard I would suggest checking the package scripts.
Any filesystem swap on /?

Regards,
Trond