extend the /( root) file system--

[sam_25_1]

Hello everyone,


I would be oblidged if you'll could help me out. I have gone through nearly all the threads regaring the (/) root file system full and have tried all possible suggestion, however my problem is still persisting.

I have my /root file system at 94 % and have checked for core files and other options posted in previous thread.

Intially my root file system was at 76% but when I rebooted the server It reached 94 %.

please find the contents of the root file system.

____________________________________________

.Xauthority .pvprinters_ver1 ThCallHooks: dev ignite-backup1 nsr sbin tmp
.Xauthority.new .rhosts ThrSaveSPAFields error.file opt stand tmp_mnt
.Xauthority.old .sh_history ThrSaveSPAFields: etc lib oracle taxware usr
.gpmhp-lathstg .ssh bas home lost+found sap taxware345 var
.profile .sw bin iface lvoltest sapmnt
temp-backup wan
.profile.bak SD_CDROM cdrom ignite-backup net sapswap testr

----------------------------------------------
i have usr and tmp & others mounted on different Logical volumes.

I have checked there are no core files & other log files which I could modify.


Kindly let me know, what I could do to get this sorted out.

Incase I need to finally extend the roof file system through Ignite backup. Could u please guide me how to fo about while resing it.

I have downloaded few pdf for the same and I am trying my best to grasp as much understanding I could.

Thanks once again to everone for your ongoing support & forum rocks:) ...

Awaiting your reply

Regards

Sam

[Ganesan R]

Hi Sam,

Most cases /etc/lvmconf directory consumes more space. You can move or delelte old conf files.

Use this command to find which directory consumes more space on root filesystem.

#du -xk / |sort -nr |head -25

The above command will list the top 25 directory consumes more space on root filesystem. you need to check top directories and remove the unnecessary files.


Though we have some alternates, ignite is the safe and preferred way to extend the root filesystem. If you have installed ignite issue the below command.

#make_tape_recovery -Av -x inc_entire=vg00 -I

Boot with the tape and run interactive mode. Select advance options there you can modify the LV sizes and continue to restore.

[smatador]

Hi,
You could search for example the big file
find / -xdev -size +5000 -exec ls -al {} \;
maybe you have some dead.letter or tar file put somewhere in /

[sam_25_1]

Hi Ganesah,Smartdoor

Thanks a lot for your speedy reply. You are rite under lvm.conf there were some old configs which I have already moved earlier thats how my / root file system came down from 97% to /94%. To be really honest I dont know what other files have occupied so much of space and why after reboot my / root file system suddenly increased.

The out of the large files are given below.

175512 /
126528 /etc
63448 /etc/vx
48256 /sbin
33128 /etc/opt
32960 /etc/vx/type
29472 /etc/vx/static.d
28760 /etc/vx/static.d/build
23344 /etc/opt/resmon
17808 /etc/opt/resmon/lib
14920 /etc/vx/type/static
12576 /etc/lvmconf
8952 /etc/vx/type/gen
8504 /etc/lp
6776 /etc/vx/type/raid5
6736 /etc/lp/interface
6232 /etc/opt/OV/share
6232 /etc/opt/OV
5928 /sbin/fs
5512 /etc/opt/OV/share/conf
5416 /etc/lp/interface/model.orig
4504 /etc/emc
4104 /etc/opt/OV/share/conf/analysis
3832 /etc/opt/resmon/lbin
3512 /sbin/fs/vxf
-----------------------------------------=

Thanks once again for your help & guidance, is there anything else I could do to get this worked, as I havent tried doing a ignite-backup/restore before.

Thanks once again for your speedy reply.

Regards

Sam

[Ganesan R]

Hi Sam,

I don't think you can get much free space from here. Your root filesystem has been created with default size taken during installation. This is the comman scenario most of the unix admin faces. It should have created with some more space considering the future.

Anyway now you have to extend the filesystem
I still prefer to ignite backup and restore.
If not there is a alternate way. If you have mirrordisk and enough space in vg00 you can try this.

Go through here..

http://www.symmetricwebsites.com/articles/HP-UX/hpuxDynamicallyExtendSlashAndOrStand.php

[sam_25_1]

Hi ganesan,

Well I dont have the mirror disk in place.

is there anything else i could move or delete from the output u large files.

Well I would go through the link for the ignite-recovery. To be honest I have never done this activity before of restoring through the ignite-tapes. Thanks once again for your guidance, sincelry appreciate it.



Regards

Sam

[Ganesan R · Accepted solution]

Hi SAM,

I cannot see any directory cleaned up further since all are necessary directories.

If you still not willing to go for ignite recovery and want to free up some space, try few steps.

Find 1MB files and see anything can be deleted.

#find / -xdev -size +1000

check the size of /etc/utmp and empty if needed

#ll /etc/utmp

check for any log files

#find / -xdev -name log

[smatador]

Hi,
Boot from the tape or you lan boot image and you will get an interative install. You could change the sizes during this.

[Ganesan R]

Hi Sam,

If you have another free disk or LUN and you are good in LVM, I would suggest another way since you do not have mirror.

If you have another disk with enough space and onlineJFS installed you can try this.

Add the new disk or LUN into VG00 using pvcreate and vgextend.
pvmove the lvol1/lvol2/lvol3 to the new disk
Now we have root lv on newdisk. you can extend the root lv now, since we have contigious space. And extend the filesystem using fsadm.

After that you need to pvmove the remaining lvols to new disks. Now all the lvols are in new disks. If need mirror the new disk with old disk. Having the new disk in VG00 or breaking it, is upto you.

Also for safer side, you can do mirror instead of pvmove. So that we can be safe during pvmove activity.

Hope this helps..

[Steven E. Protter]

Shalom,

Move every home directory based in root out of root.

You seem to be using x windows app and the temporary data is being stored in the root fs.

SEP

[sam_25_1]

Hi ganesan

Thanks a lot for your suggestion, Unfortunaetly I dont have an Online Jfs installed on the system. I have checked the logs and i guess at the maximum I would be able to free up 5 mb of space.

Secondly I still have ample amount of space around 30 Gb for the Vg00 disk.

You are rite there is not much room for space as all the remaining files are improtant. But I still fail to understand how after my reboot the / usage increased from 74 % to 94 %

I would be going the notes fo r the ignite-recovery as I guess it would be the most feasible solution I beleive.

Thanks once again for your speedy reply & guidance, highly appreciate it.

Would keep you posted about the progress.

regards

Sam

[sam_25_1]

Hi Steve,

Thanks a lot for your guidance, I have the seperate logical volume for my /home directory

Please find below the bdf details.

Filesystem kbytes used avail %used Mounted on
/dev/vg00/lvol3 262144 243536 18608 93% /


/dev/vg00/lvol1 314736 46240 237016 16% /stand

/dev/vg00/lvol8 10256384 2309992 7884992 23% /var

/dev/vg00/lvol7 2621440 1668560 945472 64% /usr
/dev/vg00/lvol4 4128768 567856 3533632 14% /tmp

/dev/vg00/lvol6 4128768 3834040 293424 93% /opt
/dev/vg00/lvol5 327680 140400 185864 43% /home
#

Thanks once again for your reply, kindly let me know if anything else I could do.

Thanks
Sam

[Johnson Punniyalingam]

Hi Sam,

1) Check the biggest directory in root (/):

# du -k -x | sort -rn | pg

2) Go to each big subdirectories (which will be listed on top, running
the above command) and check for bigger files there:

# find . -depth -xdev -size +1000 -print

3) Check and if you think the directories/files are not needed, move or
delete it.

Note: One common reason for root file system full is a big file in
/dev. If by mistake, somebdy gave /dev/rmt/Om instead of /dev/rmt/0m during
a backup, that might make the root file system full!

Thanks,
Johnson

[sujit kumar singh]

hi


as from the bdf O/P you are having a 250MB root!!.


better to think of increasing that asap using ingnite , pvmove lvol4,lvol5 to the other places etc and then exxtend the root LV /dev/vg00/lvol3 taking in the Single-user mode.


anyway the best way is to take thhe help of ignite of the server and ignite restore.

good that if ypu do not have the root disk as mirrored now , get a disk and get that mirriored the disk, take an ignite, take one of the mirrored disks out, do an ignite restore of the OS with the advanced option,, install OS with the larger root, swap , var ,opt , home , tmp and stand.

if all is good and the Ignite restore is good and the purpose is solved out in the mirror disk and re mirror.


mirroring a disk with the existing one, and keeping that aside helps you to have one more level of protection in case the ignite might not succeed. Then you can put in this disk and get the system up and running.



just few thoughts
sujit

[Steven E. Protter]

Shalom,

250 MB root is a bit small but if there are no files in root, as there should not be, it should be sufficient.

I always liked to have root be 650 MB so it could handle an accidental dump of a cd to it, which often happened where I worked two jobs ago.

SEP

[sam_25_1]

Hello Everyone,

Thanks a lot for your suggestions. Sorry once again for the delay in reply as I was not able to access net on the weekend.

I guess resizing the / root would be the best solution I belive as all of you'll have suggested the same. I am really not sure which other files I could move, as I am just been assigned this new project and I am failry new working on this server.

I have gone through few documents for taking the ignite-backup & restore, but i am not sure how to resize it.

I would be very greatful if anyone could help me in doing so, is there any specific format that I need to follow.

Sorry once again for the delay in replying, Seniors thanks once again for your ongoing support, you'll are always ready to help us out.

Regards

Sam

[Ganesan R]

Hi Sam,

Ignite backup and restore has very few steps to follow. Go through this steps.

1. Check if you have ignite product installed.
#swlist |grep -i ignite

(If necessarey remove old one and install the latest ignite. Here you can download the latest ignite product. http://h20392.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=IGNITEUXB)

2. Run the below command to take ignite backup with interactive mode enabled.

#make_tape_recovery -Av -x inc_entire=vg00 -I

When the -I option is specified, booting from the tape will always present the interactive menus. This option is useful when making configuration changes during the recovery.

3.Once you have successfully taken the backup, boot from the tape and it will take you to HP-UX main menu.

In main menu -> Select HP-UX installation and Advance installation. You will be taken into user interface next, where you can modify filesystem sizes and other configurations. Goto filesytem tab and modify the filesytem sizes. Other settings you can leave it as it is. Continue to install, that will finish everything with modified filesystem sizes.

[sam_25_1]

Hi Ganesan,

Thanks a lot for all your inputs,
I have checked we have the ignite server configured, but have never used it yet. I would go through all the guideline provided. Thanks once again for your help, I sincerly appreciate it.

We have a script in place for the ignite server
===========================================

#!/usr/bin/ksh

uname -r > /tmp/uname.tmp

value=`cut -d"." -f3 /tmp/uname.tmp`

#put in if to look at end of script.

/opt/ignite/bin/make_net_recovery -s lathstg -a lathstg:/ignite-backup -x inc_entire=vg00 -n 2 > /tmp/ignitebackup.log

wait $!

value=`grep -c -i ERROR /tmp/ignitebackup.log`

if [ $value -gt 0 ]
then
cat /tmp/ignitebackup.log | mailx -s "Lath Ignite Backup"
fi
----------------------------------------


But have never used it,

Just a question instead of taking a backup on the tape can i take it on a shared nfs location and dump the output there.


Ganesan, thanks for all your help bro.

Regards

Sam

[Ganesan R]

Hi Sam,

Yes.You can use it. But just make sure that the hardware is capable of booting over lan. Most of the hardwares having that ability except some old models. When you recover from the network image, you have two options.
One is boot from the client.This is called pull install. Other one is boot from the server. This is called push install. If the server does not have network boot capablity, then push install is the only option.

As per your script, you have ignite net backup on "lathstg" server. You can use that image to recover. Give the below command to boot from client on BCH menu.

BCH>boot lan. install

Just interact the booting and change the filesystem sizes as we descriped earlier.

[sam_25_1]

Hi ganesan,

Thanks a lot for all your inputs, would do the same and update you.

ganesan, appreciate your sincere help& guidance.

Regards

Sam

[sam_25_1]

Hello Everyone,

I would be performing the ignite-recovery activity next week. Thanks everyone for your inputs, I highly appreciate it.

Regards

Sam