no space left on device

[Matt Shaffer_1]

This is a rhel3u8 box. I'm trying to create a dir under /home and am getting No space left on device. There are plenty of free inodes and the lvol is almost 100% free. Help please. Thank you

###################################
# df -i .
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/vg00/home 655360 190 655170 1% /home
# df -h .
Filesystem Size Used Avail Use% Mounted on
/dev/vg00/home 5.0G 65M 4.8G 2% /home
####################################

[Steven E. Protter]

Shalom,

If you delete the file and there is still an open process with a file handle open, the space is not returned usable to the system.

Fixes:
1) find and kill processes on /home fuser -u /home
2) reboot


SEP

[Matt Shaffer_1]

There is no one in /home.
################################3
# lsof /home
COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
ksh 29007 sysadmin cwd DIR 58,0 4096 32769 /sysadmin
su 29140 root cwd DIR 58,0 4096 32769 /sysadmin
ksh 29619 sysadmin cwd DIR 58,0 4096 32769 /home/sysadmin
su 29640 root cwd DIR 58,0 4096 32769 /home/sysadmin
ksh 30474 pprasad cwd DIR 58,0 4096 180226 /home/pprasad
# fuser -u /home
/home:
No process references; use -v for the complete list
#
#######################3

[Matt Shaffer_1]

I decided to just try to remove this lv and recreate it. I am not able to remove it.

# lvscan
lvscan -- ACTIVE "/dev/vg00/home" [5 GB]
lvscan -- ACTIVE "/dev/vg00/opt" [1 GB]
lvscan -- ACTIVE "/dev/vg00/tmp" [2 GB]
lvscan -- ACTIVE "/dev/vg00/var" [4 GB]
lvscan -- ACTIVE "/dev/vg00/wcc" [25 GB]
lvscan -- ACTIVE "/dev/vg00/library" [4 GB]
lvscan -- ACTIVE "/dev/vg00/data" [2 GB]
lvscan -- 7 logical volumes with 43 GB total in 1 volume group
lvscan -- 7 active logical volumes

# umount /dev/vg00/home
umount: /dev/vg00/home: not mounted
# lvremove /dev/vg00/home
lvremove -- can't remove open logical volume "/dev/vg00/home"

# lvchange -a n /dev/vg00/home
lvchange -- operation not permitted for (open) logical volume "/dev/vg00/home"

[Court Campbell]

try

# fuser -cu /home

[Court Campbell]

> # umount /dev/vg00/home
> umount: /dev/vg00/home: not mounted

Might want to try

# umount /home

But I believe the file system is still in use and the command is going to fail.

[Ivan Ferreira]

Normally, you won't be able to umount /home even with no user activity. This should be done in rescue mode.

Please post the outout of:

dumpe2fs -h /dev/vg00/home

[Sreedharamurthy K]

Sometimes if /tmp is full you get this error. So check if /tmp or /var/tmp is full.

[Adithyan]

Hi Matt,

As per the df output the /home is not started using still ??

Why dont you try a file system recreation ?

Run mkfs.ext3 once and try.

[Stuart Browne · Accepted solution]

THE HELL Adithvan ?!? Don't do that!

Sheesh!

A 'fsck' if it's still playing funny-buggers might be in order though.

[Adithyan]

Hi Matt,

Lets see what difference fsck make in this case !!

Let us know the outcome.

[Matt Shaffer_1]

Thanks for all the suggestions everyone. Yesterday, lvremove worked for me. I don't know why it wasn't working on Wednesday. I forgot to close out the forum. Thanks again.

[Matt Shaffer_1]

lvremove worked for me