job failing with this errpr Could not perform semaphore operation 60026

[caj]

My jobe are failing with this error .it is a control-M job

========= Error from Reformat_4.000 on blazer =========
Could not perform semaphore operation 60026
Aborting: No space left on device

ABINITIO (2.10.15): Fri Feb 10 14:50:24 2006


I except your valuable suggestion to resolve this problem

[Srini Jay]

Ajeesh,
Did you see this message "Aborting: No space left on device".

Probably one of your filesystem is 100% full. Free up some space or extend the filesystem and try submitting the job again.

You can try 'bdf' to see which filesystem is full.

[A. Clay Stephenson · Accepted solution]

I would tackle this as I do every other related error. One of the things that a good sys admin knows is what each system call does. The system calls are what really define UNIX. In your case, semaphores are mentioned and the error message "No space left on device" indicates that errno is being set to ENOSPC (see /usr/include/sys/errno.h) but that doesn't necessarily mean that it has anything to do with disk space.

There are 3 system calls related to sema4's: semget, semctl, and semop (There are actually more but these 3 comprise the "classical" sema4 system calls). You know do a man semget, semctl, and semop and see which one can set errno = ENOSPC.

You will find that semop() can do it and that indicates a need for more sem undo values -- the tunabls semmnu and semume address this.

Also, semget() can do it and that indicates that the system wide number of sema4's is exceeded. The kenel tunable semmni address this and possibly semmns.

It's going to be one of those tunables.

Another approach is use tusc to examine the running process and note exactly which system call is failing.

[Jeff_Traigle]

Actually, the "No space left on device" message is not related to disk space when it comes to semaphores. As I recall, I saw this once while trying to install Oracle once upon a time and the "device" the message referred to was a kernel table. You should check your semmns (max number of semaphores) kernel setting. You probably have it set too low. Increase it and things will probably work better.