topic Cron jobs not executed for specific user in Operating System - HP-UX

Cron jobs not executed for specific user

Panagiotis Tzolio — Tue, 13 Oct 2009 06:51:49 GMT

We have created some crontab jobs for a specific user.
We have noticed that none of them is executed any more as scheduled, whereas as manual commands are successful.

Even simple commands under this user's crontab (eg date) are not executed whereas under another crontab with same group and same shell are successful.

Restarting cron daemon does not have any result and
ps -ef|grep cron
shows
# ps -ef|grep cron
root 13824 13798 0 17:10:25 pts/1 0:00 grep cron
root 16891 1 0 11:35:35 ? 0:01 /usr/sbin/cron

Can you please advice on what the problem can be?

Re: Cron jobs not executed for specific user

Kapil Jha — Tue, 13 Oct 2009 07:08:46 GMT

check in cron log what exacttly is happening.

Second you will have to tell how u scheduled the jobs...
crontab -e or crontab filename

BR,
Kapil+

Re: Cron jobs not executed for specific user

Michal Kapalka (mikap) — Tue, 13 Oct 2009 07:13:17 GMT

hi,

you could use su - $user and all your defined crontab scripts could be running under root crontab.

mikap

Re: Cron jobs not executed for specific user

Panagiotis Tzolio — Tue, 13 Oct 2009 07:35:26 GMT

In the cron log commands are referred but in real they are not executed.
In the past everything was working properly.

Is it possible that any cron job of this user is hanged and causes the rest of them not to be executed?

Re: Cron jobs not executed for specific user

Michal Kapalka (mikap) — Tue, 13 Oct 2009 07:40:03 GMT

hi,

when you executing the script manually,

under which user and how ??

sh shell_script.sh

mikap

Re: Cron jobs not executed for specific user

Kanagaraj — Tue, 13 Oct 2009 07:41:20 GMT

check /usr/lib/cron/cron.allow & cron.deny files are exist or not.

If cron.allow is exist then put the user entry & restart the cron daemon.

Re: Cron jobs not executed for specific user

Hakki Aydin Ucar — Tue, 13 Oct 2009 08:25:03 GMT

I agree with D.Kanagaraj, check this out. cron.allow

Re: Cron jobs not executed for specific user

Panagiotis Tzolio — Tue, 13 Oct 2009 08:52:18 GMT

The user is inside cron.allow.

Is it possible that any cron job of this user is hanged and causes the rest of them not to be executed?

Re: Cron jobs not executed for specific user

Hakki Aydin Ucar — Tue, 13 Oct 2009 09:47:14 GMT

No , I do not think so that cron jobs will affect others belongs to that user.

You say cron.allow is OK then

What can you see when examine the logs related with your user:

more /var/adm/syslog/syslog.log
more /var/adm/cron.log

OR

cat /var/adm/cron.log | grep -i

Re: Cron jobs not executed for specific user

Hakki Aydin Ucar — Tue, 13 Oct 2009 09:49:49 GMT

On second though; for test purpose :

try this with user root if you can afford it ?

and write here what is your exactl line in cronjob ?

crontab -e ?

Re: Cron jobs not executed for specific user

Panagiotis Tzolio — Tue, 13 Oct 2009 10:26:39 GMT

You can find attached the cron log.
The problematic user is nmcman.
Does this give you any clue?

Re: Cron jobs not executed for specific user

TTr — Tue, 13 Oct 2009 11:08:01 GMT

The jobs are getting executed but are getting a killed with a ts=9 status. Look for yourself in the cron log
> nmcman 19468 c Mon Oct 12 12:00:00 EETDST 2009
...
< nmcman 19468 c Mon Oct 12 12:00:00 EETDST 2009 ts=9

The log entries are intermixed with log entries from other jobs so you have to pair the log entries approprietly. The ">" stands for a job start and the "<" stands for a job exit. You can see the ts=9 at the exit entry. That is a hard kill with a "kill -9" signal. Now a few things to check as to why the jobs are getting killed.
1. Yes in some cases a command will not run if a another commnad is still executing from before. This is true with commands that lock a file or depend another resource (such as a port or a pipe file or a fifo) which is in use by a previously executed command
Check with "ps -efu nmcman" to see what else is running by this user.
2. Check if you are hitting any system limits such as open files, flocks, user processes etc. Look at the /var/adm/syslog/syslog.log for any errors.
3. Did you recently convert to a trusted system?

You also have too many jobs running every minute. Is that really necessary?

Re: Cron jobs not executed for specific user

Hakki Aydin Ucar — Tue, 13 Oct 2009 11:28:52 GMT

Yes, whenever you cron attempt to run it was immediately killed as TTr said.

Try (if you can use root) the same command with user root OR another user in cronjob:

as far as I can see also nmcman used another commands with this use and also got killed

Re: Cron jobs not executed for specific user

Panagiotis Tzolio — Tue, 13 Oct 2009 11:47:24 GMT

Exactly!
The commands fail only for the specific user. All the others are working fine.

I will re-check cron and syslog logs.

Re: Cron jobs not executed for specific user

TTr — Tue, 13 Oct 2009 11:58:02 GMT

You can also check if nmcman receives any email from cron regarding the killed job. See if there is anything else in the email.

You can add the -x c-shell flag to the crontab entry so that you get all the commands echoed as they are executed.

... csh -f -x /opt/mv36 ...

You can simplify his cronjob, why did he/she put /../ in there. It does not change anything, it just finds the command more directly.
... csh -f -x /opt/mv36/core/script/CK ...

Check

Re: Cron jobs not executed for specific user

Dennis Handly — Tue, 13 Oct 2009 12:49:01 GMT

What OS version are you running?

I would suggest you not write cron scripts using the scummy C shell.
Unfortunately you have one entry: date >> /home/nmcman/test2.txt
that uses the posix shell and that aborts too.

One time when cron was aborting, it occurred due to a bogus value of TZ. What's the value for nmcman?

>TTr: The jobs are getting executed but are getting a killed with a ts=9 status.

Hmm, the last time I looked, kill 9 would be ts=137, 128+9.
http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1287859
http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1212499
http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1287859
http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1319191

Re: Cron jobs not executed for specific user

TTr — Tue, 13 Oct 2009 13:17:43 GMT

> Dennis: ...kill 9 would be ts=137, 128+9.

Isn't the 128 offset used for the root user only?

Re: Cron jobs not executed for specific user

Dennis Handly — Tue, 13 Oct 2009 13:31:04 GMT

>TTr: Isn't the 128 offset used for the root user only?

I'm not sure why wait(2) would treat root special?

Re: Cron jobs not executed for specific user

Dennis Handly — Wed, 14 Oct 2009 06:04:22 GMT

>TTr: Isn't the 128 offset used for the root user only?

The 128 is used to indicate a coredump was produced. So you are correct, there was a kill -9.
SIGKILL is also also occurs when dld detects unsats. (Not sure how that happens with date(1).)

Re: Cron jobs not executed for specific user

Panagiotis Tzolio — Wed, 14 Oct 2009 06:43:54 GMT

Let me remind you that everything was working properly also for this user and no cron job is executed any more as scheduled, whereas as manual commands are successful.

The OS is HP-UX version B.11.23 in a ia64 hp server rx6600.

What else can i check so as to find the root cause of the failure (ts=9)?