topic Re: Vclass server cannot boot up normally in Operating System - HP-UX

Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 07:31:51 GMT

We have total power shutdown last 2 weeks. But we encounter a problem with one of our Vclass server. It cannot boot up normally. Below is the error I captured:

/sbin/auto_parms: DHCP access is disabled (see /etc/auto_parms.log)

/sbin/rc[11]: /sbin/rc2.d/S425ifs.server: not found
/sbin/rc2.d/S620xfs[10]: grep: not found
/sbin/rc2.d/S620xfs[10]: env: not found
interpreter "/bin/sh" not found
file link resolves to "/usr/bin/sh"
/sbin/rc[11]: /sbin/rc2.d/S999vxsal: not found
interpreter "/bin/sh" not found
file link resolves to "/usr/bin/sh"
/sbin/rc[11]: /sbin/rc2.d/S999vxsragent: not found
/sbin/rc3.d/S200tps.rc[15]: /usr/bin/hostname: not found

HP-UX Start-up in progress
__________________________

Configure system crash dumps ........................................ OK
Mount file systems .................................................. FAIL *
Update kernel and loadable modules .................................. N/A
Initialize loadable modules ......................................... N/A
Setting hostname .................................................... FAIL *
Set privilege group ................................................. N/A
Display date ........................................................ N/A
Copy processor logs to /var/tombstones .............................. N/A
Save system crash dump if needed .................................... N/A
Enable auxiliary swap space ......................................... FAIL *
Start syncer daemon ................................................. N/A
Configure HP Fibre Channel interfaces ............................... FAIL *
Configure Loopback interfaces (lo0) ................................. FAIL *
Initialize Software Distributor agent daemon ........................ N/A
Configuring all unconfigured software filesets ...................... FAIL *
Recover editor crash files .......................................... OK
Clean UUCP .......................................................... N/A
List and/or clear temporary files ................................... N/A
Clean up old log files .............................................. OK
Start system message logging daemon ................................. N/A
Start pty allocator daemon .......................................... N/A
Start network tracing and logging daemon ............................ N/A
Configure HP Gigabit Ethernet interfaces ............................ FAIL *
Configure HP Ethernet interfaces .................................... FAIL *
Configure HP 100BT interfaces ....................................... N/A
Configure HP SPP 100BT interfaces ................................... N/A
Configure LAN interfaces ............................................ FAIL *
Start name server daemon ............................................ FAIL *
Start NFS core subsystem ............................................ OK
Start NIS+ server subsystem ......................................... OK
Start NIS+ client subsystem ......................................... OK
Start NIS server subsystem .......................................... OK
Start NIS client subsystem .......................................... OK
Start NFS client subsystem .......................................... FAIL *
Start the Trusted Mode with Nis+ subsystem .......................... N/A
Configure pseudo devices for MAC/LLA access ......................... OK
Start multicast routing daemon ...................................... N/A
Start Internet services daemon ...................................... FAIL *
Start dynamic routing daemon ........................................ N/A
Start router discover protocol daemon ............................... N/A
Configuring PPP Interface ........................................... FAIL *
Start RARP protocol daemon .......................................... N/A
Start remote system status daemon ................................... N/A
Configuring man pages for Internet Services ......................... OK
Starting mail daemon ................................................ FAIL *
Starting outbound connection daemons for DDFA software .............. N/A
Start SNMP Master Network Management daemon ......................... FAIL *
Start OSPF MIB Network Management subAgent .......................... N/A
Start SNMP HP-UNIX Network Management subAgent ...................... FAIL *
Start SNMP MIB-2 Network Management subAgent ........................ FAIL *
Start SNMP Trap Dest Network Management subAgent .................... FAIL *
Start DCE daemons ................................................... N/A
Start RPC daemon if needed .......................................... N/A
Start the Isogon License Server daemon .............................. N/A
Start remote boot daemon ............................................ N/A
Starting X Font Server at TCP port 7000 ............................. N/A
Start vt daemon ..................................................... N/A
Start time synchronization .......................................... N/A
Start accounting .................................................... N/A
Starting the password/group assist subsystem ........................ N/A
Starting HP Disk Array Manager daemons. ............................. FAIL *
Starting disk array monitor daemons. ................................ FAIL *
Start print spooler ................................................. N/A
Starting HP Distributed Print Service ............................... OK
Start clock daemon .................................................. N/A
Support Tools Informational Fileset ................................. OK
Start diagnostic subsystem .......................................... OK
Starting hardware predictive ........................................ FAIL *
Start environment monitoring daemon ................................. N/A
Start auditing subsystem ............................................ N/A
Start audio server daemon ........................................... N/A
Start Distributed Single Logical Screen daemon ...................... N/A
SAM System administration configuration ............................. OK
MeasureWare performance software is being started. .................. OK
Initialize Software Distributor agent daemon ........................ FAIL *
Starting Event Monitoring Service ................................... OK
Start EMS SNMP subagent ............................................. FAIL *
Start FDR/UPSTREAM daemon ........................................... FAIL *
Configure HP Fibre Channel Mass Storage interfaces .................. FAIL *
Starting the Tracker RemoteExecutionServer (remexd) ................. FAIL *
Starting the HFT daemon ............................................. OK
Configure EMC Consistency Groups .................................... OK
Configure HP Fibre Channel Tachyon TL/TS Mass Storage interfaces .... FAIL *
.................................................................... interpreter "/bin/sh" not found
file link resolves to "/usr/bin/sh"
FAIL *
.................................................................... interpreter "/bin/sh" not found
file link resolves to "/usr/bin/sh"
FAIL *
Start X print server(s) ............................................. N/A
Start SAS/SPDS, SAS/Share & iPlanet Web Server ...................... OK
Starting the LSF subsystem .......................................... N/A
Start CDE login server .............................................. FAIL *

Hopefully you guys can help me. TQ

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 07:37:19 GMT

"Mount file systems .............. FAIL *"

## Could you post the output of

# bdf
# cat /etc/rc.log

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 07:40:19 GMT

From the previous thread, I could see that

#/dev/vg00/lvol3 / vxfs delaylog 0 1
/dev/vg00/lvol1 /stand hfs defaults 0 1
/dev/vg00/lvol4 /opt vxfs delaylog 0 2
/dev/vg00/lvol5 /tmp vxfs delaylog 0 2
/dev/vg00/lvol6 /usr vxfs delaylog 0 2
/dev/vg00/lvol7 /var vxfs delaylog 0 2
/dev/vg00/lvol8 /home vxfs delaylog 0 2
/dev/vg00/lvol9 /appl vxfs delaylog 0 2
/dev/vg00/lvol10 /home1 vxfs delaylog 0 2
/dev/vg00/lvol11 /etc/lvmconf vxfs delaylog 0 2

/dev/vg00/lvol3 is commented.

Why ?

Please uncomment it and reboot the server !!

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 07:42:10 GMT

I forget..

Please welcome to ITRC forums.

Please assign points to your thread
http://forums11.itrc.hp.com/service/forums/helptips.do?#33

This is a way of saying thanks to the right answers

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 07:55:05 GMT

This is rc.log

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 07:55:44 GMT

And this is /etc/fstab

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 07:57:39 GMT

Hi,

** rc.log **
Mount file systems
Output from "/sbin/rc1.d/S100localmount start":
----------------------------
mountall: file system table may be corrupt
EXIT CODE: 1
checking quotas
"/sbin/rc1.d/S100localmount start" FAILED

Also we could find in /etc/fstab

/dev/vg00/lvol3 is comments

I would advice you to uncomment it from /etc/fstab and boot the server

Also is bdf showing "/" (root) mounted as /dev/root

Check the second line in
# bdf

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 08:06:24 GMT

We comment it because there is another lvol mount as /

Filesystem kbytes used avail %used Mounted on
/dev/root 524288 438677 80469 84% /

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:11:55 GMT

You booted the server today

**************************************************
HP-UX Start-up in progress
Sun Mar 8 15:35:04 mal 2009
**************************************************

There is no where mentioned in fstab that /dev/root should be mounted as /

I would advice to edit /etc/fstab, uncomment the entry and boot the server

Since the server was unable to find "/" in fstab it mounted /dev/root as /

or edit it and reboot the server if downtime could be arranged

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:16:06 GMT

NOTE: root (/) FS should be mounted via /dev/vg00/lvol3.

Please make the changes.

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 08:20:29 GMT

So what u mean is, when the system cannot find lvol for / (root) at /etc/fstab, it will replace it with /dev/root, isn't it?

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:30:53 GMT

Yes,

we would have suggested to uncomment and mv mnttab and and do a mount -a, but since none of the services have been started, I would strongly recommened you to unhash the entry and then boot the server again .

By the way why is the entry in fstab commented ?

Was it commented after reboot.

If not, then uncomment and reboot the server.

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:34:23 GMT

Also please don't forget to assign points.

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 08:34:46 GMT

We also don't know. I'll follow your recommendation. However, how about other services which are failed duirng boot up? Are they also happened due to this problem?

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:37:17 GMT

If root filesystem doesn't get mounted "/sbin/sh" and /bin diretory which is needed to start all the script wont be found.
Hence all the above errors.

Hence uncommenting it will resolve the issue with the services not starting.

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 08:43:15 GMT

Okey, it makes sense. But how come it can up if I bring up accordingly? Single user mode > Init 2 > Init 3.

Re: Vclass server cannot boot up normally

Avinash20 — Sun, 08 Mar 2009 08:51:31 GMT

Since /dev/root got mounted as /, we are able to make the system up

I believe we could avoid the downtime via following

Make down your application is it is running

Edit /etc/fstab and uncomment the entry /dev/vg00/lvol3

The n

# mv /etc/mnttab /etc/mnttab.old
# mount -a
# bdf

If /dev/vg00/lvol3 gets mounted as / then

# init 1
# init 3

Re: Vclass server cannot boot up normally

mohdamir — Sun, 08 Mar 2009 08:57:09 GMT

Okey.. I've done as your suggestion. Hopefully this server do not down again. Thanks a lot for your help (^_^)

Re: Vclass server cannot boot up normally

mohdamir — Thu, 12 Mar 2009 03:14:53 GMT

Solution as above.TQ