ProLiant Servers (ML,DL,SL)
cancel
Showing results for 
Search instead for 
Did you mean: 

After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Giorgos Gaganis
Occasional Visitor

After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I have just purchased a DL360 G5. I have also purchased Redhat Enterprise Linux and installed v5.3 on the server.

Next I tried to install PSP version 811 which was provided in the CD-Rom that came with the server. During the installation the system hanged and the keyboard blinked indicating kernel panic. I hard rebooted the server and then the server hanged every time during the boot process again indicating kernel panic.

Next I got and tried to install version 815 which during the installation process rebooted the server. Now the server proceeds up to a point at the boot process and then automatically stops booting and starts shutting down and eventually reboots. This results in an eternal rebooting cycle.

My questions are:
-Is PSP supported on this version of Redhat Enterprise Linux?
-Is this a known problem?
-How can I get support about the PSP from hp?

Thank you very much
Giorgos Gaganis
16 REPLIES
Brandt lawson_1
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I just had the equivalent problem on a dl380 g4 - I allowed a huge update to my RHEL5 (probably the equiv of 5.3) and now I get a kernel panic on reboot. I booted my previous kernel and tried to use LDU to re-install my 8.15 PSP and got mixed results.

Apparently, I can't just rip out the PSP and I can't rebuild it. If I am stuck with an OS re-install, I will really be mad. Thank goodness this isn't a production server.

What are my options?

Marshall Norris
Occasional Visitor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I'm installing RHEL 5.2 just today on a DL 360 and I have run into this problem as well. The installation was working just fine on previous servers as recent as last week, so perhaps the iLo RPM doesn't like the latest Linux kernel.
THAKUR
Frequent Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Hi Marshall,

Which version of PSP you are using & what is the firmware version?

Thanks,
AKT
THAKUR
Frequent Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Hi Giorgos,

RHEL5.3 is not supported by hp till now. May be in the future they will support this OS.

you can try using RHEL5.2 OS. It is supported by PSP version 8.11

Answers to your question:-
1. PSP 8.11 & 8.15 does not support RHEL5.3 OS.

2. I think, this is a known problem.

3. They will be releasing the PSP for this OS with 8.20

Thanks,
AKT
THAKUR
Frequent Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Hi Brandt,

Hope my above answer to giorgos will also resolve your query.

Thanks,
AKT
Ole Holm Nielsen
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

We have a kernel panic on a DL380 G5 when rebooting RHEL 5.3. It's when the hp-ilo driver is loaded. Workaround: Boot the old kernel and do "rpm -e hp-ilo hponcfg", then reboot the RHEL 5.3 kernel.

Question: Is there a release date for PSP 8.20 ?
Brandt lawson_1
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I appreciate all the input. I methodically ripped out all the HP PSP stuff (I hope) and am running smoothly now.

My current production DL580 server has been up like 99.99% for 3 years, running RHEL 3 and Oracle 9i. I keep it updated and never installed the PSP stuff on it.

I am not interested in taking a chance with this next server. I'll just go look at the lights every day.

I am not impressed with HP's tools, but I like their servers.
Ole Holm Nielsen
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

We also had many cases where the PSP needs to be ripped out. Sometimes the PSP homepage is almost empty (no agents shown), then you know it's time...
The instructions for PSP removal are absent from HP, so here is my version made by trial and error:

First stop the running services (RedHat5):

service hp-snmp-agents stop
service hp-health stop
service hp-ilo stop
service hpvca stop
service hpsmhd stop
cpqacuxe -stop # if cpqacuxe is running

or for RedHat 4:

service hpasm stop
cpqacuxe -stop # if cpqacuxe is running

Then uninstall the PSP RPM packages:

rpm -e hpasm hprsm hpsmh cmanic hponcfg hpadu hpvca cpqacuxe hpacucli hpdiags hp-vt hp-ilo hpmouse hp-pel hp-OpenIPMI

With PSP 8.11 and 8.12 we need in stead:

rpm -e hpsmh hp-smh-templates hponcfg hpadu hpvca cpqacuxe hpacucli hpdiags hp-ilo hpmouse hp-OpenIPMI hp-snmp-agents hp-health hp-pel hp-vt

If rpm complains about one or more packages not being installed, then remove these from the list. The hpmouse RPM removal may have error messages, remove it by:

rpm -e --noscripts hpmouse

Check the running processes to make sure that there are no PSP processes (such as hpsmh etc.) left behind:

ps auxw

Finally, remove all the configuration and log files left behind:

rm -rf /opt/hp /opt/compaq /usr/local/hp /var/spool/compaq /var/hp

Now update /etc/passwd and /etc/group from the central password server so that the user hpsmh is defined according to the central password repository. Currently this setup is:

# grep hpsmh /etc/passwd /etc/group
passwd: hpsmh:x:451:15011::/opt/hp/hpsmh:/sbin/nologin
group: hpsmh:x:15011:

At this stage it should be possible to reinstall the PSP from scratch as shown above.
Brandt lawson_1
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Whew, I had most of it, but you cleaned up the small pieces.

Tak skal du have, Ole.
David Altobelli
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

As mentioned elsewhere in this thread, this is a known problem. This problem is caused by the hp-ilo RPM included in the PSP. RHEL5.3 includes the hpilo module, which replaces the module shipped in the hp-ilo package (hp_ilo module). The problem is caused by hp_ilo, there is not a problem with your distro kernel.

The panic trace will look something like:
RIP: [] :hp_ilo:init_hpqci+0xx/0xxx

This PSP is not supported on RHEL5.3. You will need the 820 version of the PSP, which is not yet released. The release date is not announced yet, I can't share that data.

To avoid the problem, remove the hp-ilo package, or if you already have the problem and have crashed, boot to init level 1, and then remove the hp-ilo package.
David Altobelli
Occasional Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

The 815 (and earlier) hp_ilo module does not account for the case that pci_register_driver() could succeed, but the .probe method would not be called. So, hp_ilo assumes the CpqCi pointer is valid, and causes a NULL pointer dereference.
The fix is pretty simple:

--- drivers/char/hp_ilo/CpqCiKlx.c 25 Apr 2008 14:55:18 -0000 1.3.2.3
+++ drivers/char/hp_ilo/CpqCiKlx.c 23 Jan 2009 18:53:26 -0000
@@ -1994,6 +1994,8 @@ static int __devinit hpqci_pci_probe(str
return (status);
}

+ pci_set_master(pdev);
+
adapterExtension->pdev = pdev;
return (status);
}
@@ -2114,6 +2116,9 @@ Return Value:
}


+ if (!CpqCi)
+ return -ENODEV;
+
adapterExtension = CpqCi;
pdev = CpqCi->pdev;
mmioreg = (CPQCIPHYSICAL)pci_resource_start(pdev, 1); // BAR 1, Offset 0x14

The pci_set_master() is to keep the integrated remote console working, there are some shared resources that can get disabled on hpilo unload. The !CpqCi check turns the crash into a graceful failure.
If you want to build this, make sure you system is set up for module builds (kernel-devel + gcc), and run "cd /opt/hp/hp-ilo; do_your_edits to drivers/char/hp_ilo/CpqCiKlx.c; make".

To work around this in the short term, one could add a "rmmod hpilo" in the start portion of /etc/init.d/hp-ilo. That way, your existing management software would continue to function, and there would be no crash.

case "$1" in
start)
#
-# First test to see if hp-ilo driver is loaded
+# First test to see if hpilo driver from distro is loaded
+#
+ RUNNING=`lsmod | fgrep hpilo`
+ if [ ${#RUNNING} -ne 0 ]; then
+ rmmod hpilo
+ if [ "$?" -ne 0 ] ; then
+ showfailure
+ cmaecho "hp-ilo: Not able to stop hpilo module"
+ exit 1
+ else
+ cmaecho "hp-ilo: Unloaded distribution hpilo module"
+ fi
+ fi
+#
+# Then test to see if hp_ilo driver is loaded
#
RUNNING=`lsmod | fgrep hp_ilo`
if [ ${#RUNNING} -ne 0 ]; then


Long term, the right way will be to upgrade your management software to version 820, which will use the in distro hpilo module, and you will not need the hp-ilo package.
pakazmir
Occasional Contributor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I've experienced the same problem with a DL580 G4 that was updated to 5.3. I've simply disabled the hp-ilo service and am running okay.

Eagerly waiting for the 820 release.

Thanks,
Peters
THAKUR
Frequent Advisor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Thanks David...
For such a detailed explanation...

Regards,
AKT
Jimmy Vance
HPE Pro

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Red Hat Enterprise Linux 5.3 includes a newer version of the HP iLO driver and the older driver may panic the system if both are loaded simultaneously.

More details can be found in this RedHat KB article

http://kbase.redhat.com/faq/docs/DOC-15564



__________________________________________________
No support by private messages. Please ask the forum!      I work for HPE

If you feel this was helpful please click the KUDOS! thumb below!   
David_679
Occasional Visitor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

Jason Balicki
Occasional Visitor

Re: After Installing PSP on Redhat Enterprise Linux 5.3 on a DL360 G5 the system hangs on boot

I've downloaded the new PSP that was just posted and I can install everything except cpq_cciss. I get:

[root@stlmojbprod01 linux]# rpm -Uvh cpq_cciss-3.6.20-18.rhel5.x86_64.rpm
Preparing... ########################################### [100%]
The currently running kernel (2.6.18-128.1.1.el5) is not
supported by this rpm. The supported kernels are:

2.6.18-128.el5
2.6.18-128.el5xen
2.6.18-53.1.13.el5
2.6.18-53.1.13.el5xen
2.6.18-53.1.14.el5
2.6.18-53.1.14.el5xen
2.6.18-53.1.19.el5
2.6.18-53.1.19.el5xen
2.6.18-53.1.21.el5
2.6.18-53.1.21.el5xen
2.6.18-53.1.4.el5
2.6.18-53.1.4.el5xen
2.6.18-53.1.6.el5
2.6.18-53.1.6.el5xen
2.6.18-53.el5
2.6.18-53.el5xen
2.6.18-8.1.14.el5
2.6.18-8.1.14.el5xen
2.6.18-8.1.15.el5
2.6.18-8.1.15.el5xen
2.6.18-8.el5
2.6.18-8.el5xen
2.6.18-92.1.13.el5
2.6.18-92.1.13.el5xen
2.6.18-92.1.18.el5
2.6.18-92.1.18.el5xen
2.6.18-92.1.1.el5
2.6.18-92.1.1.el5xen
2.6.18-92.el5
2.6.18-92.el5xen

Please boot into a supported kernel before installing this rpm
error: %pre(cpq_cciss-3.6.20-18.x86_64) scriptlet failed, exit status 1
error: install: %pre scriptlet failed (2), skipping cpq_cciss-3.6.20-18

Info:

[root@stlmojbprod01 linux]# cat /etc/redhat-release ; uname -a
Red Hat Enterprise Linux Server release 5.3 (Tikanga)
Linux stlmojbprod01.magellanhealth.com 2.6.18-128.1.1.el5 #1 SMP Mon Jan 26 13:58:24 EST 2009 x86_64 x86_64 x86_64 GNU/Linux
[root@stlmojbprod01 linux]#

Is there an easy solution?

Thanks.