DL380 G5 / Linux RHEL 5 / Reboot by ASR

[Arend Lensen]

For DL380G6....6...not 5. please look here:

http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?locale=en_US&objectID=c01955503

Regards,
Arend

[Johan Nieuwhoff]

HP Support provided me the following regarding the same problem:

Van: Global_Delivery_Event_Services@hp.com [mailto:Global_Delivery_Event_Services@hp.com]
Verzonden: vrijdag 12 februari 2010 10:23
Aan: VBVB - Johan Nieuwhoff
Onderwerp: Advisory: (Revision) Integrated Lights-Out 2 (iLO 2) Firmware Version 1.70 (Or Earlier) And iLO 2 Management Controller Driver Version 1.9.0 Or 1.11 - ProLiant Server May Unexpectedly Reboot And Display Event ID 57 Error Messages

Hewlett Packard is pleased to provide the following documentation via email.

Please do not reply to this message, as the HP Customer Care Center cannot be reached via this mailbox. Should further technical support be needed, please call the Customer Care Center directly.

Thank-you for contacting HP,
Your Customer Care Representative.

SUPPORT COMMUNICATION - CUSTOMER ADVISORY
Document ID: c01802766
Version: 3
Advisory: (Revision) Integrated Lights-Out 2 (iLO 2) Firmware Version 1.70 (Or Earlier) And iLO 2 Management Controller Driver Version 1.9.0 Or 1.11 - ProLiant Server May Unexpectedly Reboot And Display Event ID 57 Error Messages
NOTICE: The information in this document, including products and software versions, is current as of the Release Date. This document is subject to change without notice.
Release Date: 2010-01-20
Last Updated: 2010-01-20
________________________________________
DESCRIPTION
Document Version Release Date Details
3 01/20/2010 Updated information relating to the Windows Event Log.
2 01/19/2010 Added the HP ProLiant xw460c Blade Workstation to the Platforms Affected section as well as Microsoft Windows XP to the Scope and Operating Systems Affected section.
1 07/06/2009 The original document release.
When using Integrated Lights-Out 2 (iLO 2) Firmware Version 1.70 (or earlier) and iLO 2 Management Controller Driver Version 1.9.0 or 1.11, a ProLiant server may unexpectedly reboot when running Windows Server 2003 or Windows Server 2008. The following event ID 57 duplicate sensor error messages may be displayed in the Windows Event Log:

In addition, the following Automated System Recovery (ASR) message may be displayed in the Windows Event Log:
Information Events 1090 Server Agents bl460c N/A System Information Agent: Health: The server is operational again. The server has previously been shutdown by the Automatic Server Recovery (ASR) feature and has just become operational again.
Furthermore, the following ASR message may be displayed in the Integrated Management Log (IML):
ASR Detected by System ROM Automatic Server Recovery 1 Critical 1
SCOPE
Any ProLiant server configured as follows:
â ¢ Integrated Lights-Out 2 (iLO 2) Firmware Version 1.70 (or earlier)
â ¢ iLO 2 Management Controller Driver Version 1.9.0 or 1.11
â ¢ Windows Server 2003, Windows Server 2008 or Windows XP
RESOLUTION
In order to prevent unexpected server reboots, upgrade to both of the following:
â ¢ Integrated Lights-Out 2 (iLO 2) Firmware Version 1.78 (or later)
â ¢ iLO 2 Management Controller Driver Version 1.11.2.0 (or later).
Instructions for ProLiant BL-Series Server Blades
Perform the following steps to upgrade to iLO 2 Firmware Version 1.78 (or later):
1. Select the following URL:
http://welcome.hp.com/country/us/en/support.html?pageDisplay=drivers
2. Under category, select BladeSystem .
3. Select BladeSystem Server Blades .
4. Select HP ProLiant BL Server Blades .
5. Select the appropriate server blade.
6. Select the appropriate operating system.
7. Under category select Firmware - Lights-Out Management .
8. Select the Download button next to the description Online ROM Flash Component for Windows - HP Integrated Lights-Out 2 Version 1.78 (or later).
Perform the following steps to upgrade to HP ProLiant iLO 2 Management Controller Driver Version 1.11.2.0 (or later):
1. Select the following URL:
http://welcome.hp.com/country/us/en/support.html?pageDisplay=drivers
2. Under category, select BladeSystem .
3. Select BladeSystem Server Blades .
4. Select HP ProLiant BL Server Blades .
5. Select the appropriate server blade.
6. Select the appropriate operating system.
7. Under category select Driver - System Management .
8. Select the Download button next to the description HP ProLiant iLO 2 Management Controller Driver Version 1.11.2.0 (or later).
Instructions for ProLiant ML-Series and DL-Series Servers
Perform the following steps to upgrade to iLO 2 Firmware Version 1.78 (or later):
1. Select the following URL:
http://welcome.hp.com/country/us/en/support.html?pageDisplay=drivers
2. Under category select Servers .
3. Select ProLiant/tc Series Servers.
4. Select the appropriate server.
5. Select the appropriate operating system.
6. Under category select Firmware - Lights-Out Management.
7. Select the Download button next to Online ROM Flash Component for Windows - HP Integrated Lights-Out 2 Version 1.78 (or later).
Perform the following steps to upgrade to HP ProLiant iLO 2 Management Controller Driver Version 1.11.2.0 (or later):
1. Select the following URL:
http://welcome.hp.com/country/us/en/support.html?pageDisplay=drivers
http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=nl&prodTypeId=15351&prodSeriesId=1121586&prodNameId=3279711&swEnvOID=1005&swLang=8&mode=2&taskId=135&swItem=MTX-fa4293286417437a97aa0c4eb1
2. Under category select Servers .
3. Select ProLiant/tc Series Servers .
4. Select the appropriate server.
5. Select the appropriate operating system.
6. Under category select Driver - System Management .
7. Select the Download button next to the description HP ProLiant iLO 2 Management Controller Driver Version 1.11.2.0 (or later).
RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HP Subscriber's Choice. Sign up for Subscriber's Choice at the following URL:
http://www.hp.com/go/myadvisory


NAVIGATION TIP : For hints on navigating HP.com to locate the latest drivers, patches, and other support software downloads for ProLiant servers and Options, refer to the Navigation Tips document .
SEARCH TIP : For hints on locating similar documents on HP.com, refer to the Search Tips document .

________________________________________
Hardware Platforms Affected: HP ProLiant BL460c G6 Server series, HP ProLiant ML310 G5p Server series, HP ProLiant DL580 G5 Server series, HP ProLiant DL385 G2 Server series, HP ProLiant DL365 Server series, HP ProLiant BL465c Server series, HP ProLiant ML310 G3 Server series, HP ProLiant DL320 G4 Server series, HP ProLiant BL280c G6 Server series, HP ProLiant DL380 G6 Server series, HP ProLiant BL260c G5 Server series, HP ProLiant BL465c G5 Server series, HP ProLiant ML310 G5 Server series, HP ProLiant DL320 G5p Server series, HP ProLiant BL680c G5 Server series, HP ProLiant BL480c Server series, HP ProLiant ML310 G3 Storage Server, HP Integrated Lights-Out 2 (iLO 2) Firmware(Standard HP Product), HP ProLiant DL360 G6 Server series, HP ProLiant DL385 G5p Server series, HP ProLiant BL25p G2 Server series, HP ProLiant ML370 G6 Server series, HP ProLiant DL585 G5 Server series, HP ProLiant ML350 G5 Storage Server, HP ProLiant BL20p G4 Server series, HP ProLiant DL380 G5 Server series, HP ProLiant ML350 G6 Server series, HP ProLiant BL495c G5 Server series, HP ProLiant BL685c G5 Server series, HP ProLiant DL585 G2 Storage Server, HP ProLiant DL380 G5 Data Protection Storage Server, HP ProLiant BL45p G2 Server series, HP ProLiant ML310 G4 Server series, HP ProLiant BL460c Server series, HP ProLiant xw460c Blade Workstation(Standard HP Product), HP ProLiant Essentials iLO 2 Advanced Pack SW(Standard HP Product), HP ProLiant DL370 G6 Server series, HP ProLiant BL2x220c G5 Server series, HP ProLiant ML310 G4 Storage Server, HP ProLiant DL320s Server series, HP ProLiant ML570 G4 Server series, HP ProLiant BL460c G5 Server series, HP ProLiant DL785 G5 Server series, HP ProLiant DL320s Storage Server, HP ProLiant ML350 G5 Server series, HP ProLiant DL360 G5 Server series, HP ProLiant ML370 G5 Server series, HP ProLiant BL490c G6 Server series, HP ProLiant DL385 G5 Server series, HP ProLiant DL365 G5 Server series, HP ProLiant DL380 G5 Storage Server, HP ProLiant DL585 G2 Server series, HP ProLiant DL320 G5 Server series, HP ProLiant BL685c Server series, HP ProLiant DL580 G4 Server series
Operating Systems Affected: Microsoft Windows Server 2003 R2 Enterprise Option Kit SW(Standard HP Product), Microsoft Windows Server 2003 R2, Microsoft Windows Server 2003 Enterprise x64(Standard HP Product), Microsoft Windows Server 2003 Datacenter Edition(Standard HP Product), Microsoft Windows Essential Business Server 2008, Microsoft Windows Server 2003 Standard x64(Standard HP Product), Microsoft Windows Server 2008, Microsoft Windows Server 2003 Enterprise Edition(Standard HP Product), Microsoft Windows Server 2003 64Bit(Standard HP Product), Microsoft Windows Server 2003, Microsoft Windows Server 2003 R2 Standard X64 Option Kit SW(Standard HP Product), Microsoft Windows Small Business Server 2003 SW(Standard HP Product), Microsoft Windows Small Business Server 2008 with Windows Svr 2008 SP2, Microsoft Windows Server 2003 R2 Standard Option Kit SW(Standard HP Product), Microsoft Windows XP, Microsoft Windows Server 2008 Datacenter 2 CPU Option Kit English SW(Standard HP Product), Microsoft Windows Server 2003 R2 Enterprise X64 Option Kit SW(Standard HP Product), Microsoft Windows Small Business Server 2003 R2, Microsoft Windows Server 2003 Web Edition(Standard HP Product), Microsoft Windows Server 2008 Enterprise Option Kit English SW(Standard HP Product), Microsoft Windows Server 2008 for Itanium-based Systems, Microsoft Windows Server 2003 R2 Standard Edition (deleted), Microsoft Windows Server 2003 Standard Edition(Standard HP Product)
Software Affected: Not Applicable
Support Communication Cross Reference ID: IA01802766

[Metcalfep]

is HPASMCLI for Non Windows Servers?
Can I use it on Windows 2003?

if so where do I get it from
Need to turn off ASR on All Servers

[dawn_jose85]

In some of my HP Proliant DL 580 and DL 380 servers , hpasmcli command is not working. They are giving 3 types of errors as below .
ips121root#hpasmcli
HP management CLI for Linux (v1.0)
Copyright 2004 Hewlett-Packard Development Group, L.P.

--------------------------------------------------------------------------
NOTE: Some hpasmcli commands may not be supported on all Proliant servers.
Type 'help' to get a list of all top level commands.
--------------------------------------------------------------------------

ERROR: Could not communicate with hpasmd.
Please make sure the hpasmd daemon is started and running properly.


ALso in mcp

mcp1root#hpasmcli
ksh: hpasmcli: not found


ips132root#hpasmcli
HP management CLI for Linux (v1.0)
Copyright 2004 Hewlett-Packard Development Group, L.P.

--------------------------------------------------------------------------
NOTE: Some hpasmcli commands may not be supported on all Proliant servers.
Type 'help' to get a list of all top level commands.
--------------------------------------------------------------------------
hpGetSemID() semget failed: No such file or directory

ERROR: Could not open /dev/cpqhealth/cdt.
Please make sure the Health Monitor is started.
ips132root#


ipl133root#hpasmcli
HP management CLI for Linux (v1.0)
Copyright 2004 Hewlett-Packard Development Group, L.P.

--------------------------------------------------------------------------
NOTE: Some hpasmcli commands may not be supported on all Proliant servers.
Type 'help' to get a list of all top level commands.
--------------------------------------------------------------------------

[Don Vanco - Linux Ninja]

1) Your issues appear to have nothing to do with ASR reboots, the subject of this thread

2) There are numerous pointers to the problem(s) in the very text you pasted - did you address them?

Your problems could be as simple as starting daemons and using absolute path for the commands you're attempting to run.

[rapgame]

We have the same problem with two Proliant ML350 g5. Both rebooting instantly without clear cause. Databases are not turned off before shutdown, something I really not like.

Our monitor system tells us:

Hardware status;WARNING;SOFT;1;WARNING - fan 1 (system) is not ok, fan 3 (system) is not ok, System: 'proliant ml350 g5',

We did the test, with a similar testmachine.
When you unplug the fan manually, the system will reboot instantly. Maybe due overheating or self-protection against it.

We contact HP support and they will visit and help us with a firmware update. Hope this will help. Again, abnormal restarts is the main cause of database corruption. Our company relies on those databases.

So if HP can not solve this problem I will not advise to choose a Proliant, although HP hardware is well known as reliable and good support.

[Sayed Sadik]

I am not able to find Recovery option in System Management homepage to disable ASR.

The OS running is w2k3 64 bit.

Kindly let me know how to disable ASR.

[Ugo Bellavance (ATQ)]

You can disable it in the bios, at worse.

[Sixto_1]

I have experienced a similar situation but if I check the IML log the only entry that I found are similar to this:
Event: 9 Added: 02/15/2011 21:36
CRITICAL: ASR - ASR Detected by System ROM.

Does it mean a server reboot?

[Don Vanco - Linux Ninja]

ASR = Automatic Server Recovery

Yes - you rebooted.