Frequently rebooting dl380 g3

[Charles Driver]

Am trying to troubleshoot a problem on a dl380 g3. The server will run for a few days trouble free and then get itself into a cycle of very frequent reboots - no faults logged in event viewer or the hp diagnostic side of things, but the ilo log shows this sort of thing over and over -

473 10/08/2007 18:50:00 Server power removed.
474 10/08/2007 18:50:00 Server power restored.
475 10/08/2007 18:51:00 Server power restored.
476 10/08/2007 18:51:00 Server power removed.
477 10/08/2007 18:54:00 Server power removed.
478 10/08/2007 18:54:00 Server power restored.
479 10/08/2007 18:55:00 Server power restored.

There has been no problem with the power in the office and I can detect no fault in the UPS, but am running the server directly off the mains for the moment to see if that rectifies the issue. I'm after suggestions on my next step should the problem crop up when straight into mains? Isolate the individual psu's, test with each one acting on it's own, replace both if not resolved? Cheers for any help.

[Charles Driver]

Forgot to mention - the reboots do not occur at any specific point, can be a few seconds after it starts booting, halfway through loading server 2003, or after days of usage.

[James ~ Happy Dude]

Hello Charles,

Is could be due to Old Firmwares;

Download Firmware maintenance CD 7.9 from

http://h18004.www1.hp.com/support/files/server/us/download/27783.html

& boot from it.

Regards,
James.

[Charles Driver]

Should have mentioned that too - applied the most up to date firmware cd about a month ago.

[James ~ Happy Dude]

Hello,

Do you have one PSU connected to the MAINS & the redundant one connected to the UPS ?
Which UPS ?

Regards,
James.

[Charles Driver]

Both are connected to mains at the moment, they were previously both into an APC smart ups.

[Doug Dellinger]

Firmware was mentioned, 7.90 is the latest. PSP's wer not mentioned, 7.80 had some issues an dwe saw this type of reboots. Try PSP 7.90. An HP TCC sent me this:

Customer Advisory: (Revision) HP ProLiant Server May Blue Screen Under High I/O if Configured with HP Smart Array SCSI or SAS/SATA Controller and Running Microsoft Windows Server 2003 with HPCISSS.SYS or HPCISSS2.SYS and STORPORT.SYS with KB932755 Update: http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?lang=en&cc=us&objectID=c01068337


Bear in mind that the advisory is for any version of Windows 2003 not just x64.


There is also another issue with PSP 7.8 and the NC373i NICs where there are possible BSODs with CPQTEAM.SYS under Windows Server 2003 for x64 SP2 or SP1 if the Scalable Networking Pack was installed. I have not yet seen an advisory so here's some information you can use right now: If teaming is being used, temporarily disable TOE support within the utility interface until a fix is released later on this month or "downrev" the NC-Series (Broadcom), embedded LOM MF NIC driver to 2.8.22.0 http://h18023.www1.hp.com/support/files/server/us/download/26385.html

[Charles Driver]

Firmware and psp are both at 7.90 already. Reboots can occur before windows even begins to load. Have also confirmed it is not a faulty dimm.

[Charles Driver]

It has started rebooting again :( No thoughts?

[Charles Driver]

One other observation - after powering it down, fiddling with bits for a while, it seems to run again for the next few days and then start with the reboots.

[AMRIT RANJAN]

Hi, Charles
if no error message is trapped in event logs amd in IML, soo kindly disable the ASR from RBSU and disable it from operating system
after disabling it hopefully you will get blue trap screen or some value in IML, on that we can diagnose the issue
if possible then share the IML logs and event logs

[Blazhev_1]

Hi,

I think that ASR disable will help and can point you to a component.

Have you made any SW/HW changes before this issue occured?

Is the room temperature ok?

If he issue occurs only during OS(and after that) loading can be driver/corrupt MBR?
You can go into RBSU and stay there for a while to see if this is temperature related.

Any LEDs? You can run Offline Insight Diagnostics with 10 Loops and check if there are any errors shown.

Regards

[Kacey Wood]

I have the same server with the exact same problem. I was wondering if you ever found a resolution for this?

I finally powered my server off as all it did was reboot itself over and over.

[Charles Driver]

Running directly off the mains resolved the rebooting issue, but the server then started faulting drives, detecting them as replaced when they hadn't been, and it was deemed time to cut losses on the thing and go to a fresh, cheaper, less powerful server... more in line with the office needs.

[Graham Weldon]

Anyone got any more comments on this?
I am running a DL380 G3 with a linux OS, and am getting very frequent reboots. Its located inside a rack at a data center, under controlled conditions, so I am confident that temperature is not an issue.
I am running two identical systems in the data center, and the other server is having no issues at all.

Any assistance at all would be appreciated.

iLO Event Log Extract
------------------------------------
12/20/2007 14:36 Server power restored.
12/20/2007 14:36 Server power removed.
12/20/2007 14:15 Server power restored.
12/20/2007 14:15 Server power removed.
12/20/2007 00:05 Server power restored.
12/20/2007 00:05 Server power removed.
12/20/2007 00:03 Server power restored.
12/20/2007 00:03 Server power removed.
12/18/2007 18:35 Server power restored.
12/18/2007 18:35 Server power removed.
12/18/2007 18:06 Server power restored.
12/18/2007 18:06 Server power removed.
12/18/2007 18:00 Server power restored.
12/18/2007 18:00 Server power removed.
12/18/2007 17:50 Server power restored.
12/18/2007 17:50 Server power removed.
12/17/2007 16:20 Server power restored.
12/17/2007 16:20 Server power removed.
12/17/2007 16:18 Server power restored.
12/17/2007 16:18 Server power removed.
12/17/2007 09:37 Server power restored.
12/17/2007 09:37 Server power removed.
12/17/2007 09:36 Server power restored.
12/17/2007 09:36 Server power removed.
12/17/2007 09:35 Server power restored.
12/17/2007 09:35 Server power removed.
12/17/2007 09:34 Server power restored.
12/17/2007 09:34 Server power removed.
------------------------------------

Cheers,
Graham

[boyley]

Thought it waqs the RAM all was well for about 4 days then rebooting happened again, and again and again.

Pulled out the discs, memory and one of the processors, including the riser card for the processor.

swapped into new machine. Machine has now been up all day, so fingers crossed.

I can now only assume either a motherboard board problem or some internal power problem.

Regards

Boyley

[Mike Frazer]

Has anyone found a resolution to this issue? I have the same model server as Charles Driver and I'm seeing the same data in the iLO event log. Nothing in windows event logs, nothing in iml, no apparent problem with UPS.

[boyley]

Hi Charles

Sorry I forgot to update the post.

You need to replace the Power Back pane, part no : 309629-001, Spare No 314670-001

(Its the module that the power supplies connect to). I obtained one from ebay for around £25.

This resolved the issue for me.

Regards

chris Boyle