ML380 G5 Crashes - Server 2003R2 Std x64

[mike24]

I have a new server that keeps crashing on a daily basis though not at the same time. I have the latest drivers and firmware. I have been working with HP techs but they say to call Microsoft. Has anyone had any similar problems/fixes?

12GB RAM
SmartArray P400

IML:
An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000)

[Vulcan Maximus]

Hi Mike,

Most likely cause for these errors is hardware.Especially, focusing more on scsi part.so, firmware plays an important role.Please make sure the server is running latest Firmware revision for the existing hardware as well as for OS.I mean Proliant support packs(Although you have mentioned update has been done).

Secondly, Make sure the OS hotfixes are installed.Look for any event ID's in the eventviewer related to this.

Regards,
Maximus

[KarloChacon]

mike

can you tell us your troubleshooting done
so we don't waste about time repeating the things HP already has done

like parts replaced? if any?
or any other thing?

exact blue screen?
Dump file?

bye

[KarloChacon]

i forgot server configuration?

how many procs, memories, attached devices?
when does server crash? doing something special?

more info more easy to help

[mike24]

Hello I had the motherboard replaced but it crashed again. Then I realized that the firmware on the new motherboard was probably old, so I updated it. The server was then stable for over two weeks so going from crashes every day to two weeks I thought I was in for gold...

Then during a backup job I got another BSOD
Blue Screen Trap (BugCheck, STOP: 0x000000D1 (0xFFFFFADEA5F5F3A8, 0x0000000000000007, 0x0000000000000001, 0xFFFFFADEC219BA63))

I was able to finally get what looked like a good memory dump and called Microsoft so they can analyze. They told me that the dump didn't work but they wanted me to update the storport.sys file. I had storport.sys version 5.2.3790.4021 and upgraded to storport.sys version 5.2.3790.4156.

I then went to update exchange 2007 with update rollup 6 when it BSOD again with An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000)

I am now going to enable Special Pool per Microsoft's request to get a good dump file.

[Nicholas Schmietenknop]

I'm very intrested to find out if you have been able to resolve this issue. We have been experienceing similar issues. all around approx around the same time of day.

1 An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 2/24/2009 12:24AM 2/24/2009 12:24AM 1
2 An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 2/17/2009 12:16AM 2/17/2009 12:16AM 1
An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 1/27/2009 10:46AM 1/27/2009 10:46AM 1

[mike24]

You know I have not found a solution yet and I am about to get a new server.

In this last blue screen I got Microsoft is asking me to update the PCIIDE.sys and PCIIDEX.sys drivers.

This is what Microsoft found on the memory dump analysis:

SUMMARY: Appears to be pool corruption, in looking what was happening just before we bug check, we where fist populating the buffer to RETURN_SMART_STATUS on the IDE drive then called atapi!IdePortNotification to request a DPC at the completion of an Interrupt.

PCIIDE.sys appears a bit out dated i.e. dated March 2005 vs PCIIDEX.sys is dated 2007, this may be a mismatch (note: these where found in the list Device objects under atapi.

At the same time there is one stuck IRP for HPCISSs2 - but this driver is dated 2009

I'm going to do as Microsoft has requested and crossing my fingers. I have already updated the storport.sys driver to version 5.2.3790.4156 from 5.2.3790.4021. I have replaced the motherboard and memory.

[mike24]

I have seen more reboots since updating the storport.sys driver. I'm having HP send another server on RMA. If anyone else has a fix I would love to hear about it.

An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 2/26/2009 2:11AM 2/26/2009 2:11AM 1
2 An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 2/25/2009 6:56AM 2/25/2009 6:56AM 1
3 An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000) 2/23/2009 9:03PM 2/23/2009 9:03PM

[GScala]

I have a DL360 G5 with a SmartArray P400i and 12 GB RAM and have been experiencing the same ASR reboots about once a week. I read this entire post, so I updated the firmware, drivers and updates, but a week later, it rebooted with the same
IML:
An Unrecoverable System Error has occurred (Error code 0x0000002D, 0x00000000)
Mike, have you resolved this problem and if so, could you be kind enough to share your resolution? It's very frustrating. Thank you.

Regards,

Gerald Scala

[mike24]

Unfortunately I never found a solution from HP or Microsoft. I spoke to some coworkers and they said that once they downgraded drivers to PSP version 8 (overwriting newer drivers) to fix a similar problem but I never had the chance to try that. I ended up getting a whole new server from HP. This was the most frustrating HP server problem I ever ran into.

I used the same windows server media to do the new server installation. The replacement server came with the smartstart cd version 8.15. When I built the bad server, I went and downloaded the latest firmware, smartstart and psp from HP's site as the smarstart CD it came with was version 8 I believe. This time I just used what came with the server (Smartstart 8.15).

I still have the bad server running and will be sending it back to HP late this week but it still keeps on rebooting from what I can see in the IML. Bad batch of servers????

[GScala]

Thank you Mike, I appreciate it.

Regards,

Gerald

[Andrés Zuccarino]

I just had exactly same issue and same error logged.
Hardware is ProLiant BL480c G1 with P400 SAS controllers.
From beginning of the year 2008 that persists this problem, HP changed the motherboard, RAM, also they applied all the updates of firmware and drivers, someone could solve it?
Pardon for my English.

Regards,
Andrew.

[TarunJain]

Hi,
It should be a hardware failure for sure.
You must have tried some of following steps but just in case you haven't.

1. Have you tried checking system on minimum configuration?
2. Which PCI-e and PCI-X devices are installed in this server? Try removing them.
3. Disable the ASR (for testing only)
4. RUN offline diagnostics via Smart Start CD.
## Offline diagnostics will take more than hour depending on the loops and number of hard drives, This will check all the hardware components. It is also helpful to determine if the issue could be reproduced without OS

Following thread also discusses the similar issue:
[Expired Broken link removed on <4/20/2017> by Mod]