Error flashing NVRAM, IP reinstall DL380e Gen8, error for the Embedded Flash/SD-CARD

[Fernanmd]

Hello i need to reinstall system and configure new RAID but Intelligent provisioning dont start (black screen).

I try reinstall IP with dvd but with version 1.63 and 1.71 have the same error "Error flashing NVRAM"

I update ILO to 2.70, update bios to P73 05/24/2019 and reset NVRAM using System Maintenance Switch.

Always have the same error, looking for this problem i find this: https://support.hpe.com/hpsc/doc/public/display?docId=emr_na-c04996097
With this steeps:

Step 1) Upgrade the iLO 4 firmware to version 2.61 
Step 2) Perform a NAND format 
Step 3) Check the iLO status If the iLO status is normal, then skip to Step 6 If the iLO status is still degraded, continue to Step 4 
Step 4) Schedule downtime; AC power-cycle and repeat the NAND format 
Step 5) Check the iLO status If the iLO status is normal, continue to 
Step 6 If the iLO status is still degraded, then skip to Step 7 
Step 6) Perform these final steps if the system board does not need to be replaced: Reboot the server; reinstall IP; and refresh the server in OneView (if server is managed by OneView) 
Step 7) If steps 1-4 did not resolve the degraded iLO, replace the system board.

I perform the NAND format but have the same error "iLO 4 self-test error for the Embedded Flash/SD-CARD", and when try update IP have the same error "Error flashing NVRAM"

Any can help to fix it? or other way to create raid and install windows?

Thanks.

[Martinnn]

Hello Fernanmd,

This will require deep analysis, please open a support case on this matter.

Thanks

P.S. You can create RAID using SSA (Smart Storage Administrator) then install Windows without using IP)

[Fernanmd]

Thanks i will try it.

[JMaloughney]

Currious if this was resolved, and, if so; what was the procedure?

I have a DL380p Gen8 that i cannot seem to update the Intelligent Provisioning firmware, as it always give the "error flashing NVRAM"

[HShack]

Error flashing the NVRAM - Same error here trying to do IP Recovery Media 1.71 on a BL460c Gen8

[lixinfeng]

Same error as my MicroServer Gen8.

1. The version of Intelligent Provisioning shows "N/A" in iLO system information
2. There is an error  "Controller firmware revision 2.10.00 NAND write failure: Media is in a WRITE-PROTECTED state" for "Embedded Flash/SD-CARD" in iLO diagnostics page;
3. Intelligent Provisioning Recovery Media 1.71 failed to update with error "Error flashing the NVRAM"

I have tried clean NVRAM (Refer to https://support.hpe.com/hpesc/public/docDisplay?docId=mmr_kc-0101397) or format NAND (Refer to https://support.hpe.com/hpesc/public/docDisplay?docId=a00048622en_us), but both doesn't help.

I googled and someone said it's caused by NAND chip damaged, so maybe there is no software solution for it.

[Torsten.]

Consider to upgrade ILO firmware, if done pull the plugs, re-connect power and format the NAND. Check ILO log if this was successful. Try this multiple times if it doesn't work.

If the issue remains, you need to replace the board.

https://support.hpe.com/hpesc/public/docDisplay?docId=emr_na-a00048622en_us

[BradV]

Check your iLO security setting.  Ours are not in production.  Once I set it back to production, this error went away.

[SimonWHill]

Hi @BradV where is that setting, ive lookked in the ILO and in BIOS but cant find the setting to change to "Production"

Thanks

Simon

[BradV]

Look for Security on the left.  Click that.  Then accross the top, click on Encryption.  Under Security Settings is a drop down to select the Security State.  Your choices are Production, High Security, and FIPS.

[vidazj]

Dear Fernanmd,

  I've got the same problem with my ProLiant ML310e Gen8 v2 server. It takes just 4 full days to solve the issue. Tried everything: update firmware, boot from USB (Rufus made) , boot *.iso from ILO4 HTML remote console, format NAND at least 10 times, reconfigured maintenance switch., cut power supply and removed battery for a night.... I've got the same result: NVRAM write fails, when tried to update Intelligent Provisioning 1.5 to 1.74, or stuck with SPP.  According to self-diagnostics the server was in perfect condition.

Just one question: have you used the original HP USB Key Utility for making boot media?

  When I used Rufus or instable LAN method got the listed errors for long painful days. After I changed to the HP's utility everything worked as a dream at first attempt. Please try it! This was my last idea, gived about 0,5% to solve the issue. When the update finished successfully I felt like I won the jackpot. 

 Now I enjoy my good old server. The only significant and annoying problem is, the rear fan always working loud on 38% without load too. The only exception when I’m running Intelligent Provisioning it’s working quiet on 9%.

  I hope my impossible “adventure” (advice) will be useful for you!

Best regards,
-vidazj

[Flog738]

I was successful in getting the Intilligent Provision Update ISO on an HPE DL380 Gen9 to work by using the iLO Remote Console to attach the ISO via Virtual Media (the CD icon or the cirlce in a circle icon on the top of the iLO Remote Console window). 

Process:
1. Save the Intelligent Provision ISO somewhere on your computer.
2. Add the virtual media from the computer you are accessing the iLO from by clicking the CD icon or the cirlce in a circle icon on the top of the iLO Remote Console window, then CD/DVD, click on ISO and look for the *.iso file on your computer.
3. While the server is booting, click on F11 to select boot device. The virtual media should be listed at the bottom of the boot devices. Click on it.
3a. If the virtual media is not there, back out, and go back in.
4. Once the ISO boots, select the first option, or let the timer at the bottom of the screen time out. The Intelligent Provision Update ISO Version #.## will now proceed in updating.

Do not interupt this process. Just leave the server and computer alone until it finishes. Move the mouse if need be to keep the computer from going to sleep or the screen saver activating. The update process will take a while.

Should the update fail:
1. Power off the server
2. Pull the the power cables
3. Push the power button a few times to clear any remaining power.
4. Take off the server lid
5. Remove the system board battery
6. Pull the RAID array cache battery cable
7. Push the power button a few more times
8. Let the server sit for a few minutes.
9. After waiting, push the power button a few more times
10. Reconnect the RAID array cache battery cable
11. Insert the system board battery
12. Close the lid
13. Plug the power cables back in
14. Power on the server.
15. Log back into iLO
16. Reattach the ISO via virtual media
17. Attempt the update again.

Note: you will have to reset the date and time on the server.

[CesarRyder]

Este error lo resolvi restableciendo de fabrica la configuracion de iLo, ademas de usar la aplicacion de USB Key Utility de HPE, esto con la ISO mas reciente logre restaurar Intelligent provisioning

Google Translated: 

I solved this error by resetting the iLo configuration to factory settings, in addition to using the HPE USB Key Utility application, with the most recent ISO I managed to restore Intelligent provisioning

[markus06]

Hi, I had a similar problem when trying to reinstall IP for my HP DL380 gen10 server, the error disappeared and i could successfully install IP by first upgrading and installing the SPP package from HP to the newest version, hope this helps.