GB1000EAMYC hard drive running f/w:HPG3 blinking blue and locking up

[Jeffery_Smith]

Hello,

We have a Proliant ML330 G6 with dual GB1000EAMYC (1TB HD) running in RAID+1 configuration.  The lights have been blinking blue for a bit, but I have been unconcerned as the server was running fine.  Friday, the server locked up with an IML message "Internal SAS Enclosure Device Failure (Bay 1, Box 1, Port 1I, Slot 0)".  Other than that error, the managment page and array utility don't show a problem other than the rebuild caused by the server locking up on the above failure.  It locked again on Saturday w/o the device error listed in the IML, but with an array rebuild being required.  I figured that updating the firmware for the drives was a good idea, but they will not update.  I tried the following:

1. Downloaded cp020448.exe and tried to run it, but it reported that the required hardware isn't installed.
2. Downloaded cp016173.exe and tried to run it, but it reported that the required hardware isn't installed
3. My Array diagnostics clearly reports that I have "model: ATA GB1000EAMYC" and "f/w ver: HPG3" for both drives.

Since neither of these firmware updates work, I'm unsure how to proceed.  Is there an offline bootable version I can build a CD to run from?  Do I have to find HPG4 and HPG5 and apply those before appying HPG6?  

Thanks,

Jeff

[System_Headache]

Hello,

The following steps are recommanded:

• Update the BIOS to the latest
• Update the firmware of the controller by downloading the HP Smart Update

Since you have an ML330 G6, I have no clue which controller you are using:

• HP Smart Array P212/256 BBWC 1-ports Int/1-ports Ext PCIe x8 FIO SAS Controller 491191-B21
• HP Smart Array P410/ZM 2-ports Int PCIe x8 FIO SAS Controller 462860-B21
• HP Smart Array P410/256 BBWC 2-ports Int PCIe x8 FIO SAS Controller 491195-B21
• HP Smart Array P411/256 BBWC 2-ports Ext PCIe x8 FIO SAS Controller 491193-B21

Check the one you have and search for its drivers... there will always be an HP Smart download you burn on a CD/DVD and boot from it. It will update the firmware and should provide the stability.

[Erdogan Temur]

Hi @Jeffery_Smith

Can you upload the adu report. Then we can give the right answer.

[Jeffery_Smith]

Here is the report:

https://drive.google.com/file/d/0BwIrrlt6CO3Id0VSc2tZVkZSODg/view?usp=sharing

[Erdogan Temur]

Hi @Jeffery_Smith

Perform a general update with the Smart Update Firmware DVD 10.10.
It has hard disk firmware HPG6.

Smart Update Firmware DVD 10.10 Download Link.

[Jeffery_Smith]

Thanks for the great info,

I noticed as I was about to download it that it was coming from a Taiwan website, so I went to find it on the US HPE.COM website and can only find 10.00 instead of the 10.10 you have listed. Do you have the link for the 10.10 version on HPE's US site?

Also, I'm a bit concerned. This server is the primary storage for a small church I do work for. The unit is no longer under warranty, and while updating a flakey HDD's F/W is a reasonable risk, doing "a collection of firmware" is a bit scary.  I've never had a firmware bomb out on an HP server or HP server device, but I'm wondering how reliable are the firmware updates?  I'd like to give a reasonable risk statement to the office manager before starting the firmware updates.

Thanks,
Jeff

[Jeffery_Smith]

Nevermind on the Smart Update Firmware DVD 10.10. Despite the main link calling it 10.00, when I clicked through the description to see what it said, it lists it as 10.10.

I would still really love an answer to the reliability of the firmware updates so I can bring this option up with the office manager and make sure they are aware of any risk. If HP has documented information that woudl be awesome. If not, any insight the experts here can offer would be wonderful.

Thanks,
Jeff

[Erdogan Temur]

Hi,

You can safely do the update.It does not damage the raid.
You can download it from HPE sites if the server has a warranty
http://h20566.www2.hpe.com/hpsc/swd/public/detail?sp4ts.oid=3948601&swItemId=MTX_4372f442c3424063809e3d9198&swEnvOid=4064

[Jeffery_Smith]

I've done the updates before at other clients, but always when the server was under warranty. I'm more interested in knowing what percentage breakage there is with the HP firmware updates as this client would be in deep trouble and be unable to afford replacing the server if it was bricked.  I imagine hp has done some study of breakage when applying f/w updates... if not, has anyone here ever bricked a device or server doing the firmware updates?

Should I do the offline interactive and only apply the RAID controller?  From the readme, it sounds like in automatic mode that it will try to update every firmware on my system that is out-of-date.

Thanks,
Jeff

[Jeffery_Smith]

I'm not sure if the lack of responses means that no one has ever had a failed f/w update or if no one wants to comment on their experiences.  I explained to the office manager that there is some risk with any firmware update, but in my experience that the HP Business system f/w udpates are very stable.  I downloaded the 10.10 ISO and I've scheduled to do the work on Thursday.  I plan to let the smart firmware dvd 10.10 do whatever updates it thinks is appropriate.  "In for a penny, in for a pound, right?"  I will let you know how it goes and assign the solution assuming nothing goes horribly wrong. ;)

Thanks again for the help,

Jeff

[Jeffery_Smith]

Hi,

So I downloaded the firmware ISO, made a DVD, and applied it to my home Proliant ML110 just to make sure it boots and see the procedure.  It started, I put it in automatic mode and walked downstairs for a cup of coffee. When I came back up, it was rebooting.  Is there a way to see what it updated if anything?  My ML110 is an old G4 and it may not have had anything to update, but I'm just curious if it found anything to update.  I'll watch the production machine like a hawk and hopefully be able to tell what is updated, but I'm just curious if it found anything to update on my old home server.

Thanks,
Jeff

[Torsten.]

I prefer the interactive method because you can select/deselct components and get a result screen after the update.

However, you should find a log file anywhere at your USB device. The names and locations did change for several HPSUM versions.

[Jeffery_Smith]

So if I did it from a DVD, no report or would it have dropped it on the hard drive somewhere?

Thanks,
Jeff

[Jeffery_Smith]

So I applied the 10.10 smart firmware ISO in automatic mode and it only updated 2 things. I'm pretty sure those two things were the system ROM and the iLo firmware as I next ran it in online interactive mode and those are the two that were already up-to-date.  I never was given an option to do a firmware update to my smart array B110i SATA RAID controller and I can't find a standalone installer anywhere with an updated f/w.  I ran the PSP 9.10 on the server to see if any of the driver updates would help, but I'm in mostly the same situation as before but with updated firmware on most of server devices.

Problem:

- Lights on my hard drives are still blinking on and off Blue and the critical firmware update for these specific drives GB1000EAMYC still say that I don't have this equipment in my server.
- The "Internal SAS Enclosure Device Failure" that I got and was hoping that the firmware update for the Smart Array controller was going to mitigate is still a lurking issue. Here is the info I collected:

Logs from multiple attempts running Smart firmware Update DVD 10.10 in online mode:
https://drive.google.com/file/d/0BwIrrlt6CO3IVDJ0TTBTcjFpUEE/view?usp=sharing

Log from installing PSP 9.10:
https://drive.google.com/file/d/0BwIrrlt6CO3Idkdqa2psMHhkTHM/view?usp=sharing

Recent ADU Report:
https://drive.google.com/file/d/0BwIrrlt6CO3IOE1GTGFidDB2OGM/view?usp=sharing

Any help would be appreciated.

Thanks,
Jeff

[Jeffery_Smith]

Hi,

If this forum is moderated by HP Tech support, please take a look at this.  While there have been some excellent suggestions, the solutions provided have not resolved the issue.  If this is not moderated or monitored by HP tech support, can the other experts in this area give this a second look?  I'm at a loss for what to do.  All the docs I find say that a critical f/w update needs to be applied to these drives, but when I try to apply the update, I'm told that I don't have the hardware.  I tried the firmware smart udate 10.10 and while it updated several firmware on the server, it did not update the smart array firmware or the hard drive firmware.

Thanks,

Jeff

[Jimmy Vance]

---

@Jeffery_Smith wrote:

Hi,

If this forum is moderated by HP Tech support, please take a look at this.  While there have been some excellent suggestions, the solutions provided have not resolved the issue.  If this is not moderated or monitored by HP tech support, can the other experts in this area give this a second look?

---

While some of us who work for HPE try to monitor and assist when possible, the form community is supported by the users. If you want official HPE support you will need to open a case with HPE

The blue light on the drives is for identification, you can toggle the light on/off in the ACU/HPSSA utility

The B110i firmware is included with the system ROM firmware as this controller is embedded in the system chipset. Very dirfferent than a 'P' series hardware based RAID controller.

From what I can find, here is the latest firmware file for your drive. (HPG5 (B) )

http://h20566.www2.hpe.com/hpsc/swd/public/readIndex?sp4ts.oid=4134154&swLangOid=8&swEnvOid=4064

This component is included in the SPP date 2013.09.0

[Jeffery_Smith]

Hi Jimmy,

Thanks for the info.  I tried the f/w you posted, but got the same message as the other firmware packages I've tried:

The software will not be installed on this system because the required hardware is not present in the system or the software/firmware doesn't apply to this system.

I looked everywhere in the ACU installed on the server, 9.40.12.0 and can't find anywhere that I can turn on or off the identification blink.  Most documents I've read inidcate that they will blink if you have them selected, but they blink even while the server is rebooting.  The resources I've found that discuss this are:

https://community.hpe.com/t5/ProLiant-Servers-Netservers/DL380G5-can-I-get-the-hard-disk-light-to-blink-to-identify-a/td-p/1077399 (This seems to indicate that if you have the drive selected in ACU, that they will blink. Ours blink even if ACU is closed.)

https://h20464.www2.hp.com/Media/B029D8FF-5EF2-40DC-8F6C-4145253842DC/460cg7_fru_sasharddriveledsandledcombinations.htm (This seems to indicate that the drive is in failure / pre-failure mode.  Since the ACU is not reporting this, I'm hoping it's not relevant)

I found another document while looking into this that indicated a similar problem was fixed when f/w update was applied to the drive. When I found a critical f/w update for the drive that I know I hadn't applied, I tried to apply it, but was told it doesn't apply to my drive despite the fact that the model number is exactly what is listed for the drive, GB1000EAMYC.  When we recently had a lockup with the message about, "Internal SAS Enclosure Device Failure (Bay 1, Box 1, Port 1I, Slot 0)", I started this thread. 

This is a small church that I talked into installing a real server several years back instead of the peer-to-peer setup they had previously. They are outside of warranty for this server and if I understand correctly, HP no longer gives support unless you have support contract or warranty.  I know in the past, I was able to call HP about problems on servers that were out of warranty and they would help.  Is anything like that still available?  If so, how can I contact someone at HP about this issue?  If you can't get support outside of warranty, what would be my most cost effective way to get this resolved if the experts on the forums can't help provide an answer?

Thanks,
Jeff