topic CPLD firmware update on composer2 in HPE Synergy

CPLD firmware update on composer2

dehpe2022 — Wed, 22 Jun 2022 08:15:17 GMT

Trying to get back dead composer2, which couldn't be powered on.

All the sympthoms are loking as described here:

https://support.hpe.com/hpesc/public/docDisplay?docId=a00121316en_us&docLocale=en_US

Current OneView version was 6.50, so i decided to update via OneView.

The appliance state displays "Not connected to standby", so i used the "Remove standby" option as suggested and then uploaded HPE_Synergy_Composer2_CPLD_Firmware_Z7550-97383.bin

Update was successful, but only on active composer. The other composer was not updated, even in activity log i can't see nothing about it.

At this moment, i have two composers, all of them has ip addresses, i can login at each of them thru ilo, but can't power on the second one. I even couldn't confirm it was updated to CPLD version 0x12(A), because it has no power.

In the maintenance console i can only see the active composer, that is already updated.

When i'm tryig to reach maintenance console of the second composer, putty, as expected, can't connect to it.

Moreover, we have two independent synergy domains, in the second domain both two composers are dead. I planned to physically move those composers to the freame of the first domain and try to update and resore it there, but until i'm figured out how to proper restore standby composer in this domain, im' stuck.

Any suggestions?

Re: CPLD firmware update on composer2

DanCernese — Tue, 21 Jun 2022 15:33:25 GMT

Running the CPLD fix ( https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_1d4a2ae5ea394f9ab843c724ca ) on the Active Composer2 should reach out to all Composer2 iLO it can talk to in the ring and should have updated anyone that matches. So moving the other two dead ones into the ring with the working active composer should also work.

The fix is supposed to RESET the dead composer2's iLO on the standby. After running again, I would reseat the formerly dead standby just in case it decides to come alive after the update (maybe the reset didn't work?)

Glad the active updated-- but if the standby did not, you'll need to engage support to figure out why. It doesn't hurt to run it again.. ..and it's good that you verified you can login to the iLO.

Re: CPLD firmware update on composer2

dehpe2022 — Tue, 21 Jun 2022 19:54:43 GMT

After removing and installing back the second composer, i have the same results i.e. NOTHING. I suppose a consequence of the fact that it couldn't power on, therefore its ILO was unable to detect actual CPLD version. Repeated update didn't help, saying 'already updated' for the first composer and even not mentioning the second one.

Comparing this issue with CPLD problem on the computing units itselves, i've tried to update CPLD through ILO. After some searching i've downloaded firmware-synergy_composer2_cpld-12-1.1.x86_64.rpm and planned to use it, but..... Firmware update page is unavailable, saying somthing like insufficient rights. 'iloadm' user (created by me in OneView) doesn't have it. Besides my user i've got 'administrator' and '_OneViewAdmin' but i have no passwords for them.

Computing unit CPLD issue was resolved by resetting ILO, which, as i remember, helps with power-on and subsequently firmware update. But in my case i can't reset composer ilo due to insufficient rights. Anyway, after removing composer from slot and putting it back in, ilo was resetted, isn't it?

Or, alternatively, i've uploadeded .rpm and .compsig to repository, created custom SPP but how to apply SPP to composer? Is it possible?

At this moment i can't engage support, so i have to resolve this issue by myself, so i'm searching any ideas that would help

Re: CPLD firmware update on composer2

DanCernese — Tue, 21 Jun 2022 20:00:11 GMT

Try as you might, there is no alternative path. Only the methods documented in the advisory will work. There are no others.

Re: CPLD firmware update on composer2

dehpe2022 — Tue, 21 Jun 2022 20:11:44 GMT

OK, tomorrow i will try to remove dead composer from the second domain and put it in this system with operating appliance. Hope something changes and second composer will be updated

Re: CPLD firmware update on composer2

DanCernese — Tue, 21 Jun 2022 21:06:55 GMT

Don't forget there is also the local USB method if the maintenance console responds and you can login.

Re: CPLD firmware update on composer2

dehpe2022 — Wed, 22 Jun 2022 18:18:15 GMT

Results of the day:

Another dead composer moved to this frame can't power on.

CPLD update through OneView didn't update this composer either.

Just for fun, i've placed two dead composers in second frame (working composer are situated in the first frame),

assigned completely new IP addresses for both of them and started update with HPE_Synergy_Composer2_CPLD_Firmware_Z7550-97383.bin again. For the active composer it says 'already applied' for the rest two of them nothing jappens. Absolutely. As far as i remember, one of them flashed green by Power LED for half a minute, which i suppose was power cycling or ILO reset, and no sign of life again.

I suppose, the main problem is inability to power on to help ILO determine current version of CPLD firmware. Maybe because e-fuse is stuck in off position.

Next try will be resetting of e-fuse with oneview console, or clear composer NVRAM with dip switches inside it (but comparing with proliant, it has two block of switches and i'm not sure that the second 12-switch panel is the same as in DL servers)

BTW, all dead composers are still easily accessible via ILO

Re: CPLD firmware update on composer2

DanCernese — Wed, 22 Jun 2022 19:09:05 GMT

Do NOT play with the Composer's switches. If you clear NVRAM, you will not be able to reimage them among other things.. ..and they may never boot again without support help. [edit] It may even completely forget what kind of appliance it is.

Re: CPLD firmware update on composer2

DanCernese — Wed, 22 Jun 2022 19:12:49 GMT

Is there anything interesting in the log file found from

Settings > Appliance => Actions => Download fixme installation details

Can you download an AHS log from one of the dead composers, maybe the one that flashed the power LED?

Re: CPLD firmware update on composer2

CSKA — Mon, 19 Sep 2022 18:50:19 GMT

Hi,

Any updates on this topic, it will be intereted for us, did you resolve the issue?
I've checked some shell scripts inside the firmware bin file, and seems that getting the current level of CPLD firmware is prerequisite in order to continue with main part of the upgrade process. Another prerequisites are getting ILO IP and credentials, but seems they are valid in your case.