Unable to re-add server to OneView.

[CymruWizard]

Hello,

Looking for some help.

I have 2 x DL380 gen10 servers which have been removed from OneView as they were no longer required.

I now have to re-add them to OneView as they have been re-purposed.

However, when I try to re-add them I get the error message-

Unable to add hardware: xxx.xxx.xxx.xxx

Unable to communicate with the server hardware

Resolution: Verify your request and network connectivity and try the operation again.

I have updated the iLO 5 to the latest version v3.07, Oneview version is v9.00.00-0493574.

I have multiple servers on the same VLAN and in the same rack and I can communicate with them all and the 2 gen10 servers iLOs are reachable.

I have factory reset one of the iLOs but still have the issue. I have had new certificates created (iLO names and IPs have changed from when they were originally used). I have removed the certificates and used the generic ones that the iLO creates.

I have tried searching OneView for the original certificates of these servers but cannot find them. I have tried to add the new certificates to OneView first but that doesn't work either.

I have tried to add them as monitored and managed but still get the same error. The iLOs are configured exactly as I configured our 150 other servers and all is functioning as expected except that they will not add to OneView.

Any help or suggestions will be really appreciated.

Thanks in advance.

[rabindra11sharm]

Dear CymruWizard

Please go through the below provided links and do the needfull, it might be resolved your issue.

1.  Add a rack server for monitoring or management : https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sd00001152en_us&page=s_server-rack-task-add-cic.html

2.  Add Server Hardware in HPE OneView Video : https://www.hpe.com/h22228/video-gallery/us/en/700000804/EN/US/f52de32e-3b59-49e1-a43c-ac283f2423c4/add-server-hardware-in-hpe-oneview_demo1/video?lang=en-US

[CymruWizard]

@rabindra11sharm 

Thanks for the reply, however,  this doesn't address the issue I am having.

I can add servers to OneView and have added some new servers today. It is only these 2 servers that I cannot add to OneView.

As a test I removed and re-added other servers successfully. 

No matter what I have tried I cannot add these 2 servers back to OneView.

[rabindra11sharm]

Dear  CymruWizard

Can you please help us tyo share by error snap?? 

[thutchings]

Hello,

I do not believe the iLO's having been managed by a different OV would cause the error being seen.

Have you tried some basic connectivity tests from OV and the iLO? Within OV -> Settings -> Networking, then select Ping under the actions menu. From the iLO you can login using SSH, then issue the oemHpe_ping command to the OV IP address (do not use the OV hostname as there is no name resolution for this command).

Regards

[CymruWizard]

The iLOs are contactable, I even see OneView connecting to the iLOs in the session list when I try to add the iLOs to OneView.

I am, in fact, trying to add the iLOs back to the OV that they were removed from when the servers were decommissioned.

I believe, but happy to be proven wrong, that the issue is with OneView and not the iLOs.

[thutchings]

Hello,

There are some thing that can potentially cause problems like this (for instance disabling SNMPv3 on the target iLO), but factory resetting the iLO should clear out any issues on the iLO side that could cause this type of problem.

You may be able to get more detail regarding what is happening by selecting to add one of these servers again, then when it fails, go to the settings -> Diagnostics (view diagnostics tool page). You would then be able to see what is happening behind the scenes by looking at the cidebug log.

I suspect a case may be needed to determine what is causing this problem.

Regards

[DJMcPaz]

Has this been resolved? I'm having the same issue. I even swapped iLO IP address to rule-out firewall issue (assign a working iLO to the non-working). Same result. I can see from OneView Activity that the server Certificates gets added then it gets removed when it fails to continue to add the server.

iLO Health and other Resources are all Green from iLO console. It's happening on both iLO 4 and iLO 5 (updated firmware).

Below are the logs from OneView Diagnostics. Any help is much appreciated. Thank you!

2024-10-11 17:37:11.981 UTC,INFO ,psrm-web,FusionRetry,com.hp.ci.mgmt.fusion.client.retry.RetryAction,07f6964b-63f6-721b-d0d3-dc89ba6a3c00,addRackServerExecutor_7f96,throwIfRetryCondition():220,method: com.hp.ci.mgmt.psrm.ilo.client2.RestILOServiceClientRetryer.readBlobStore threw: ErrorMessage [errorCode=BLOB_NOT_FOUND, message=Blob not found, details=, recommendedActions=[TBD]] action: no-retry-cfe
2024-10-11 17:37:09.853 UTC,WARN ,psrm-web,psrm,com.hp.ci.mgmt.psrm.hal.hp.probe.SHalProbeRAS,07f6964b-63f6-721b-d0d3-dc89ba6a3c00,addRackServerExecutor_7f96,probe():355,The 'RedfishResources' property is missing for task [id=3285193c-0cc3-341b-a991-951070b596b4,taskState=Exception,taskStatus=Critical,percentComplete=100,messages=[[message=Starting PROBE execution.,messageArgs={PROBE},messageId=ASYNC_TASK_START,resolution=<null>,severity=OK], [message=The management processor 10.214.18.6 returned a malformed response. Failed with the error PROPERTY_NOT_FOUND. (RAS_015),messageArgs={10.214.18.6,PROPERTY_NOT_FOUND},messageId=MP_INVALID_RESPONSE,resolution=Soft-reset the management processor and retry.,severity=Critical], [message=PROBE execution complete.,messageArgs={PROBE},messageId=ASYNC_TASK_END,resolution=<null>,severity=OK]]] for enclosure = null, bay null
2024-10-11 17:37:09.853 UTC,WARN ,psrm-web,psrm,com.hp.ci.mgmt.psrm.hal.utils.RasTaskUtil,07f6964b-63f6-721b-d0d3-dc89ba6a3c00,addRackServerExecutor_7f96,handleTerminalTask():298,Task 3285193c-0cc3-341b-a991-951070b596b4 terminated [state=Exception, status=Critical, percentComplete=100, startTime=2024/10/11 17:37:05, endTime=2024/10/11 17:37:09, messages= [[message=Starting PROBE execution.,messageArgs={PROBE},messageId=ASYNC_TASK_START,resolution=<null>,severity=OK], [message=The management processor 10.214.18.6 returned a malformed response. Failed with the error PROPERTY_NOT_FOUND. (RAS_015),messageArgs={10.214.18.6,PROPERTY_NOT_FOUND},messageId=MP_INVALID_RESPONSE,resolution=Soft-reset the management processor and retry.,severity=Critical], [message=PROBE execution complete.,messageArgs={PROBE},messageId=ASYNC_TASK_END,resolution=<null>,severity=OK]]]

[CymruWizard · Accepted solution]

Hi,

Finally, after a support call to HP, numerous emails, several teams chats, and a system board replacement, none of which solved the issue, I have managed to add the 2 gen10 servers (and an old gen9 server that had the same issue) to OneView.

The issue seems to be using symbols in passwords rather than just normal alpha-numeric characters. Perhaps a mistranslation when characters are being passed to the iLO??

This is our normal procedure once the servers have been placed in a rack.

1 – Configure the iLO with a static IP address.

2 – Rename the iLO local administrator account and give it a complex password including symbols

3 – Add the iLO to OneView.

4 – Finish configuring iLO through the web interface/Ilo Remote Console.

The above has worked for all our servers so far including servers we have removed and re-added to OneView, the exception being the 2 servers (and a gen9 server) we raised this call about..

This is how I managed to get the servers to add to OneView.

1 – Reset iLO to factory settings

2 – Configure the iLO with a static IP address

3 – Add an additional local iLO user account with administrator privileges and with a simple password comprising just numbers and letters.

4 – Add the iLO to OneView.

5 – Reconfigure the local default administrator account as per our normal procedure.

6 – Remove the local iLO user account created in step 3.

7 - Finish configuring iLO through the web interface/Ilo Remote Console.

I hope this helps, please let me know if it works for you.

[DJMcPaz]

WOW! it worked!!! This will be a game changer! We have 70+ servers having this issue. Thank you so much CymruWizard!!!