3PAR SP in unresponsive UI state

[adamdb_uk]

Hi,

     I've got a 3PAR SP which began sending out notifications yesterday complaining about connection issues to HPE. This does happen from time to time so I didn't look into it. Then later in the day it began sending emails about not being able to connect to the storage system it's connected to, So I decided to check it over. It appears to be an OS resource issue from the UI. Lots of 500 Internal Server error messages back.

I ssh'ed into the service menu as admin and attempted to reboot the server however the reboot did not happen. It did however redner the web UI completely offline so my guess is the system is basically out of resources (most likely due to a memory leak in some code) and can't fork any more processes to inititate a reboot.

To be safe I opened a case with HPE last night to check on any steps I could take for recovery. I do have access to the ILO so i COULD just issue a reset from there and see if it comes back. My only concern with doing that is filesystem corruption. I am hoping these appliances will run fsck in that event on reboot anyhow but I have not attempted this yet as i was waitng on support.

However as of now although the case has been picked up as 'degraded down' call and assigned to an engineer I've had zero emails or updates from the assigned resource. In the meantime this means that if anything does occur on the storage system it won't be picked up.

I would have expected it have received something by now in regard to an action plan but alas despite approaching 24 hours since the call was logged.... nothing.

So figured I'd ask here about the risk of just 'resetting' from the ILO. I'm guessing it's low but wanted to check before attempting in case there is other mitigation i can take.

But really this length of time for response is not great. I've asked for a case update twice today (at 8am and 12pm) so it's not like they don't know I would like a response.

Hoping someone out there can confirm an ILO 'reset' is pretty safe to execute.,

thanks

Ad

[sbhat09]

Hello @adamdb_uk,

What is the version of 3PAR OS and SP OS?

Regards,
Srinivas Bhat

If you feel this was helpful please click the KUDOS! thumb below!
Note: All of my comments are my own and are not any official representation of HPE.

[adamdb_uk]

Hi

SP Version : 5.1.0.1-29281

OS Version : 3.3.1.648 (MU5)+P126,P132,P135,P140,P146,P150,P151,P155,P156,P170,P172,P173,P175,P177

And still no response from HPE support...

I think I'm going to just reset the server from the ILO if I don't hear anything from support.. and hope it recovers.

[adamdb_uk · Accepted solution]

Just  a follow up. Someone from HPE finally got back to me and then remoted on and was able to restore the SP after clearing out some files and performing a service restart.

[sbhat09]

Hello @adamdb_uk 

That is great to know. Thanks for the update.!

Regards,
Srinivas Bhat

If you feel this was helpful please click the KUDOS! thumb below!
Note: All of my comments are my own and are not any official representation of HPE.