topic Re: iLO3 not responsiv in Server Management - Remote Server Management

iLO3 not responsiv

Ralf Gerresheim — Wed, 08 Dec 2010 09:34:45 GMT

Hi,

I have a problem with 3 DL380G7 with iLO3, FW is already 1.15:
After unplug power and reconnect power, the interface is working for some time. Then, the interface becomes unreachable via browser, while ping on IP-address is still possible.
IE and Firefox we have tested, so it is not a browser problem.

Any ideas how to get the iLO running stable?

Thanks in adavance?

Re: iLO3 not responsiv

Oscar A. Perez — Wed, 08 Dec 2010 14:43:15 GMT

We have received reports of this happening and we are investigating.
Are you running in your network a port scanner tool like Nessus, Foundstone, etc?

Re: iLO3 not responsiv

Ralf Gerresheim — Thu, 09 Dec 2010 07:29:53 GMT

No,

we are not using any port scanner.

Re: iLO3 not responsiv

Ralf Gerresheim — Thu, 09 Dec 2010 12:00:33 GMT

Sorry, correction:

Port-scanner Foundstone is used.

Re: iLO3 not responsiv

Oscar A. Perez — Thu, 09 Dec 2010 15:07:27 GMT

Interesting. The other report I'm investigating is also mentioning FoundStone.
I would suggest to configure FoundStone to skip those subnets where your iLO are residing and see if the issue goes away. This would confirm for sure FoundStone is causing iLO3 webserver to go down.

Re: iLO3 not responsiv

Dean Allendorf — Tue, 04 Jan 2011 23:09:23 GMT

Intresting. Having same issues on DL585 G7 iLO3 FW at 1.15. We are running Foundstone also.

Re: iLO3 not responsiv

Oscar A. Perez — Wed, 05 Jan 2011 16:14:06 GMT

Can you guys please confirm that iLO3 still responds to ping and that you are still able to access iLO3 from the local subnet? This is important.

Re: iLO3 not responsiv

0644hunt — Wed, 05 Jan 2011 16:23:22 GMT

The above is what is happening to me, local subnet ok and ping.

Re: iLO3 not responsiv

Dean Allendorf — Mon, 10 Jan 2011 18:28:37 GMT

I can ping the ilo from remote and local subnets but the website is not responding. Going to run a foundstone test today to see if maybe foundstone is causing this issue.

Re: iLO3 not responsiv

Dean Allendorf — Tue, 11 Jan 2011 01:34:12 GMT

We ran foundstone and it looks like it may have knocked down two of our ilo3 cards. We are going to try and isolate these card on a separate vlan that does not have foundstone running on it. Also it looks like the ilo2 cards used to have this issue also.

http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?objectID=c02629048〈=en&cc=us&taskId=101&prodSeriesId=3331044&prodTypeId=15351

Re: iLO3 not responsiv

Oscar A. Perez — Tue, 11 Jan 2011 14:28:02 GMT

Dean,

That is very interesting piece of information. About iLO2, we just released 2.05 to fix issues related to Nessus Scanner and FoundStone but, iLO3 is a completely different product with different OS and TCP/IP stack so, the fixes we just did for iLO2 TCP/IP stack won't apply to iLO3.
We will though do more research on how FoundStone could cause iLO3 to go unresponsive. So far we have been unable to duplicate the issue in our labs. We continue to work on it.

Re: iLO3 not responsiv

Dean Allendorf — Wed, 12 Jan 2011 02:40:56 GMT

We excluded the ilo3 cards from Foundstone and re-ran Foundstone. The ilo3 cards stayed up. We will keep these excluded and see if these remain stable for a few weeks. If not it must be something other than
Foundstone. I will report back our findings.

Re: iLO3 not responsiv

Dean Allendorf — Thu, 13 Jan 2011 23:16:39 GMT

iLo 3 cards are still up and running today since we removed them from Foundstone. I just found out that another data center in our company has 9 DL585 G7 servers with the same issue. They also run Foundstone. They run a different Foundstone script than ours but they found after running Foundstone the thier iLO 3 cards also became unresponsive but yet could ping them. We are feeling pretty confident this is why our iLO three cards are becoming unresponsive. So we are hoping HP can come up with a fix.

Re: iLO3 not responsiv

Oscar A. Perez — Fri, 14 Jan 2011 12:12:32 GMT

Dean,

Thanks for the info. Could you please provide the FoundStone version and scripts if possible? Thanks

Re: iLO3 not responsiv

Dean Allendorf — Fri, 14 Jan 2011 18:00:26 GMT

Foundstone Enterprise version 6.7
Getting the scripts seems to be challenging. If I can get you any further info I will send it.

Re: iLO3 not responsiv

Oscar A. Perez — Mon, 07 Feb 2011 18:10:04 GMT

We have made progress on this case. We were able to reproduce the issue in our lab using a newer version of FoundStone (McAfee Vulnerability Manager v7.00). We found and fixed a couple of bugs in the webserver that were making iLO3 to run out of sockets.

The fix will be in the next official iLO3 release. I have a beta version for those of you who would like to give it a try. Let me know.

Re: iLO3 not responsiv

Ralf Gerresheim — Tue, 08 Feb 2011 13:27:43 GMT

Hi Oscar,

please send me the fix. I will try it.

Re: iLO3 not responsiv

Oscar A. Perez — Tue, 08 Feb 2011 14:17:34 GMT

You can download the 1.17 beta firmware from the below FTP. Remember, this build is for testing purposes only. Do NOT use in production.

FTP System: ftp.usa.hp.com (15.192.32.78)
Login: tempilo3
Password: G1vmeilo (NOTE: CASE-sensitive)

FTP Access: ftp://tempilo3:G1vmeilo@ftp.usa.hp.com/
or: ftp://tempilo3:G1vmeilo@15.192.32.78/

Re: iLO3 not responsiv

William Graham — Mon, 04 Apr 2011 09:24:19 GMT

I too am having the same issue. I am using iLO3 FW 1.15 and 1.16 on HP BL460C G7 Blades. Our parent company is using FoundStone and will not disable.

I have exhausted all other avenues with HP Support.

I have tried to download Beta FW 1.17 from ftp.usa.hp.com, but the files are no longer there. Can I get a copy please?

Re: iLO3 not responsiv

William Graham — Mon, 04 Apr 2011 09:33:02 GMT

I found a link courtesy of Oscar on another thread. I was able to download 1.20 FW, mt problem is resolved.

Oscar's post below. Thankyou

OK, iLO3 1.20 does fix an issue where the webserver and SSH could become unresponsive when McAfee FoundStone scans iLO3.

You can download iLO3 1.20 from the below FTP links:

Windows Online Flash Component
ftp://ftp.hp.com/pub/softlib2/software1/sc-windows-fw-ilo/p901462262/v64721/

Windows Online Flash Component x64
ftp://ftp.hp.com/pub/softlib2/software1/sc-windows-fw-ilo/p1728391553/v64720/

Linux Online Flash Component
ftp://ftp.hp.com/pub/softlib2/software1/sc-linux-fw-ilo/p1255562964/v64722/