Integrity Servers
cancel
Showing results for 
Search instead for 
Did you mean: 

rx2620 shuts down after 20-30 minutes.

 
SOLVED
Go to solution
rsussman
Advisor

rx2620 shuts down after 20-30 minutes.

I have an rx2630 that does a "soft" shutdown after 20 to 30 minutes. Message on the console:

rpcbind: terminated: rpcbind terminating on signal. Restart with "rpcbind -w"
Jan 30 16:14:14 /usr/sbin/envd[3275]: terminated by signal 15
shutting down machine, please wait

System event log:
Log entry 42: 30 Jan 2008 21:15:14
Alert level 7: Fatal
Keyword: Type-02 127008 1208328
System shut down or reset caused by sensor reading
Logged by: Baseboard Management Controller:
Sensor: System Event - Chassis Open
Data2: OEM Code2: Ox02
0x2047A0E8A50202B0 020EA87002120300

I thought maybe the fans were failing so I replaced them. I made sure everything was re-seated and the cover was put on correctly.

Any ideas?

Thanks...Rick
28 REPLIES 28
Tim Nelson
Honored Contributor

Re: rx2620 shuts down after 20-30 minutes.

>Sensor: System Event - Chassis Open

How about a bad/loose chassis open switch ?

Sandy Chen
Honored Contributor

Re: rx2620 shuts down after 20-30 minutes.

Hi,

Is your MP firmware is latest? If not, try to update the firmware, this usually a firmware bugs.

Regards,
Sandy
I never think of the future. It comes soon enough.
Vic006
Frequent Advisor

Re: rx2620 shuts down after 20-30 minutes.


May be you could diagonise by viewing the sensors online with the open source software ipmitool.

http://herkules.deu.hp.com/documents/scripts/ipmitool.html
Torsten.
Acclaimed Contributor

Re: rx2620 shuts down after 20-30 minutes.

"Chassis Open" may also cause a temperature problem.

Go to the MP and run

MP:CM> ps

to check the temp and fans.


BTW, the link above seems to be HP internal and not available to the internet!

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
F Verschuren
Esteemed Contributor

Re: rx2620 shuts down after 20-30 minutes.

the sensor read somting bad, normaly this is temperture,
make sure the /etc/syslog.conf is adleast:
*.info;mail.none;local2.none;local2.alert /var/adm/syslog/syslog.log
than the /var/adm/syslog/OLDsyslog will show you why it went down. (if it is a temputure problem.

If that is the cause check your airco and if that is ok it can be that some sensors are bad. ore dirty...
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Tim: Do you know where I can find the "chasis open switch". Thanks

Sandy: I will check the MP firmware when I get on site today, but I have two other rx2620s in the same rack not have the same problems. Thanks

Torsfen: I did a MP:CM>ps before I started this thread. The fans/temp where normal. Thanks

Does anyone know where the "sensors" are located on the system?

Rick
Torsten.
Acclaimed Contributor

Re: rx2620 shuts down after 20-30 minutes.

From the firmware release notes:

"...
BMC 03.48

- Extended the open chassis timeout from 5 to 30 minutes before initiating system shutdown

..."

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=447331&swItem=ux-54855-2&prodNameId=441910&swEnvOID=54&swLang=13&taskId=135&mode=4&idx=1



Now you can be sure the "open chassis" will cause the shutdown.

But unfortunately I can't remember where the sensor is. If this is a mechanical part, is must be near the top cover, if this is light sensitive sensor (like on other systems) it is anywhere in the rear area of the system board. Just in case - is there a very bright light source around?

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Torsten: I upgraded the MP, thanks for the info. Upgrading the firmware did not help.
What did you mean by a "very bright light source"?

Rick
Torsten.
Acclaimed Contributor

Re: rx2620 shuts down after 20-30 minutes.

"... if this is light sensitive sensor ..."

Sorry, I'm not sure what sensor is used there.

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Tim Nelson
Honored Contributor

Re: rx2620 shuts down after 20-30 minutes.

The only thing I see in the book is there is a statement about a safety interlock between the front panel and the power supply.

http://docs.hp.com/en/2411/rp24xx_customer.pdf
Page 161


Torsten.
Acclaimed Contributor

Re: rx2620 shuts down after 20-30 minutes.

Tim, it's an Integrity rx2620, your doc is about the HP9000 A-class, aka rp24xx.
Totally different system.

The interlock on the A-class will immediately switch off the power supply - but it's a different server ...

;-)

I have sometimes problems with names too ...

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Hi,
I have tried everything suggested in this thread, (thanks for the suggestions), but nothing seems to solve the problem.
Does anybody have any other ideas?

Rick
Grayh
Trusted Contributor

Re: rx2620 shuts down after 20-30 minutes.

Hi Rick,

This is a known issue on the rx2620/rx4640 servers.

If the BMC firmware on the server is less then 3.48, the server goes down.A system board with the minimum BMC firmware version of 3.48 (AB331-69201 or later) is the only system board that you can use in an Office Friendly rx2620 server.

The latest version of BMC is 4.27.It is recommended to upgrade to 4.27 if not already done from the following link:-

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareIndex.jsp?lang=en&cc=us&prodNameId=441910&prodTypeId=15351&prodSeriesId=447331&swLang=13&taskId=135&swEnvOID=7

If the above dosent resolve the issue send the following logs to analyse:-

/ver/tombstones/ts99
#tail -1000 /var/opt/resmon/log/event.log
#cat /etc/shutdownlog
#cat /etc/OLDshutdownlog
#tail -n 1000 /var/adm/syslog.log

And also the following from MP to analyse the issue:-
MP>SL>E>D

MP>SL>F>D

MP>CM>PS

MP>CM>DF

MP>CM>SYSREV

Regards,
Mohan
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Hi,
SYSREV gives me:
MP FW: E.03.30
BMC FW: 04.04
EFI FW: 05.48
SYSTEM FW: 04.27

PS
Eeverything is normal

I am considering re-installing the OS. I have 2 other identical 2630s in the same rack not experiencing this problem.

Thanks...Rick
Khairy
Esteemed Contributor

Re: rx2620 shuts down after 20-30 minutes.

hi,

i don't think reinstalling the OS will solve the issue as its its clearly indicate a temperature problem. Check system event log.

All integrity servers are equip with thermal logic management which constantly monitor the temperature and will initiate appropriate corrective action such as initiating system shutdown when temperature reaches critical levels. This is to avoid the server from overheating as we're all know that overheating may cause futher damages to electronic components in the system and I/O boards.

Check for current temperature where the server is located. Make sure proper ventilation is achieve if the server is rackmounted.

Rgds
Sameer_Nirmal
Honored Contributor

Re: rx2620 shuts down after 20-30 minutes.

The period of 20-30 minutes does match with the pre-defined threshold in the BMC firmware. So I would think this has to do with the chassis open sensor for sure.

This I would do to verify ( ensuring chassis cover is placed properly). Once the system is powered on , monitor MP FPL log , look for the first chassis open event and events thereafter. If there is chassis open error immediately after power on , the event log shows multiple entries until it reach the threshold and shut down the system, it would mean that the sensor is faulty and would require system board replacement. I would also take a look at the MP-CM-DF result to see if the sensor entry is listed even though it may not be a FRU.

This sensor is optical sensor. I am not sure about it's exact location it maybe around
the area between memory slots and PCI slots on the system board.
Murat SULUHAN
Honored Contributor

Re: rx2620 shuts down after 20-30 minutes.

Hi Rick

0x2047A0E8A50202B0 020EA87002120300 --> definitely sensor related problem not fan related.

You may look at OS event.log and other System Event Logs in MP. You can also open a ticket local HP support

Best Regards
Murat
Murat Suluhan
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Hi,
The 20-30 minutes was a guess. The system stays up longer than 30 minutes.

Thanks!
Grayh
Trusted Contributor

Re: rx2620 shuts down after 20-30 minutes.

Please post the following logs to analyse the issue:-

o/p of the attached script

Procedure for script execution.

Use the binary mode to transfer the files. In case you use ftp mode , Copy the script in the working directory and execute the following command.

# sh getsysinfo.sh -t

The output of this script would be 'sysinfo.tgz' in '/tmp' directory.

Could you also send us the following MP logs for each of the servers for a helthcheck :-

MP>SL>E>D

MP>SL>F>D

MP>CM>DF
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Hi,
Here is the sysinfo file...

Thanks!
rsussman
Advisor

Re: rx2620 shuts down after 20-30 minutes.

Where do you find the MP logs?

Thanks,
Rick
Torsten.
Acclaimed Contributor

Re: rx2620 shuts down after 20-30 minutes.

According to your syslog the system stays up for 30min.
As long as the system "sees" the chassis open, it will shutdown after 30min.

I'm quite sure you have a bad sensor. You will probably need to exchange the system board to resolve this.
Contact your local HP support.

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Vamsidin
Frequent Advisor

Re: rx2620 shuts down after 20-30 minutes.

Hi,

As from the logs received the issue could be with the system board(AB331-69201) or/and CPU(AB334-69003).

I do not find any futher issues with Fan/temp./memory/firmware/stm ver/BPS.

I see that you have a MP Card installed on the server.To further narrow down the issue it would be helpful to check the MP logs.

You would have a different IP address to log on to MP else you could connect a console to the server to collect these logs.

In any case you will have to log a call with HP to replace these parts(either or both) and this could be conformed from the MP logs.
Vamsidin
Frequent Advisor

Re: rx2620 shuts down after 20-30 minutes.

Additional info found from the logs---

In addition to the above you might also need to change the disk connected to the enclosure DS2100/DS2300 @ h/w path 0/5/1/0.2.0 with part number ST336607LC(A6571-69001) as this has critical write errors and will fail soon.

:)