RP3410 Fan States Failure

[Oktovianus]

Hi all,

I'm having a problem on the fan on RP3410 server. It's stated that fan 3 (the one in the PCI cage behind harddisks) of the system is in failure state (please see the PS below), and I had replaced the fan.
Everything run well on the booting process after the replacement was done and there's no any single failure LED indication. But when I run the PS command, it shows the same fan state where the fan 3 is still in failure condition.
This make me confuse wether there is a fan failure or not. Can anyone help me on this case?
Below is the latest PS and SL capturation. Thanx in advance.



-----------------------------------------------------------
PS
System Power state: On
Temperature : Normal

Power supplies | Fan
# State Type | States
-----------------------------------------------------------
1 Normal Type 0 | Normal
2 Normal Type 0 | Normal
3 - - | Failure
4 - - | Normal
5 - - | Normal
6 - - | Normal
7 - - | Normal
8 - - | Normal

-------------------------------------------------

Log Entry 24: 12 Aug 2009 04:19:12
Alert Level 3: Warning
Keyword: Type-02 0a0701 657153
Cooling unit warning
Logged by: Baseboard Management Controller;
Sensor: Cooling Device - Cooling 1 (Sys)
Data1: transition to Non-Critical from OK
0x204A8242C00201B0 FFFF0107110A0300

Log Entry 23: 12 Aug 2009 04:19:11
Alert Level 3: Warning
Keyword: Type-02 040601 263681
Fan speed lags
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan CPU0 (R)
Data1: Performance Lags
0x204A8242BF0201A0 FFFF0106EA040300

Log Entry 14: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 3B (Disk)
Data1: Performance Met
0x204A8242A8020100 FFFF0006EF040300

Log Entry 13: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 3F (Disk)
Data1: Performance Met
0x204A8242A80200F0 FFFF0006EE040300


Log Entry 12: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 2B (Memory)
Data1: Performance Met
0x204A8242A80200E0 FFFF0006ED040300


Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 2F (Memory)
Data1: Performance Met
0x204A8242A80200D0 FFFF0006EC040300


Log Entry 10: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan CPU1 (L)
Data1: Performance Met
0x204A8242A80200C0 FFFF0006EB040300

Log Entry 9: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan CPU0 (R)
Data1: Performance Met
0x204A8242A80200B0 FFFF0006EA040300


Log Entry 8: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 1L (Power)
Data1: Performance Met
0x204A8242A80200A0 FFFF0006E9040300

Log Entry 7: 12 Aug 2009 04:18:48
Alert Level 2: Informational
Keyword: Type-02 040600 263680
Fan Performance OK
Logged by: Baseboard Management Controller;
Sensor: Fan - Fan 1R (Power)
Data1: Performance Met
0x204A8242A8020090 FFFF0006E8040300

[Torsten.]

Your logs are showing alerts from unit 1, but ps is showing a problem with unit 3.

There are some fan related fixes in the firmware - what version do you have?

MP:CM> sysrev

see

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=2512013&swItem=pf-58098-1&prodNameId=1828449&swEnvOID=54&swLang=13&taskId=135&mode=4&idx=0

current:

MP FW : E.03.32
BMC FW : 03.52
System FW : 46.34

[Oktovianus]

Hi Torsten,

Thanks for replying. The server firmware is exactly the same as you had posted before :

MP FW : E.03.32
BMC FW : 03.52
System FW : 46.34

I'm afraid I don't need to upgrade the firmware right? Is there anything else I can do to fix the problem?

[Torsten.]

The fan pack 3 consists of 2 fans, you may consider to inspect them to see if both are turning. Maybe one of them is not turning or too slow.

[Oktovianus]

Hi Torsten,

I still can't solve this problem. I tried to check manually if the fan is running by inserting a piece of paper in it, and all of them are running normally. I also tried to clean up the server, but it made no difference at all.

Then I tried this simple ways to diagnose which fan is actually in the failure state by running the ps command after removing one of the fan.

1. without fan 1a
Power supplies | Fan
# State Type | States
-----------------------------------------------------------
1 Normal Type 0 | Failure
2 Normal Type 0 | Normal
3 - - | Failure
4 - - | Normal
5 - - | Normal
6 - - | Normal
7 - - | Normal
8 - - | Normal

2. without fan 1b
Power supplies | Fan
# State Type | States
-----------------------------------------------------------
1 Normal Type 0 | Normal
2 Normal Type 0 | Failure
3 - - | Failure
4 - - | Normal
5 - - | Normal
6 - - | Normal
7 - - | Normal
8 - - | Normal

3. without fan 2
Power supplies | Fan
# State Type | States
-----------------------------------------------------------
1 Normal Type 0 | Normal
2 Normal Type 0 | Normal
3 - - | Failure
4 - - | Normal
5 - - | Failure
6 - - | Failure
7 - - | Normal
8 - - | Normal

4. without fan 3
Power supplies | Fan
# State Type | States
-----------------------------------------------------------
1 Normal Type 0 | Normal
2 Normal Type 0 | Normal
3 - - | Failure
4 - - | Normal
5 - - | Normal
6 - - | Normal
7 - - | Failure
8 - - | Failure

And I still can't figure which fan is number 3&4 refer to.

I also try running the cfg2html and here's the result :

Cabinet 0 Hardware Inventory:
Component Slots Present Failure State
--------- ------- ------- ------- -------
Cabinet Fans (blowers) 8 8 0 NA
Cabinet Power Supplies 2 3 0 NA


Please advice..

[Torsten.]

Sometimes it is a bit confusing, but This is what I can tell you:

from "ps" list
fan 0+1 are fans 1A + 1B
fan 2+3 are CPU fans 0+1
fan 4+5 are fan pack 2
fan 6+7 are fan pack 3

So if fan 3 is failing, this is in fact CPU (on top) fan number 1.

[Oktovianus]

Hi Torsten,

Thanks for the helps. I checked the CPU 0 fan and yes, it was not running because of the connector was not connected. The problem was solved and everything is running normal.

Thanks.

[Oktovianus]

The problem was solved because the CPU 0 fan was not connected properly to the board.