rx 4640 show red light

[Sakui]

I have a rx4640 which is blinking red on the system light. The OS is still running with out halting. I have checked the power supply and processor all seem to be okay. I am running HP-UX on this system.


Below are the logs i copy from the MP console.



86 OSA 2 0x21482F4352020E80 FF0F066F001F0300 Type-02 1f6f06 2060038
17 May 2008 20:42:58
185 SFW 0 0 0x148002C500E00E60 0000000000000000 BOOT_REBOOT
17 May 2008 20:37:59
184 BMC 2 0x20482F4218020E50 FFFF027000120300 Type-02 127002 1208322
17 May 2008 20:37:44
183 HPUX 2 *3 0x7F80033702E00E30 00000000000AD700 HP-UX_CRASHDUMP_STARTED
17 May 2008 20:36:30
182 HPUX 2 *5 0xBF80033802E00E10 000000000002B100 HP-UX_HEX_FAULT_CODE
17 May 2008 20:36:28
181 OSA *7 0x21482F41C7020E00 FF0F016F00200300 Type-02 206f01 2125569
17 May 2008 20:36:23
180 SFW 14 *7 0xF48000790EE00DE0 000000000000000E INIT_INITIATED
17 May 2008 20:36:19
179 SFW 12 *7 0xF48000790CE00DC0 000000000000000C INIT_INITIATED
17 May 2008 20:36:18
178 SFW 10 *7 0xF48000790AE00DA0 000000000000000A INIT_INITIATED
17 May 2008 20:36:18





7 SFW *7 0xC1482F41C2020D90 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:18
176 SFW *7 0xC1482F41C2020D80 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:18
175 SFW 8 *7 0xF480007908E00D60 0000000000000008 INIT_INITIATED
17 May 2008 20:36:18
174 SFW *7 0xC1482F41C2020D50 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:18
173 SFW *7 0xC1482F41C2020D40 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:18
172 SFW 6 *7 0xF480007906E00D20 0000000000000006 INIT_INITIATED
17 May 2008 20:36:18
171 SFW *7 0xC1482F41C1020D10 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:17
170 SFW 4 *7 0xF480007904E00CF0 0000000000000004 INIT_INITIATED
17 May 2008 20:36:17
169 SFW *7 0xC1482F41C1020CE0 003FA36F00130300 Type-02 136f03 1273603
17 May











68 SFW 0 *7 0xF480007900E00CC0 0000000000000000 INIT_INITIATED
17 May 2008 20:36:17
167 SFW *7 0xC1482F41C1020CB0 003FA36F00130300 Type-02 136f03 1273603
17 May 2008 20:36:17
166 SFW 0 2 0x448000A700E00C90 FFFFFFFF001DFF74 MEM_CORR_ERR
11 May 2008 12:40:48
165 SFW 2 0xC14826E950020C80 1A8F6070B80C0300 Type-02 0c7000 815104
11 May 2008 12:40:48
164 BMC 2 0x2048259786020C70 231F5781D7010300 Type-02 018107 98567
10 May 2008 12:39:34
163 BMC *3 0x2048257D3E020C60 23235701D7010300 Type-02 010107 65799
10 May 2008 10:47:26
162 SFW 0 2 0x448000A700E00C40 FFFFFFFF001DFF74 MEM_CORR_ERR
10 May 2008 05:40:46
161 SFW 2 0xC14825355E020C30 1A8F6070B80C0300 Type-02 0c7000 815104
10 May 2008 05:40:46
160 BMC 2 0x2048243CC1020C20 231F5781D7010300 Type-02 018107 98567
09 May 2008 12:00:01


MP:SL (+,-,,D, F, L, J, H,







50 BMC *3 0x204804C6D9020B70 23235701D7010300 Type-02 010107 65799
15 Apr 2008 15:16:41
149 BMC 2 0x2047F0E534020B60 231F5781D7010300 Type-02 018107 98567
31 Mar 2008 13:20:52
148 BMC *3 0x2047F0CB63020B50 23235701D7010300 Type-02 010107 65799
31 Mar 2008 11:30:43
147 OSA 2 0x2147DE645A020B40 FF0F066F001F0300 Type-02 1f6f06 2060038
17 Mar 2008 12:30:18
146 SFW 0 0 0x148002C500E00B20 0000000000000000 BOOT_REBOOT
17 Mar 2008 12:25:20
145 BMC 2 0x2047DE6322020B10 FFFF027000120300 Type-02 127002 1208322
17 Mar 2008 12:25:06
144 SFW 0 0 0x148002C500E00AF0 0000000000000000 BOOT_REBOOT
17 Mar 2008 12:21:51
143 BMC 2 0x2047DE6251020AE0 FFFF027000120300 Type-02 127002 1208322
17 Mar 2008 12:21:37
142 SFW 0 1 0x5480006300E00AC0 0000000000000000 BOOT_START
17 Mar




330342 HPUX 6 1 0x3F00033A06E00000 00000000000CF18F HP-UX_HEX_RUN_CODE
330341 HPUX 2 1 0x3F00033A02E00000 00000000000CF28F HP-UX_HEX_RUN_CODE
330340 HPUX 6 1 0x3F00033A06E00000 00000000000CF18F HP-UX_HEX_RUN_CODE
330339 HPUX 14 1 0x3F00033A0EE00000 00000000000CF48F HP-UX_HEX_RUN_CODE
330338 HPUX 12 1 0x3F00033A0CE00000 00000000000CF18F HP-UX_HEX_RUN_CODE
330337 HPUX 8 1 0x3F00033A08E00000 00000000000CF48F HP-UX_HEX_RUN_CODE
330336 HPUX 6 1 0x3F00033A06E00000 00000000000CF58F HP-UX_HEX_RUN_CODE
330335 HPUX 6 1 0x3F00033A06E00000 00000000000CF48F HP-UX_HEX_RUN_CODE
330334 HPUX 4 1 0x3F00033A04E00000 00000000000CF28F HP-UX_HEX_RUN_CODE
330333 HPUX 12 1 0x3F00033A0CE00000 00000000000CF38F HP-UX_HEX_RUN_CODE
330332 HPUX 6 1 0x3F00033A06E00000 00000000000CF68F HP-UX_HEX_RUN_CODE
330331 HPUX 6 1 0x3F00033A06E00000 00000000000CF28F HP-UX_HEX_RUN_CODE
330330 HPUX 10 1 0x3F00033A0AE00000 00000000000CF48F HP-UX_HEX_RUN_CODE
330329 HPUX 12 1 0x3F00033A0CE00000 00000000000CF28F HP-UX_HEX_RUN_CODE
330328 HPUX 12 1 0x3F00033A0CE00000 00000000000CF18F HP-UX_HEX_RUN_CODE
330327 HPUX 6 1 0x3F00033A06E00000 00000000000CF38F HP-UX_HEX_RUN_CODE
330326 HPUX 8 1 0x3F00033A08E00000 00000000000CF38F HP-UX_HEX_RUN_CODE
330325 HPUX 4 1 0x3F00033A04E00000 00000000000CF28F HP-UX_HEX_RUN_CODE
330324 HPUX 12 1 0x3F00033A0CE00000 00000000000CF18F HP-UX_HEX_RUN_CODE
2008 12:21:31
K, T, A, U, ? for H2008 20:36:17

[Torsten.]

Without reading all the entries - this is probably the the reason:

UX_CRASHDUMP_STARTED

from 17 May 2008 20:37:44.

You need to get this dump analyzed.

[Sakui]

How do i analyze the log from the crash dump? wht tools do i use?I saw two dump file under the /var/adm/crash.

Below are the logs from the /etc/shutdownlog

tail shutdownlog
02:52 Thu Nov 8, 2007. Halt: (by HO-IT-SV-023!root)
03:29 Thu Nov 8, 2007. Halt:
05:45 Thu Nov 8, 2007. Halt:
06:04 Thu Nov 8, 2007. Reboot:
06:19 Thu Nov 8, 2007. Halt:
14:35 Thu Nov 8, 2007. Halt:
16:44 Thu Nov 8, 2007. Reboot:
14:24 Sat Apr 26, 2008. Reboot: (by HO-IT-SV-023!oracle)
20:45 Sat May 17 2008. Reboot after panic: Bad News!

i also got the output from the /var/tombstone

cat cpumap
Running Command File (/usr/sbin/stm/ui/config/.stmrc).

-- Information --
Support Tools Manager


Version C.54.00

Product Number B4708AA

(C) Copyright Hewlett Packard Co. 1995-2006
All Rights Reserved

Use of this program is subject to the licensing restrictions described
in "Help-->On Version". HP shall not be liable for any damages resulting
from misuse or unauthorized use of this program.

cstm>select device 1
cstm>info
-- Updating Map --
Updating Map...
cstm>wait
cstm>infoLog
-- Converting a (1276) byte raw log file to text. --
Preparing the Information Tool Log for system on path system File ...

.... HO-IT-SV-023 : 10.195.1.133 ....

-- Information Tool Log for system on path system --

Log creation time: Sat May 17 20:47:47 2008

Hardware path: system


Product ID : ia64 hp server rx4640
Current Product Number : AB370B
Original Product Number : N/A
System Firmware Revision : 04.10
BMC Revision : v04.03
System Serial Number: : DEH4704JD2

System Software ID : 3465732631



For additional information about the system and the CPUs, please run
following command:

/usr/contrib/bin/machinfo



Field Replaceable Unit Identification (FRUID):
---------------------------------------------------------------------------
ID: 0x24 FRU Name: Processor 0 RAM
BOARD INFO:
Mfg Date/Time: 0
Manufacturer :
Product Name : MONT C2 16 18
S/N : PR106471ME
Part Number : AD139-04002
FRU File ID : B
---------------------------------------------------------------------------
ID: 0x25 FRU Name: Processor 1 RAM
BOARD INFO:
Mfg Date/Time: 0
Manufacturer :
Product Name : MONT C2 16 18
S/N : PR106456HJ
Part Number : AD139-04002
FRU File ID : B
-- Information Tool Log for system on path system --
View - To View the file.
Print - To Print the file.
SaveAs - To Save the file.
Enter Done, Help, Print, SaveAs, or View: [Done]
cstm>
cstm>exit
-- Exit the Support Tool Manager --
Are you sure you want to exit the Support Tool Manager?

Enter Cancel, Help, or OK: [OK] OK
#

[Dennis Handly]

>How do I analyze the log from the crash dump?
20:45 Sat May 17 2008. Reboot after panic: Bad News!

If you have a support contract, you let HP do it.

[Sakui]

I don't have support contract with HP. So how do i analyze the logs.

[Dennis Handly]

>So how do i analyze the logs.

The crashdump itself? You don't, you pay to have HP do it.

If you have kwdb in /usr/contrib, you might be able to get a stack trace and compare it to some patch. Or you should just install the latest patch bundle:
http://www11.itrc.hp.com/service/patch/releaseIndexPage.do?BC=main|
There is also swa to help you analyze your patches:
https://h20293.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=B6834AA