rx6600 (11.23) after patch bundle... MCA occur!

[kimdy]

model: rx6600
OS: 11.23
problem:
after finished patch bundle Dec '07 (all OK.well done),
system reboot and during kenel loading.
panic!!!...MCA occur

Temporarily I did rename and use OLD backup kernel, system booting (luckily OS working.)

please, advise for this symptoms ;;

=============================================
### panic console log ###

Calling function e0000000010bd220 for Shutdown State 8 type 0x4


MCA[0]:MCA occurred!!!.
MCA[0]: lid 0x0
MCA[0]: iip 0xe0000000008db000, ipsr 0x1008220012, ifa 0x0000000000000000
MCA[0]: xip 0xe000000000f3b6e0, xpsr 0x12100842601a, xfs 0x0
MCA[0]:The processor state register value = 0x20010000fff21120
MCA[0]:Rendezvous status information GR11 = 255
MCA[0]:mca_wakeup() procs MCA'ed 0, procs rendezvous'ed 0,
procs INIT'ed 0, procs not rendezvoused 0.
MCA, IIP:0xe0000000008db000 IFA:0x0000000000000000

*** A system crash has occurred. (See the above messages for details.)
*** The system is now preparing to dump physical memory to disk, for use
*** in debugging the crash.

ERROR: Your system crashed before I/O and dump configuration was complete.
This system does not support a crash dump under these circumstances.
Contact your HP support representative for assistance.
MCA[0]: OS_MCA ends. Resetting the system.

==============================================
### MP error log ###


Log Entry 248: 01 Aug 2008 17:38:48
Alert Level 7: Fatal
Keyword: OS_CRITICAL_SHUTDOWN
OS run-time critical shutdown
Logged by: OS Software Agent;
Sensor: OS Critical Stop
Data1: Run-time Stop
0x2148934A28021460 FF0F016F00200300


Log Entry 247: 01 Aug 2008 17:38:42
Alert Level 7: Fatal
Keyword: MC_INITIATED
Machine Check initiated
Logged by: System Firmware 0
Data: Major change in system state - HPMC or MCA
0xF480009800E01440 000000000000000B


MP:SL (+,-,,D, F, L, J, H, K, T, A, U, ? for Help, Q or Ctrl-B to Quit) >



Log Entry 246: 01 Aug 2008 17:38:42
Alert Level 7: Fatal
Keyword: MACHINE_CHECK_INITIATED
Machine Check initiated
Logged by: Redundant w/ an E0 code;
Sensor: Critical Interrupt
Data2: OEM Code2: 0x00
0xC148934A22021430 003FA17000130300


===============================================
### machine check analyzer ###


Machine type selected is rx6600

------------------------------------------------------------------------------
Loading data from error log file(s).
------------------------------------------------------------------------------

Opening binary error log file(s)


------------------------------------------------------------------------------
Loading of error log data completed.
------------------------------------------------------------------------------

Earliest timestamp: 2008/08/01 18:31:21
Latest timestamp: 2008/08/01 18:31:21
Time Span: 0 day(s), 00 hour(s), 00 minute(s), 00 second(s)


------------------------------------------------------------------------------
Starting analysis
------------------------------------------------------------------------------

Problem:
CPU 0: Bus Check[0] - A hard fail response was detected in data on the front
side bus (FSB). An hard fail response is typically caused by a failure in
the I/O subsystem or the CEC. If the target address is provided it will
indicate the target of transaction that received the hard fail response.

Possible Cause:
A transaction received a hard fail response. The hard fail response could
have be caused by a I/O or CEC failure.
Possible Fix:
1. Review the target address, if provided, to determine the target of the
transaction that failed.
2. Review the analysis of the I/O subsystem for I/O failures.
3. Review the analysis of the CEC for any failures.


----- Decoding CPU 0 Bus Check[0] MOD_TARGET_IDENTIFIER ----------------------

MOD_TARGET_IDENTIFIER 0x00000000d00095b5
rope 5 LMMIO

Problem:
[4] IOC5, FE: Time-out occurred waiting for a PIO Completion message.

Possible Cause:
An Error has occurred in the I/O subsystem.
Possible Fix:
1. Review the analysis of the Rope Interface 5 for resolution of this error.
2. Review the analysis of the LBA hosted by Rope 5 for resolution of this
error.
3. Review the analysis of PCI device(s) located on slot(s) 7 or 8 for
resolution of this error.


------------------------------------------------------------------------------
Analysis completed
------------------------------------------------------------------------------

If no Problem / Cause / Fix statements are provided then the analyzer was
unable to determine the cause of the failure. In this case the user can

1: Review the trace file.
2: Re-run the analysis with Analyze All Mode.
3: Contact a HP Specialist for assistance.

=========================================
### ioscan -fnk ###


Class I H/W Path Driver S/W State H/W Type Description
=====================================================================================
root 0 root CLAIMED BUS_NEXUS
ioa 0 0 sba CLAIMED BUS_NEXUS System Bus Adapter (4030)
ba 0 0/0 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
tty 0 0/0/1/0 rmp3f01 CLAIMED INTERFACE PCI class(255,0) (103c1303)
tty 1 0/0/1/1 rmp3f01 CLAIMED INTERFACE PCI SimpleComm (103c1302)
tty 2 0/0/1/2 asio0 CLAIMED INTERFACE PCI Serial (103c1048)
/dev/diag/mux2 /dev/mux2 /dev/tty2p0
OO 0 0/0/2/0 UsbOhci CLAIMED INTERFACE USB OHCI Interface
OO 1 0/0/2/0.0 UsbMiniBus CLAIMED INTERFACE USB Composite Device
OO 2 0/0/2/0.0.0 UsbBootKeyboard CLAIMED DEVICE Virtual Keyboard
OO 3 0/0/2/0.0.1 UsbBootMouse CLAIMED DEVICE USB Boot Protocol Mouse
OO 4 0/0/2/1 UsbOhci CLAIMED INTERFACE USB OHCI Interface
OO 5 0/0/2/1.0 UsbMiniBus CLAIMED INTERFACE USB Composite Device
OO 6 0/0/2/1.0.0 UsbBulkOnlyMS CLAIMED DEVICE USB Bulk Only
ext_bus 0 0/0/2/1.0.16 UsbScsiAdaptor CLAIMED INTERFACE USB SCSI Stack Adaptor
target 0 0/0/2/1.0.16.0 tgt CLAIMED DEVICE
disk 0 0/0/2/1.0.16.0.0 sdisk CLAIMED DEVICE TEAC DV-28E-N
/dev/dsk/c0t0d0 /dev/rdsk/c0t0d0
target 1 0/0/2/1.0.16.7 tgt CLAIMED DEVICE
ctl 0 0/0/2/1.0.16.7.0 sctl CLAIMED DEVICE Initiator
/dev/rscsi/c0t7d0
OO 7 0/0/2/2 UsbEhci CLAIMED INTERFACE USB EHCI Interface
graphics 0 0/0/4/0 gvid_core CLAIMED INTERFACE PCI Display (10025159)
ba 1 0/1 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
ba 2 0/2 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
lan 0 0/2/1/0 iether CLAIMED INTERFACE HP AD331-60001 PCI/PCI-X 1000B
ase-T Adapter
ba 3 0/3 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (12ee)
fc 0 0/3/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port
PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd0
fcp 0 0/3/1/0.1 fcd_fcp CLAIMED INTERFACE FCP Domain
ext_bus 4 0/3/1/0.1.3.0.0 fcd_vbus CLAIMED INTERFACE FCP Array Interface
target 5 0/3/1/0.1.3.0.0.0 tgt CLAIMED DEVICE
ctl 3 0/3/1/0.1.3.0.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c4t0d0
disk 4 0/3/1/0.1.3.0.0.0.1 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d1 /dev/rdsk/c4t0d1
disk 6 0/3/1/0.1.3.0.0.0.2 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d2 /dev/rdsk/c4t0d2
disk 8 0/3/1/0.1.3.0.0.0.3 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d3 /dev/rdsk/c4t0d3
disk 9 0/3/1/0.1.3.0.0.0.4 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d4 /dev/rdsk/c4t0d4
disk 12 0/3/1/0.1.3.0.0.0.5 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d5 /dev/rdsk/c4t0d5
disk 14 0/3/1/0.1.3.0.0.0.6 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d6 /dev/rdsk/c4t0d6
disk 16 0/3/1/0.1.3.0.0.0.7 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c4t0d7 /dev/rdsk/c4t0d7
ext_bus 5 0/3/1/0.1.3.255.0 fcd_vbus CLAIMED INTERFACE FCP Device Interface
target 6 0/3/1/0.1.3.255.0.0 tgt CLAIMED DEVICE
ctl 5 0/3/1/0.1.3.255.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c5t0d0
ext_bus 6 0/3/1/0.1.4.0.0 fcd_vbus CLAIMED INTERFACE FCP Array Interface
target 3 0/3/1/0.1.4.0.0.0 tgt CLAIMED DEVICE
ctl 4 0/3/1/0.1.4.0.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c6t0d0
disk 5 0/3/1/0.1.4.0.0.0.1 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d1 /dev/rdsk/c6t0d1
disk 2 0/3/1/0.1.4.0.0.0.2 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d2 /dev/rdsk/c6t0d2
disk 7 0/3/1/0.1.4.0.0.0.3 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d3 /dev/rdsk/c6t0d3
disk 10 0/3/1/0.1.4.0.0.0.4 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d4 /dev/rdsk/c6t0d4
disk 11 0/3/1/0.1.4.0.0.0.5 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d5 /dev/rdsk/c6t0d5
disk 13 0/3/1/0.1.4.0.0.0.6 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d6 /dev/rdsk/c6t0d6
disk 15 0/3/1/0.1.4.0.0.0.7 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c6t0d7 /dev/rdsk/c6t0d7
ext_bus 7 0/3/1/0.1.4.255.0 fcd_vbus CLAIMED INTERFACE FCP Device Interface
target 4 0/3/1/0.1.4.255.0.0 tgt CLAIMED DEVICE
ctl 6 0/3/1/0.1.4.255.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c7t0d0
ext_bus 9 0/3/1/0.1.8.255.2 fcd_vbus CLAIMED INTERFACE FCP Device Interface
target 7 0/3/1/0.1.8.255.2.5 tgt CLAIMED DEVICE
disk 24 0/3/1/0.1.8.255.2.5.0 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d0 /dev/rdsk/c9t5d0
disk 25 0/3/1/0.1.8.255.2.5.1 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d1 /dev/rdsk/c9t5d1
disk 26 0/3/1/0.1.8.255.2.5.2 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d2 /dev/rdsk/c9t5d2
disk 27 0/3/1/0.1.8.255.2.5.3 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d3 /dev/rdsk/c9t5d3
disk 28 0/3/1/0.1.8.255.2.5.4 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d4 /dev/rdsk/c9t5d4
disk 29 0/3/1/0.1.8.255.2.5.5 sdisk CLAIMED DEVICE SILVER TN-6216S-F4D
/dev/dsk/c9t5d5 /dev/rdsk/c9t5d5
ba 4 0/4 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
escsi_ctlr 0 0/4/1/0 sasd CLAIMED INTERFACE HP PCI/PCI-X SAS MPT Adapter
/dev/sasd0
ext_bus 3 0/4/1/0.0.0 sasd_vbus CLAIMED INTERFACE SAS Device Interface
target 14 0/4/1/0.0.0.0 tgt CLAIMED DEVICE
disk 1 0/4/1/0.0.0.0.0 sdisk CLAIMED DEVICE HP IR Volume
/dev/dsk/c3t0d0 /dev/dsk/c3t0d0s3 /dev/rdsk/c3t0d0s2
/dev/dsk/c3t0d0s1 /dev/rdsk/c3t0d0 /dev/rdsk/c3t0d0s3
/dev/dsk/c3t0d0s2 /dev/rdsk/c3t0d0s1
lan 1 0/4/2/0 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000B
ase-T Dual-port Core
lan 2 0/4/2/1 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000B
ase-T Dual-port Core
ba 5 0/5 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
ext_bus 1 0/5/1/0 mpt CLAIMED INTERFACE SCSI Ultra320 A6961-60011
/dev/mpt1
target 8 0/5/1/0.7 tgt CLAIMED DEVICE
ctl 1 0/5/1/0.7.0 sctl CLAIMED DEVICE Initiator
/dev/rscsi/c1t7d0
ext_bus 2 0/5/1/1 mpt CLAIMED INTERFACE SCSI Ultra320 A6961-60011
/dev/mpt2
target 2 0/5/1/1.1 tgt CLAIMED DEVICE
tape 0 0/5/1/1.1.0 stape CLAIMED DEVICE HP C7438A
/dev/rmt/0m /dev/rmt/c2t1d0BEST /dev/rmt/c2t1d0DDS
/dev/rmt/0mb /dev/rmt/c2t1d0BESTb /dev/rmt/c2t1d0DDSb
/dev/rmt/0mn /dev/rmt/c2t1d0BESTn /dev/rmt/c2t1d0DDSn
/dev/rmt/0mnb /dev/rmt/c2t1d0BESTnb /dev/rmt/c2t1d0DDSnb
target 9 0/5/1/1.7 tgt CLAIMED DEVICE
ctl 2 0/5/1/1.7.0 sctl CLAIMED DEVICE Initiator
/dev/rscsi/c2t7d0
graphics 1 0/5/2/0 gvid_core CLAIMED INTERFACE PCI Display (10025157)
ba 6 0/6 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
lan 3 0/6/1/0 iether CLAIMED INTERFACE HP AD331-60001 PCI/PCI-X 1000B
ase-T Adapter
ba 7 0/7 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (12ee)
fc 1 0/7/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port
PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd1
fcp 1 0/7/1/0.1 fcd_fcp CLAIMED INTERFACE FCP Domain
ext_bus 10 0/7/1/0.1.3.0.0 fcd_vbus CLAIMED INTERFACE FCP Array Interface
target 12 0/7/1/0.1.3.0.0.0 tgt CLAIMED DEVICE
ctl 9 0/7/1/0.1.3.0.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c10t0d0
disk 33 0/7/1/0.1.3.0.0.0.1 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d1 /dev/rdsk/c10t0d1
disk 35 0/7/1/0.1.3.0.0.0.2 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d2 /dev/rdsk/c10t0d2
disk 37 0/7/1/0.1.3.0.0.0.3 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d3 /dev/rdsk/c10t0d3
disk 39 0/7/1/0.1.3.0.0.0.4 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d4 /dev/rdsk/c10t0d4
disk 41 0/7/1/0.1.3.0.0.0.5 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d5 /dev/rdsk/c10t0d5
disk 43 0/7/1/0.1.3.0.0.0.6 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d6 /dev/rdsk/c10t0d6
disk 45 0/7/1/0.1.3.0.0.0.7 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c10t0d7 /dev/rdsk/c10t0d7
ext_bus 11 0/7/1/0.1.3.255.0 fcd_vbus CLAIMED INTERFACE FCP Device Interface
target 13 0/7/1/0.1.3.255.0.0 tgt CLAIMED DEVICE
ctl 10 0/7/1/0.1.3.255.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c11t0d0
ext_bus 12 0/7/1/0.1.4.0.0 fcd_vbus CLAIMED INTERFACE FCP Array Interface
target 10 0/7/1/0.1.4.0.0.0 tgt CLAIMED DEVICE
ctl 7 0/7/1/0.1.4.0.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c12t0d0
disk 32 0/7/1/0.1.4.0.0.0.1 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d1 /dev/rdsk/c12t0d1
disk 34 0/7/1/0.1.4.0.0.0.2 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d2 /dev/rdsk/c12t0d2
disk 36 0/7/1/0.1.4.0.0.0.3 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d3 /dev/rdsk/c12t0d3
disk 38 0/7/1/0.1.4.0.0.0.4 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d4 /dev/rdsk/c12t0d4
disk 40 0/7/1/0.1.4.0.0.0.5 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d5 /dev/rdsk/c12t0d5
disk 42 0/7/1/0.1.4.0.0.0.6 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d6 /dev/rdsk/c12t0d6
disk 44 0/7/1/0.1.4.0.0.0.7 sdisk CLAIMED DEVICE HP HSV200
/dev/dsk/c12t0d7 /dev/rdsk/c12t0d7
ext_bus 13 0/7/1/0.1.4.255.0 fcd_vbus CLAIMED INTERFACE FCP Device Interface
target 11 0/7/1/0.1.4.255.0.0 tgt CLAIMED DEVICE
ctl 8 0/7/1/0.1.4.255.0.0.0 sctl CLAIMED DEVICE HP HSV200
/dev/rscsi/c13t0d0
processor 0 120 processor CLAIMED PROCESSOR Processor
processor 1 121 processor CLAIMED PROCESSOR Processor
processor 2 122 processor CLAIMED PROCESSOR Processor
processor 3 123 processor CLAIMED PROCESSOR Processor
processor 4 124 processor CLAIMED PROCESSOR Processor
processor 5 125 processor CLAIMED PROCESSOR Processor
processor 6 126 processor CLAIMED PROCESSOR Processor
processor 7 127 processor CLAIMED PROCESSOR Processor
ba 8 250 pdh CLAIMED BUS_NEXUS Core I/O Adapter
ipmi 0 250/0 ipmi CLAIMED INTERFACE IPMI Controller
/dev/ipmi
tty 3 250/1 asio0 CLAIMED INTERFACE Built-in RS232C
/dev/diag/mux3 /dev/mux3 /dev/tty3p0
acpi_node 0 250/2 acpi_node CLAIMED INTERFACE Acpi Hardware

[Torsten. · Accepted solution]

Try to pull out the SCSI card and the graphics card from slots 7 and 8 and try to boot.

What graphics card is it?

[Asif Sharif]

Hi Kimdy,

You need to log a HW call with HP backend support team for further analysis.

Regards,
Asif Sharif

[Sandeep_Chaudhary]

U need to log a call with HP.