HP rp3410 does not boot / init process when power on

[FlorianArg]

Hi,

Sorry for my English, i'm French.

I 've got trouble on a HP rp3440 server .

The server crashed few months ago and some materials were changed on it (including motherboard).

Now when I power on the server, i only have an access with the Management Processor where i see nothing on the live console after power on.

When I try to boot from the primary or alternative boot, from MP it failed . I also try to boot from a HP/UX dvd but it seems to not detect the dvd .

Actualy, it doesn't seem to preload/preboot something when power on ...

Do you already have this issue or any lead to help me ?

Or can i throw it and buy a new one ? 

[Bill Hassell]

When you power up the server, you should see the MP menu where you can select CO to connect to the console. Instead, type SL for the system logs.
Then F to select forward progress)
Then type A3T

This will display problems during selftest.

[FlorianArg]

Hi,

Unfortunetely, I 've got nothing on SL warning except some powersupply event when I unplug them last week.

[FlorianArg]

I cleared all the log and try a power off / power on to see only the associated  logs .

I don't see anything wrong (warning / failed / error) but I'm not an HP logs expert .

If anyone has some time to look them:

 SYSTEM EVENT

MP:SL (+,-,<CR>,D, F, L, J, H, K, T, A, U, ? for Help, Q or Ctrl-B to Quit) >D
Confirm? (Y/[N]): Y

# Location|Alert| Encoded Field | Data Field | Keyword / Timestamp
-------------------------------------------------------------------------------
0 BMC 2 0x2058A1778B020010 FFFF006F04140300 Type-02 146f00 1339136
13 Feb 2017 09:08:27
1 BMC 2 0x2058A177AE020020 FFFF006F04140300 Type-02 146f00 1339136
13 Feb 2017 09:09:02
2 BMC 2 0x2058A177AF020030 0401A37004120300 Type-02 127003 1208323
13 Feb 2017 09:09:03
3 BMC 2 0x2058A177B2020040 FFFF027000120300 Type-02 127002 1208322
13 Feb 2017 09:09:06
4 BMC 2 0x2058A177B2020050 FFFF027000120300 Type-02 127002 1208322
13 Feb 2017 09:09:06
5 BMC 2 0x2000641E2C020060 FFFF0103FDC00300 Type-02 c00301 12583681
75 days 22:35:24
6 BMC 2 0x2000641E2D020070 FFFF027000120300 Type-02 127002 1208322
75 days 22:35:25

-> This is the last entry in the selected log.

FORWARD PROGRESS 

MP:SL (+,-,<CR>,D, F, L, J, H, K, T, A, U, ? for Help, Q or Ctrl-B to Quit) >D
Confirm? (Y/[N]): Y

# Location|Alert| Encoded Field | Data Field | Keyword / Timestamp
-------------------------------------------------------------------------------
0 BMC 2 0x2058A1778B020010 FFFF006F04140300 Type-02 146f00 1339136
13 Feb 2017 09:08:27
1 BMC 2 0x2058A177AE020020 FFFF006F04140300 Type-02 146f00 1339136
13 Feb 2017 09:09:02
2 BMC 2 0x2058A177AF020030 0401A37004120300 Type-02 127003 1208323
13 Feb 2017 09:09:03
3 BMC 2 0x2058A177B2020040 FFFF027000120300 Type-02 127002 1208322
13 Feb 2017 09:09:06
4 BMC 2 0x2058A177B2020050 FFFF027000120300 Type-02 127002 1208322
13 Feb 2017 09:09:06
5 SFW 0 1 0x3400006300E00000 0000000000000000 BOOT_START
6 SFW 0 0 0x1600128000E00000 0000000000000000 BOOT_CCQUEUE_START
7 SFW 0 0 0x160012BE00E00000 0000000000000000 BOOT_INIT_CHASSIS_CODES
8 SFW 0 1 0x2100127000E00000 FFFFFFF0F0430000 NVM_RESTARTED
9 SFW 0 0 0x1600127300E00000 0000000900015C80 NVM_PARMS
10 SFW 0 0 0x0B00104B00E00000 0007B20311162317 BOOT_TIMESTAMP
11 SFW 0 0 0x1600128100E00000 0000000000000004 BOOT_CCQUEUE_END
12 SFW 0 0 0x1600104700E00000 00000000000000FE BOOT_CPUS_PRESENTL
13 BMC 2 0x2000641E2C020060 FFFF0103FDC00300 Type-02 c00301 12583681
75 days 22:35:24
14 BMC 2 0x2000641E2D020070 FFFF027000120300 Type-02 127002 1208322
75 days 22:35:25
15 SFW 0 0 0x160012BE00E00000 0000000000000000 BOOT_INIT_CHASSIS_CODES
16 SFW 0 1 0x2100127000E00000 FFFFFFF0F0430000 NVM_RESTARTED
17 SFW 0 0 0x1600127300E00000 0000000900015C80 NVM_PARMS
18 SFW 0 0 0x0B00104B00E00000 0007B2031116231A BOOT_TIMESTAMP
19 SFW 0 0 0x1600104700E00000 00000000000000FE BOOT_CPUS_PRESENTL
20 SFW 1 0 0x0000087501E00000 0000000000000001 BOOT_CPU_DECONFIG
21 SFW 0 0 0x160012BB00E00000 0000000000000000 BOOT_CPU_CACHE_FUSE_INIT
22 SFW 0 0 0x0300142C00E00000 0000000000000000 CPU_CACHE_REPAIR_ALL
23 SFW 0 0 0x0300142E00E00000 0000000000000000 CACHE_REPAIR_ALL_REPAIRS_MADE
24 SFW 0 0 0x0300142F00E00000 0000000000000000 CPU_CLEAR_ERROR_LOGS
25 SFW 0 0 0x0300143100E00000 0000000000000000 CPU_CLEAR_ERROR_LOGS_ERASED
26 SFW 0 0 0x160012BC00E00000 0000000000000000 BOOT_CPU_CACHE_TEST_INIT
27 SFW 0 0 0x160012CF00E00000 000001001E00000E MPS_CPU_WAITING
28 SFW 0 0 0x160012D000E00000 000001001E000000 MPS_CPU_WAIT_OVER
29 SFW 0 0 0x160012CA00E00000 0000000000000000 MPS_SELECT_MONARCH
30 SFW 0 0 0x160012C900E00000 0000000000000000 MPS_MONARCH_SELECTED
31 SFW 0 0 0x160012BD00E00000 0000000000641E36 BOOT_MONARCH_INIT
32 SFW 0 0 0x160012D100E00000 0000008BB2C97000 MPS_SET_SLAVE_TIMEOUT
33 SFW 0 0 0x0000108A00E00000 0000000000000000 BOOT_ROM_XSUM_TEST
34 SFW 0 0 0x1600106100E00000 0000000000000000 BOOT_ROM_XSUM_INIT
35 SFW 0 0 0x1600097C00E00000 000003000A0000FF BOOT_MONARCH_SLAVE_CHECK
36 SFW 0 0 0x160012CF00E00000 000003000A00000E MPS_CPU_WAITING
37 SFW 0 0 0x160012D000E00000 000003000A000000 MPS_CPU_WAIT_OVER
38 SFW 0 1 0x3400093900E00000 000000000004000C BOOT_INVOKE_EARLY_SELFTESTS
39 SFW 0 0 0x160012D100E00000 0000000C92A69C00 MPS_SET_SLAVE_TIMEOUT
40 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
41 SFW 0 0 0x1600097C00E00000 00001000020000FF BOOT_MONARCH_SLAVE_CHECK
42 SFW 0 0 0x160012CF00E00000 000010000200000E MPS_CPU_WAITING
43 SFW 0 0 0x160012D000E00000 0000100002000000 MPS_CPU_WAIT_OVER
44 SFW 0 0 0x160012F200E00000 0000000000000000 CPU_BUS_INIT
45 SFW 0 0 0x160012D100E00000 0000000773594000 MPS_SET_SLAVE_TIMEOUT
46 SFW 0 0 0x160012D100E00000 000000138ECA4800 MPS_SET_SLAVE_TIMEOUT
47 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
48 SFW 0 0 0x16000A8700E00000 0000000000000000 EST_START
49 SFW 0 0 0x16000CC600E00000 C0DE000000000001 CPU_API_DEBUG_INFO
...
56 SFW 0 0 0x16000CC600E00000 0C10000000000000 CPU_API_DEBUG_INFO
57 SFW 0 0 0x16000E3500E00000 0000000000000000 CPU_API_EARLY_TEST
...
73 SFW 0 0 0x16000E3500E00000 0000000000000064 CPU_API_EARLY_TEST
74 SFW 0 0 0x160012F400E00000 0000000000000000 CPU_DESCRIBE
75 SFW 0 0 0x160012F500E00000 0000000000000000 CPU_GET_ICACHE_INFO
76 SFW 0 0 0x160012F600E00000 0000000000000000 CPU_GET_DCACHE_INFO
77 SFW 0 0 0x16000A8500E00000 0000000000000000 EST_EXIT
78 SFW 0 0 0x1600097C00E00000 000021001C0000FF BOOT_MONARCH_SLAVE_CHECK
79 SFW 0 0 0x160012CF00E00000 000021001C00000E MPS_CPU_WAITING
80 SFW 0 0 0x160012D000E00000 000021001C000000 MPS_CPU_WAIT_OVER
81 SFW 0 0 0x160012D100E00000 0000000F5DE81400 MPS_SET_SLAVE_TIMEOUT
82 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
83 SFW 0 0 0x160012F700E00000 0000000000000000 CPU_INIT_AND_STAB
84 SFW 0 0 0x1600097C00E00000 000031001C0000FF BOOT_MONARCH_SLAVE_CHECK
85 SFW 0 0 0x160012CF00E00000 000031001C00000E MPS_CPU_WAITING
86 SFW 0 0 0x160012D000E00000 000031001C000000 MPS_CPU_WAIT_OVER
87 SFW 0 0 0x160012D100E00000 0000001CDEF9D800 MPS_SET_SLAVE_TIMEOUT
88 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
89 SFW 0 0 0x160012F800E00000 0000000000000000 CPU_CACHE_MONITOR
90 SFW 0 0 0x160012F900E00000 0000000000000104 CPU_ENB_MACH_CHK
91 SFW 0 0 0x1600097C00E00000 000041001C0000FF BOOT_MONARCH_SLAVE_CHECK
92 SFW 0 0 0x160012CF00E00000 000041001C00000E MPS_CPU_WAITING
93 SFW 0 0 0x160012D000E00000 000041001C000000 MPS_CPU_WAIT_OVER
94 SFW 0 1 0x2300129000E00000 0000000000000018 HALT_BOOT_BY_PDC
95 SFW 0 0 0x160012D100E00000 0000008BB2C97000 MPS_SET_SLAVE_TIMEOUT
96 SFW 0 1 0x3400093E00E00000 000000000005000C BOOT_INVOKE_MEM_DISCOVERY
97 SFW 0 1 0x370000A400E00000 0000000000000000 MEM_CONFIG
98 SFW 0 0 0x170000B100E00000 0000000000000001 MEM_DISCOVERY
99 SFW 0 0 0x000000DF00E00000 0000000000000000 MEM_RESET
100 SFW 0 0 0x000000C600E00000 0000000000000000 MEM_INIT_SCR_TABLES
101 SFW 0 0 0x1600132100E00000 000000000000010A MEM_CYCLES_PER_USEC
102 SFW 0 0 0x170000EC00E00000 0000000000000000 MEM_SPD_START
103 SFW 0 0 0x1600133900E00000 0000000000000000 MEM_NVM_VALID
104 SFW 0 0 0x160000A600E00000 0000000000000001 MEM_CONFIG_FROM_NVM
105 SFW 0 0 0x040000E300E00000 FFFFFFFF000AFF74 MEM_SPD_1G_DIMM_FOUND
....
112 SFW 0 0 0x040000E300E00000 FFFFFFFF003BFF74 MEM_SPD_1G_DIMM_FOUND
113 SFW 0 0 0x1700131700E00000 0000000000000001 MEM_SWITCH_LOCKSTEP_MODE
114 SFW 0 0 0x000000C600E00000 0000000000000000 MEM_INIT_SCR_TABLES
115 SFW 0 0 0x1600132100E00000 000000000000010A MEM_CYCLES_PER_USEC
116 SFW 0 0 0x170000EC00E00000 0000000000000000 MEM_SPD_START
117 SFW 0 0 0x1600133900E00000 0000000000000000 MEM_NVM_VALID
118 SFW 0 0 0x160000A600E00000 0000000000000001 MEM_CONFIG_FROM_NVM
119 SFW 0 0 0x040000E300E00000 FFFFFFFF000AFF74 MEM_SPD_1G_DIMM_FOUND
....
126 SFW 0 0 0x040000E300E00000 FFFFFFFF003BFF74 MEM_SPD_1G_DIMM_FOUND
127 SFW 0 0 0x1600132500E00000 0000000200000000 MEM_ACTIVE_MEMORY_SIZE
128 SFW 0 0 0x0000020500E00000 0000000000000000 MEM_LOADING_ORDER
129 SFW 0 0 0x0000132600E00000 0000000000000000 MEM_INIT_CONTROL_REGISTERS
130 SFW 0 0 0x170000B200E00000 0000000000000000 MEM_DISCOVERY_EXIT
131 SFW 0 0 0x000000C900E00000 0000000000000000 MEM_MAIN_MEM
132 SFW 0 0 0x1600132A00E00000 0000000000000002 MEM_RANKS_ACTIVE
133 SFW 0 0 0x170000C200E00000 0000000000000000 MEM_GENERATE_INTERLEAVING
134 SFW 0 0 0x1600133300E00000 200003944BF6EECC MEM_INFO_DUMP
135 SFW 0 0 0x1600133300E00000 000000480279DEDC MEM_INFO_DUMP
....
142 SFW 0 0 0x1600133300E00000 0000000000000001 MEM_INFO_DUMP
143 SFW 0 0 0x160000A800E00000 0000000200000000 MEM_DEST_TEST
144 SFW 0 0 0x160000CE00E00000 0000000200000000 MEM_MEM_TEST
145 SFW 0 0 0x010000B800E00000 0000000000000000 MEM_ECC_TEST
146 SFW 0 0 0x1600132F00E00000 0000000100000001 MEM_TEST_ACTIVE_CPUS
147 SFW 0 0 0x0100133100E00000 0000000000000000 MEM_TEST_MEMORY_RANGE_START
148 SFW 0 0 0x1600133200E00000 0000000040000000 MEM_TEST_MEMORY_RANGE_SIZE
149 SFW 0 0 0x0100133100E00000 0000004040000000 MEM_TEST_MEMORY_RANGE_START
150 SFW 0 0 0x1600133200E00000 00000000C0000000 MEM_TEST_MEMORY_RANGE_SIZE
151 SFW 0 0 0x0100133100E00000 0000000100000000 MEM_TEST_MEMORY_RANGE_START
152 SFW 0 0 0x1600133200E00000 0000000100000000 MEM_TEST_MEMORY_RANGE_SIZE
153 SFW 0 0 0x160000F600E00000 0000000200000000 MEM_TEST_WRITE
154 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
155 SFW 0 0 0x0100133000E00000 0000000000000000 MEM_TEST_TESTING_MEMORY_RANGE
156 SFW 0 0 0x0F0000F700E00000 0000000000000000 MEM_TEST_WRITE_BARGRAPH
...
163 SFW 0 0 0x0F0000F700E00000 0000000000000008 MEM_TEST_WRITE_BARGRAPH
164 SFW 0 0 0x0100133000E00000 0000004040000000 MEM_TEST_TESTING_MEMORY_RANGE
165 SFW 0 0 0x0F0000F700E00000 0000000000000000 MEM_TEST_WRITE_BARGRAPH
...
176 SFW 0 0 0x0F0000F700E00000 0000000000000009 MEM_TEST_WRITE_BARGRAPH
177 SFW 0 0 0x0100133000E00000 0000000100000000 MEM_TEST_TESTING_MEMORY_RANGE
178 SFW 0 0 0x0F0000F700E00000 0000000000000000 MEM_TEST_WRITE_BARGRAPH
....
185 SFW 0 0 0x0F0000F700E00000 0000000000000008 MEM_TEST_WRITE_BARGRAPH
186 SFW 0 0 0x1600097C00E00000 000044000C0000FF BOOT_MONARCH_SLAVE_CHECK
187 SFW 0 0 0x160012CF00E00000 000044000C00000E MPS_CPU_WAITING
188 SFW 0 0 0x160012D000E00000 000044000C000000 MPS_CPU_WAIT_OVER
189 SFW 0 0 0x160000F100E00000 0000000200000000 MEM_TEST_READ_WRITE
190 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
191 SFW 0 0 0x0100133000E00000 0000000000000000 MEM_TEST_TESTING_MEMORY_RANGE
192 SFW 0 0 0x0F0000F200E00000 0000000000000000 MEM_TEST_READ_WRITE_BARGRAPH
....
199 SFW 0 0 0x0F0000F200E00000 0000000000000008 MEM_TEST_READ_WRITE_BARGRAPH
200 SFW 0 0 0x0100133000E00000 0000004040000000 MEM_TEST_TESTING_MEMORY_RANGE
201 SFW 0 0 0x0F0000F200E00000 0000000000000000 MEM_TEST_READ_WRITE_BARGRAPH
....
212 SFW 0 0 0x0F0000F200E00000 0000000000000009 MEM_TEST_READ_WRITE_BARGRAPH
213 SFW 0 0 0x0100133000E00000 0000000100000000 MEM_TEST_TESTING_MEMORY_RANGE
214 SFW 0 0 0x0F0000F200E00000 0000000000000000 MEM_TEST_READ_WRITE_BARGRAPH
....
221 SFW 0 0 0x0F0000F200E00000 0000000000000008 MEM_TEST_READ_WRITE_BARGRAPH
222 SFW 0 0 0x1600097C00E00000 000044000C0000FF BOOT_MONARCH_SLAVE_CHECK
223 SFW 0 0 0x160012CF00E00000 000044000C00000E MPS_CPU_WAITING
224 SFW 0 0 0x160012D000E00000 000044000C000000 MPS_CPU_WAIT_OVER
225 SFW 0 0 0x160000EF00E00000 0000000200000000 MEM_TEST_READ
226 SFW 0 0 0x160012CB00E00000 0000000000000000 MPS_SLAVE_WAKEUP_ALL
227 SFW 0 0 0x0100133000E00000 0000000000000000 MEM_TEST_TESTING_MEMORY_RANGE
228 SFW 0 0 0x0F0000F000E00000 0000000000000000 MEM_TEST_READ_BARGRAPH
...
235 SFW 0 0 0x0F0000F000E00000 0000000000000008 MEM_TEST_READ_BARGRAPH
236 SFW 0 0 0x0100133000E00000 0000004040000000 MEM_TEST_TESTING_MEMORY_RANGE
237 SFW 0 0 0x0F0000F000E00000 0000000000000000 MEM_TEST_READ_BARGRAPH
...
248 SFW 0 0 0x0F0000F000E00000 0000000000000009 MEM_TEST_READ_BARGRAPH
249 SFW 0 0 0x0100133000E00000 0000000100000000 MEM_TEST_TESTING_MEMORY_RANGE
250 SFW 0 0 0x0F0000F000E00000 0000000000000000 MEM_TEST_READ_BARGRAPH
...
257 SFW 0 0 0x0F0000F000E00000 0000000000000008 MEM_TEST_READ_BARGRAPH
258 SFW 0 0 0x1600097C00E00000 000044000C0000FF BOOT_MONARCH_SLAVE_CHECK
259 SFW 0 0 0x160012CF00E00000 000044000C00000E MPS_CPU_WAITING
260 SFW 0 0 0x160012D000E00000 000044000C000000 MPS_CPU_WAIT_OVER
261 SFW 0 0 0x170000A500E00000 0000000000000000 MEM_CONFIG_EXIT
262 SFW 0 0 0x000013F900E00000 0000000000000000 BOOT_CALC_CPU_SPEED
263 SFW 0 0 0x030013FA00E00000 000000003B9AE70B BOOT_CPU_SPEED
264 SFW 0 1 0x3400093C00E00000 000000000007000C BOOT_INVOKE_IO_DISCOVERY
265 SFW 0 1 0x2400008100E00000 0000000000000040 IO_DISCOVERY_START
266 SFW 0 0 0x0400008600E00000 000000FFFF00FF83 IO_LBA_DISCOVERED
....
272 SFW 0 0 0x0400008600E00000 000000FFFF07FF83 IO_LBA_DISCOVERED
273 SFW 0 0 0x0400008700E00000 000000FFFF00FF83 IO_LBA_INIT
....
277 SFW 0 0 0x0400008700E00000 000000FFFF04FF83 IO_LBA_INIT

-> This is the last entry in the selected log.

MP:SL (+,-,<CR>,D, F, L, J, H, K, T, A, U, ? for Help, Q or Ctrl-B to Quit) >q

Thanks in advance.

[Torsten.]

This looks good so far.

What happens then?

Does it just stop?

Consider to remove any PCI card installed and check if it boots into the boot menu now.

[FlorianArg]

Nothing happen after, no log in the console log, no menu, just a black screen.

I will look for the PCI card

[FlorianArg]

It looks the same without the PCI card . Juste a black screen on the console or live event.

I 've also a green LED flashing for SYSTEM in the front panel and in MP it say "running non os code" but it can be normal .

[Torsten.]

No red or amber LEDs in the front?

The green get steady when the kernel is loaded.

>>

265 SFW 0 1 0x2400008100E00000 0000000000000040 IO_DISCOVERY_START
266 SFW 0 0 0x0400008600E00000 000000FFFF00FF83 IO_LBA_DISCOVERED
....
272 SFW 0 0 0x0400008600E00000 000000FFFF07FF83 IO_LBA_DISCOVERED
273 SFW 0 0 0x0400008700E00000 000000FFFF00FF83 IO_LBA_INIT
....
277 SFW 0 0 0x0400008700E00000 000000FFFF04FF83 IO_LBA_INIT

Did you cut some entries?

The last step you can see is init of core I/O (273) and PCI slot 1 (277) without an error.

Try to select live logs, power on the system and post all the output.

MP> sl



Event Log Viewer Menu:

       Log Name            Entries    % Full      Latest Timestamped Entry
---------------------------------------------------------------------------
   E - System Event          387        40 %     
   F - Forward Progress     4000       100 %
   B - Current Boot          299        99 %
   P - Previous Boot          12         4 %     
   C - Clear All Logs
   L - Live Events

[FlorianArg]

Hi,

Nop, only a green led flashing so i think that the kernel do not load .

The lines cut were the exact same lines . This is why i cut them.

I'm still trying to get all the event but it stay on this last event :

BOOT_INVOKE_BCH

[Torsten.]

>> The lines cut were the exact same lines . This is why i cut them.

NO, not exact the same, example::

273 SFW 0 0 0x0400008700E00000 000000FFFF00FF83 IO_LBA_INIT
....
277 SFW 0 0 0x0400008700E00000 000000FFFF04FF83 IO_LBA_INIT

 In this example each LBA (local bus adapter, this connects the PCI slots) has an own line.

>> BOOT_INVOKE_BCH

This is usually the very last line in the output, it means "starting boot console handler".

Question now is - why you don't see this menu.

I'm quite sure it is there.

How exactly do you connect to the system?

If in MP menu and you select "CO" you can't see anything?

MP:CM> ma


   MP MAIN MENU:

         CO: Console
        VFP: Virtual Front Panel
         CM: Command Menu
         CL: Console Log
         SL: Show Event Logs
        CSP: Connect to Service Processor
         SE: Enter OS Session
         HE: Main Help Menu
          X: Exit Connection

[] MP> co

You may also have a look into the console log (CL).