kernel panic dumpfile in red hat linux 6.2 , use crash to analyse

chuiking — Wed, 07 Jan 2015 02:25:16 GMT

I have a dump file vmcore from red hat linux 6.2 .I use crash to analyse

I find there is something like "fmd_busiest_group" in bt .

I attach the command log I analyse in crash.

Anyone can suggest me how to explain and fix it.

Below is the ouput for "bt" from crash .

KERNEL: ./vmlinux
DUMPFILE: ./vmcore [PARTIAL DUMP]
CPUS: 24
DATE: Sun Jan 4 21:25:44 2015
UPTIME: 43 days, 23:51:28
LOAD AVERAGE: 0.08, 0.02, 0.01
TASKS: 945
NODENAME: avayaacr.XXXXXXX.com.hk
RELEASE: 2.6.32-220.el6.x86_64
VERSION: #1 SMP Wed Nov 9 08:03:13 EST 2011
MACHINE: x86_64 (2294 Mhz)
MEMORY: 16 GB
PANIC: ""
PID: 0
COMMAND: "swapper"
TASK: ffff8804352e0080 (1 of 24) [THREAD_INFO: ffff88043530a000]
CPU: 17
STATE: TASK_RUNNING (PANIC)

crash> bt
PID: 0 TASK: ffff8804352e0080 CPU: 17 COMMAND: "swapper"
#0 [ffff880036823900] machine_kexec at ffffffff81031fcb
#1 [ffff880036823960] crash_kexec at ffffffff810b8f72
#2 [ffff880036823a30] oops_end at ffffffff814f04b0
#3 [ffff880036823a60] die at ffffffff8100f26b
#4 [ffff880036823a90] do_trap at ffffffff814efda4
#5 [ffff880036823af0] do_divide_error at ffffffff8100cfff
#6 [ffff880036823b90] divide_error at ffffffff8100be7b
[exception RIP: find_busiest_group+1477]
RIP: ffffffff81054ad5 RSP: ffff880036823c40 RFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff880036823e64 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88003672f860 RDI: 0000000000000000
RBP: ffff880036823dd0 R8: ffff88003672fda0 R9: 0000000000000040
R10: 0000000000000001 R11: 0000000000000000 R12: 00000000ffffff01
R13: 0000000000015fc0 R14: ffffffffffffffff R15: 0000000000000000
ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018
#7 [ffff880036823dd8] rebalance_domains at ffffffff8105fc52
#8 [ffff880036823ea8] run_rebalance_domains at ffffffff81060153
#9 [ffff880036823ee8] __do_softirq at ffffffff81072161
#10 [ffff880036823f58] call_softirq at ffffffff8100c24c
#11 [ffff880036823f70] do_softirq at ffffffff8100de85
#12 [ffff880036823f90] irq_exit at ffffffff81071f45
#13 [ffff880036823fa0] smp_call_function_single_interrupt at ffffffff8102a255
#14 [ffff880036823fb0] call_function_single_interrupt at ffffffff8100bdb3
--- <IRQ stack> ---
#15 [ffff88043530bdb8] call_function_single_interrupt at ffffffff8100bdb3
[exception RIP: intel_idle+238]
RIP: ffffffff812c4a6e RSP: ffff88043530be68 RFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff88043530bed8 RCX: 0000000000000000
RDX: 0000000000001b08 RSI: 0000000000000000 RDI: 000000000069985f
RBP: ffffffff8100bdae R8: 0000000000000005 R9: 000000000000006d
R10: 000d811401194129 R11: ffff88043530be78 R12: ffff880036830f40
R13: 0000000000000000 R14: 000d81122686c740 R15: ffff880036831040
ORIG_RAX: ffffffffffffff04 CS: 0010 SS: 0018
#16 [ffff88043530bee0] cpuidle_idle_call at ffffffff813f9f67
#17 [ffff88043530bf00] cpu_idle at ffffffff81009e06
crash> log | tail -10
[<ffffffff8100bdb3>] call_function_single_interrupt+0x13/0x20
<EOI>
[<ffffffff812c4a6e>] ? intel_idle+0xde/0x170
[<ffffffff812c4a51>] ? intel_idle+0xc1/0x170
[<ffffffff813f9f67>] cpuidle_idle_call+0xa7/0x140
[<ffffffff81009e06>] cpu_idle+0xb6/0x110
[<ffffffff814e5f43>] start_secondary+0x202/0x245
Code: d0 b8 01 00 00 00 48 c1 ea 0a 48 85 d2 0f 45 c2 41 89 40 08 66 90 4c 8b 85 e0 fe ff ff 48 8b 45 a8 31 d2 41 8b 48 08 48 c1 e0 0a <48> f7 f1 48 8b 4d b0 48 89 45 a0 31 c0 48 85 c9 74 0c 48 8b 45
RIP [<ffffffff81054ad5>] find_busiest_group+0x5c5/0xb20
RSP <ffff880036823c40>

Re: kernel panic dumpfile in red hat linux 6.2 , use crash to analyse

Jason Orendorf — Wed, 22 Apr 2015 19:12:08 GMT

This looks like a known panic fixed by 2.6.32-358 (RHEL 6.4) and later.

See:

Red Hat Enterprise Linux 6 - Kernel Panic Divide by Zero at thread_group_times+86

topic Re: kernel panic dumpfile in red hat linux 6.2 , use crash to analyse in Operating System - Linux

kernel panic dumpfile in red hat linux 6.2 , use crash to analyse

Re: kernel panic dumpfile in red hat linux 6.2 , use crash to analyse