1748249 Members
3365 Online
108760 Solutions
New Discussion

Re: Kernel Panic

 
Naj
Valued Contributor

Kernel Panic

Hi Expert,

 

Sometime it's difficult to investigate the root cause when receiving error kernel panic. What we did is reboot the server and it back to normal. However, would you share with me is there has any away to trace back/any script execute to translate the error  why/what is going on.

Rebooted the server for several times without knowing the root caused is very bad and would be trouble to server for long term,

 

Thanks in advanced

 

BR

Naj


____________________________________________
:: Really appreciate if you could assign some points.
:: Don't know how to assign point? Click the KUDOS! star!
6 REPLIES 6
Steven E. Protter
Exalted Contributor

Re: Kernel Panic

Shalom,

 

cd /etc/rc.config.d

crashconf
savecrash

See where there are crash files and if they are configured. Check the locations. There should be a fair number of files that can be tarred up, sent to HP support and analyzed for root casue Analysis.

 

Please post:

crashconf -v

 

SEP

 

Steven E Protter
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com
Alzhy
Honored Contributor

Re: Kernel Panic

Greetings and Salam!

 

So your crashes and "hungs" can be captured for analysis by the vendor, you need to set up your OS properly to capture kernel dump so you can force it to dump kernel or a panic will capture the dump.

 

First thing is you must have a crashkernel line configured (/boot/grub/menu.lst):

 

title Red Hat Enterprise Linux Server (2.6.18-194.32.1.el5)
        root (hd0,0)
        kernel /vmlinuz-2.6.18-194.32.1.el5 ro root=/dev/vg00/root fastboot crashkernel=512M@16M elevator=deadline
        initrd /initrd-2.6.18-194.32.1.el5.img

 

2nd, you must set up /etc/kdump.conf properly to suite your environment. Mine is set up as follows:

 

#ext3 LABEL=/crash

net netapp01.xyz.com:/crash/linux
core_collector makedumpfile -d 31 -c

 

 

Enjoy.!


 

Hakuna Matata.
Alzhy
Honored Contributor

Re: Kernel Panic

Seriously?
Ain't the above for HPay-UX good sir?
Hakuna Matata.
Alzhy
Honored Contributor

Re: Kernel Panic

I almost forgot, once you have the above set up - whenever your OS panics - it should generate a kernel dump at the location you specified.

 

If your Servr is behaving badly or seem to be "hung" - You can FORCE your server to generate a crash dump by invoking:

 

SysRQ+c

 

It may also help to do several SysRQ+t before doing SysRQ+c so the crash log/dump/etc will capture the various threads running while yor OS is having issues or is "hung"...

 

 

Cheers and hope this helps.

 

Hakuna Matata.
Alzhy
Honored Contributor

Re: Kernel Panic

This is important additional information. I just recalled, for SysRQ+t or +c to work, you must set your kernel parm kernel.sysrq = 1 (enable). You can do this by adding or editing the kernel.sysrq line in /etc/sysctl.conf  and comitting the change by doing " sysctl -p".

 

Your SysRQ+c or +t or whatever SysrQ combo should now work.

 

 

Note SysRQ means ALT+SysRq keys. Most virtual consoles of todays X86 servers feature the shortcut already. If you have a physical console -- then its the ALT+SysRQ+c (or t) combination.

 

Hope this helps.

 

Hakuna Matata.
Steven E. Protter
Exalted Contributor

Re: Kernel Panic

Shalom again,

Was this case in the HP section before? My earlier response made no sense. It was the prefect response to an HP-UX crash.

Is kdump configured? Whats in it? I think you should have a kdump server to accommodate the entire crash.

SEP
Steven E Protter
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com