Server is Hanging

[M.sureshkumar]

Hi All,

Last two days our server is hanging .After that i checked iostat output.Pls find the iostat output.

VVVV@root>iostat 10 5

device bps sps msps

c2t0d0 0 0.0 1.0

c2t0d0 2390 142.8 1.0

c2t0d0 1281 92.7 1.0

c2t0d0 1604 114.9 1.0

c2t0d0 975 70.5 1.0

In iostat output,bps and sps values are very high.If any problem in harddisk.

Pls guide me,how to proceed further.


Thanks&Regards,
Suresh.

[Prasanth B]

Hi,


1.Check in the /var/adm/syslog/syslog.log file to see if system is logging errors.

2. Execute dmesg and see the output.

3. Execute the following command

ioscan -fnC disk|grep NO_HW

If you see NO_HW, then there is a hardware problem.

4. If you can't see error messages execute top and see which process is chewing up resources.

5. You may do a dd on individual disk to identify intermittentl failing disks

dd if=/dev/rdsk/cxtxdx of=/dev/null bs=64k

dd will take longer time depending on the size of the disk.

-PB

[Mridul Shrivastava]

How did you notice server hang:
1. Are you able to telnet the server?
2. Are you able to ping the server?
3. Are users working on the server face hanging issue?
4. What steps you do to overcome from server hang, if any?

To confirm there is any issue with disk or not, you may collect the cstm o/p using the below mentioned command and check for the medium/ non-medium errors on this disk:

# echo "map selall info;wait infolog" | cstm > /tmp/cstm.txt

I understand this is a root disk so are we using this disk for application as well....
Please provide the answers to above questions and command output....

[M.sureshkumar]

Hi,

Telnet is not working but pinging for that server is o.k. yesterday i got this problem for two times.The MP port login only available that hanging time.

Pls find the CSTM Harddisk Output.
Product Id: ST3146807LC Vendor: HP 146 G
Device Type: SCSI Disk Firmware Rev: HPC5
Device Qualifier: HP146 Logical Unit: 0
Serial Number: 3HY71Z8Y000075066B57
Capacity (M Byte): 140014.41
Block Size: 512
Max Block Address: 286749487
Error Logs
Total Retries: 0 Buffer Overruns: N/A
Read Reverse Errors: N/A Buffer Underruns: N/A
Write Errors: 0 Non-Medium Errors: 2107
Verify Errors: 0

Thanks&Regards,
Suresh.

[Prashanth.D.S]

Hi Suresh,

I didnt find any issue with the disk mentioned above...can you check and paste the MP logs ?

MP:sl ==>e (select error log)==> dump ==> dump to screen.
MP:CM>ps

if possible attach the eventlogs and syslog from OS also.


The hang may also been caused by software also...what model is this ?

Best Regards,
Prashanth

[Mridul Shrivastava]

Hi Suresh,

I could see that ther are some non-medium errors and disk may have to be replaced, but that should not be causing server hanging problem.

I still need answers to my previous questions like:

What u did to overcome the situation?
As you said ping is working but telnet not working, did u check the inetd daemon is running or not?

Could you please reply to these so may advise you further