Error messages at syslog.log related to external disk

[yulianto piyut]

all,

Many error messages in my server running hp-ux 11.31 related to writing to disk. I have configured NetApp lun and server use 2 HBA controller connected to two SAN switch.

Feb 10 17:41:46 mrsapdb2 vmunix: Asynchronous write failed on LUN (dev=0x1f044100)
Feb 10 17:41:47 mrsapdb2 above message repeats 6 times
Feb 10 17:41:46 mrsapdb2 vmunix: Asynchronous write failed on LUN (dev=0x300002a)
Feb 10 17:41:46 mrsapdb2 vmunix: IO details : blkno : 4065088, sector no : 8130176
Feb 10 17:41:46 mrsapdb2 vmunix: class : lunpath, instance 70
Feb 10 17:41:46 mrsapdb2 vmunix: Asynchronous write failed on LUN (dev=0x1f044100)
Feb 10 17:41:46 mrsapdb2 vmunix: IO details : blkno : 3716288, sector no : 7432576
Feb 10 17:41:46 mrsapdb2 vmunix: class : lunpath, instance 71
Feb 10 17:41:46 mrsapdb2 vmunix: Asynchronous write failed on LUN (dev=0x300002a)
Feb 10 17:41:46 mrsapdb2 vmunix: IO details : blkno : 4103840, sector no : 8207680

# # ll /dev/*disk |grep 002a
brw-r----- 1 bin sys 3 0x00002a Feb 5 21:24 disk71
crw-r----- 1 bin sys 23 0x00002a Feb 10 14:49 disk71
# ll /dev/*dsk |grep 044100
brw-r----- 1 bin sys 31 0x044100 Feb 5 21:24 c4t4d1
crw-r----- 1 bin sys 188 0x044100 Feb 10 16:43 c4t4d1
# strings /etc/lvmtab
/dev/vg00
/dev/disk/disk1_p2
/dev/vgrepx
/dev/dsk/c6t0d1
/dev/dsk/c4t0d1
/dev/dsk/c6t0d2
/dev/dsk/c4t0d2
/dev/dsk/c6t0d3
/dev/dsk/c4t0d3
/dev/vgtest
/dev/disk/disk71
/dev/vgtest1
/dev/dsk/c4t4d1
/dev/dsk/c6t4d1

[Steven E. Protter]

Shalom,

A disruption of the SAN or temporary disconnect of the fiber, or an actual disk problem within the presented LUN can cause these results.

run a read test with dd.

I believe the disk is still present on your system.

SEP

[yulianto piyut]

steven,

you are correct, the lun still presented in system. I have tried to copy data to this disk and ran well.

[Avinash20]

Please refer to
http://docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad_WP.pdf

Refer to page-09

You need to log a H/W call to confirm if the disk is Ok

Run dd, diskinfo, check event.log and confirm the same

[yulianto piyut]

dd is OK and writing to these disk is OK. how ?

[Hakki Aydin Ucar]

even though I am not familiar to 11iv3 environment I recommend to run this script:

#!/usr/bin/sh
host=$(hostname)
strt=$(/usr/sbin/ioscan -fnC disk |awk '{ if ($3 != "") printf ("%s",$0) ; else
printf ("%s\n",$0)}' |grep -v DVD-ROM | grep -v Class | awk '/dsk/{print $9}')
echo $strt > /tmp/sil.$$
clear
echo $host ............................................................
for i in $(cat /tmp/sil.$$)
do
echo $i:
echo 2400?20X | adb $i
pvdisplay -v $i |grep stale
sleep 1
done
/usr/bin/rm /tmp/sil.$$

Command output should be as follows (if there are no disk errors).

2400: 44454645 43543031 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0

Those counters indicate of BBDIR that stands for BadBlockDirectory any Bad Sector occurs in any disk , these numbers will be registered into these counters;
So, any non zero numbers indicate bad blocks and that disk should be changed on the spot !
->
Another option would be to try a dd read from both drives, but that could take some time. Any blocksize less than 32k will run very slowly.
I think you'll find 64k to 512k significantly faster.

# dd if=/dev/dsk/cxtydz of=/dev/null bs=256k
->

[Ganesan R]

Hi,

The message indicates that the write I/O to the disks (0x1f044100 and 0x300002a) at the time of Feb 10 17:41:46 to Feb 10 17:41:46 has failed. It may be because of fibre disconnection, san switch, san network or even HBA issue or disk itself having issue.

My questions is that, are you getting the errors still? If you got those errors only during specific period, then it could be temperory fibre disturbtion. If you are still getting errors, then there is some issue either of the one specified above.

If you have alternate links for those disks, you can stop the i/o to those disks using pvchange command and investigate.

[Roman Gudz]

We are getting similar errors on our HP-UX 11.31 servers. We have engaged HP/Veritas/EMC in an attempt to determine what the problem is.

Here are the messages we get:

Feb 9 15:18:53 serv109a vmunix: class : lunpath, instance 116
Feb 9 15:18:53 serv109a vmunix: Asynchronous write failed on LUN (dev=0x3000022)
Feb 9 15:18:53 serv109a vmunix: IO details : blkno : 65465624, sector no : 130931248
Feb 9 15:18:53 serv109a vmunix:
Feb 9 15:18:53 serv109a vmunix: class : lunpath, instance 116
Feb 9 15:19:16 serv109a above message repeats 2 times
Feb 9 15:18:53 serv109a vmunix: Asynchronous write failed on LUN (dev=0x3000022)
Feb 9 15:21:13 serv109a above message repeats 2 times
Feb 9 15:21:13 serv109a vmunix: class : lunpath, instance 119
Feb 9 15:18:53 serv109a vmunix: IO details : blkno : 65465624, sector no : 130931248
Feb 9 15:21:13 serv109a above message repeats 2 times
Feb 9 15:21:13 serv109a vmunix: Asynchronous write failed on LUN (dev=0x3000025)
Feb 9 15:18:53 serv109a vmunix:
Feb 9 15:21:13 serv109a above message repeats 2 times
Feb 9 15:21:13 serv109a vmunix: IO details : blkno : 17358344, sector no : 34716688
Feb 9 15:21:13 serv109a vmunix:
Feb 9 15:29:19 serv109a vmunix: WARNING: VxVM vxio V-5-0-2 Subdisk tmusprd01dg02-02 block 8861872: Uncorrectable write error
Feb 9 15:29:19 serv109a vmunix: vxfs: WARNING: msgcnt 1 mesg 038: V-2-38: vx_dataioerr - /dev/vx/dsk/tmusprd01dg/tmusprd05vol file system file data write error in dev/block 0/4430934
Feb 9 15:29:19 serv109a vmunix: Synchronous Page I/O error occurred while paging to/from disk
Feb 9 15:29:19 serv109a vmunix: device 0x0463c6f9, 1K block #35447472, 57344 bytes of 57344 bytes not paged, page addr =dead31.e000000423d00000, bflag =45008e, bp = e0000005704ad680


Have you determined what is causing your problem yet?

Roman

[yulianto piyut]

hi roman, i have no sollution for this issu, yet. I want to try configure SUN storage to this server.

[yulianto piyut]

I have changed connection to the other SAN switch and problem is solved!