Strange Error logs

[Bona_1]

Hello all,
I keep getting these strange errors on my server. I suspect it's a failing disk. Any ideas?

Best Regards
Gbenga

Jan 26 17:40:32 billing vmunix: LVM: vg[12]: pvnum=0 (dev_t=0x1f101500) is POWERFAILED
Jan 26 17:40:33 billing vmunix:
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 50104696, sectno: 100209392, offset: -232398848, bcount: 8192.
Jan 26 17:40:32 billing vmunix: LVM: vg[12]: pvnum=0 (dev_t=0x1f101500) is POWERFAILED
Jan 26 17:40:33 billing vmunix: blkno: 49292056, sectno: 98584112, offset: -1064542208, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 49204920, sectno: 98409840, offset: -1153769472, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 49204928, sectno: 98409856, offset: -1153761280, bcount: 8192.
Jan 26 17:40:33 billing vmunix: SCSI: Write error -- dev: b 31 0x101300, errno: 126, resid: 16384,
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing above message repeats 3 times
Jan 26 17:40:33 billing vmunix: blkno: 48512944, sectno: 97025888, offset: -1862352896, bcount: 16384.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 47381400, sectno: 94762800, offset: 1273913344, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 44826800, sectno: 89653600, offset: -1341997056, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 42317960, sectno: 84635920, offset: 383918080, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 42101152, sectno: 84202304, offset: 161906688, bcount: 8192.
Jan 26 17:40:33 billing vmunix: SCSI: Write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing above message repeats 3 times
Jan 26 17:40:33 billing vmunix: blkno: 37230024, sectno: 74460048, offset: -531161088, bcount: 8192.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 36901216, sectno: 73802432, offset: -867860480, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36908560, sectno: 73817120, offset: -860340224, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36906480, sectno: 73812960, offset: -862470144, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36902128, sectno: 73804256, offset: -866926592, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36835408, sectno: 73670816, offset: -935247872, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36894552, sectno: 73789104, offset: -874684416, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36890752, sectno: 73781504, offset: -878575616, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36883552, sectno: 73767104, offset: -885948416, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36882320, sectno: 73764640, offset: -887209984, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36853424, sectno: 73706848, offset: -916799488, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36733528, sectno: 73467056, offset: -1039572992, bcount: 8192.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 16384,
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing above message repeats 10 times
Jan 26 17:40:33 billing vmunix: blkno: 36738928, sectno: 73477856, offset: -1034043392, bcount: 16384.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 36733576, sectno: 73467152, offset: -1039523840, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 36733568, sectno: 73467136, offset: -1039532032, bcount: 8192.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 32768,
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 36733536, sectno: 73467072, offset: -1039564800, bcount: 32768.
Jan 26 17:40:33 billing vmunix: SCSI: Write error -- dev: b 31 0x101300, errno: 126, resid: 16384,
Jan 26 17:40:33 billing vmunix: blkno: 34874056, sectno: 69748112, offset: 1351294976, bcount: 16384.
Jan 26 17:40:33 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:33 billing vmunix: blkno: 34874744, sectno: 69749488, offset: 1351999488, bcount: 8192.
Jan 26 17:40:33 billing vmunix: blkno: 31371440, sectno: 62742880, offset: 2059583488, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 31371480, sectno: 62742960, offset: 2059624448, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 31371472, sectno: 62742944, offset: 2059616256, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 31371464, sectno: 62742928, offset: 2059608064, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 31371456, sectno: 62742912, offset: 2059599872, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 31371448, sectno: 62742896, offset: 2059591680, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 26746560, sectno: 53493120, offset: 1618673664, bcount: 8192.
Jan 26 17:40:34 billing vmunix: SCSI: Read error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:34 billing vmunix: blkno: 25446552, sectno: 50893104, offset: 287465472, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 20347976, sectno: 40695952, offset: -638509056, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 9967760, sectno: 19935520, offset: 1617051648, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 2556792, sectno: 5113584, offset: -1676812288, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 2556800, sectno: 5113600, offset: -1676804096, bcount: 8192.
Jan 26 17:40:34 billing vmunix: SCSI: Read error -- dev: b 31 0x101300, errno: 126, resid: 2048,
Jan 26 17:40:34 billing vmunix: blkno: 8, sectno: 16, offset: 8192, bcount: 2048.
Jan 26 17:40:34 billing vmunix: LVM: vg[14]: pvnum=0 (dev_t=0x1f101300) is POWERFAILED
Jan 26 17:40:34 billing vmunix: blkno: 49477248, sectno: 98954496, offset: -874905600, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 47385528, sectno: 94771056, offset: 1278140416, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 37421856, sectno: 74843712, offset: -334725120, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 36866376, sectno: 73732752, offset: -903536640, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 347712, sectno: 695424, offset: 356057088, bcount: 8192.
Jan 26 17:40:34 billing vmunix: SCSI: Write error -- dev: b 31 0x101300, errno: 126, resid: 2048,
Jan 26 17:40:34 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:34 billing above message repeats 16 times
Jan 26 17:40:34 billing vmunix: blkno: 2749, sectno: 5498, offset: 2814976, bcount: 2048.
Jan 26 17:40:34 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:34 billing vmunix: blkno: 35055152, sectno: 70110304, offset: 1536737280, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 12341544, sectno: 24683088, offset: -247160832, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 12086376, sectno: 24172752, offset: -508452864, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 9996328, sectno: 19992656, offset: 1646305280, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 9700136, sectno: 19400272, offset: 1343004672, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 7070608, sectno: 14141216, offset: -1349632000, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 5545504, sectno: 11091008, offset: 1383628800, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 4161968, sectno: 8323936, offset: -33112064, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 3794248, sectno: 7588496, offset: -409657344, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 2604544, sectno: 5209088, offset: -1627914240, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 2209464, sectno: 4418928, offset: -2032476160, bcount: 8192.
Jan 26 17:40:34 billing vmunix: SCSI: Async wri
Jan 26 17:40:34 billing vmunix: te error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:34 billing vmunix: blkno: 1134544, sectno: 2269088, offset: 1161773056, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 934344, sectno: 1868688, offset: 956768256, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 875848, sectno: 1751696, offset: 896868352, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 875856, sectno: 1751712, offset: 896876544, bcount: 8192.
Jan 26 17:40:34 billing vmunix: blkno: 551792, sectno: 1103584, offset: 565035008, bcount: 8192.
Jan 26 17:40:34 billing vmunix: LVM: Performed a switch for Lun ID = 0 (pv = 0x0000000053582800), from raw device 0x1f101300 (with priority: 0, and current flags: 0xc0) to raw device 0x1f121300 (with priority: 1, and current flags: 0x0).
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f103300) to PV 0 in VG 1.
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f101700) to PV 0 in VG 10.
Jan 26 17:40:34 billing vmunix:
Jan 26 17:40:38 billing above message repeats 61 times
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f101500) to PV 0 in VG 12.
Jan 26 17:40:34 billing vmunix: SCSI: Async write error -- dev: b 31 0x101300, errno: 126, resid: 8192,
Jan 26 17:40:38 billing above message repeats 14 times
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f101300) to PV 0 in VG 14.
Jan 26 17:40:38 billing vmunix: LVM: Performed a switch for Lun ID = 0 (pv = 0x0000000053582800), from raw device 0x1f121300 (with priority: 1, and current flags: 0x40) to raw device 0x1f101300 (with priority: 0, and current flags: 0x80).
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f121500) to PV 0 in VG 12.
Jan 26 17:40:38 billing vmunix: LVM: Recovered Path (device 0x1f121300) to PV 0 in VG 14.
Jan 26 17:40:38 billing vmunix: LVM: Restored PV 0 to VG 1.
Jan 26 17:40:38 billing vmunix: LVM: Restored PV 0 to VG 12.

[Steven E. Protter]

Your suspicions are probably correct.

I'm attaching a script you want to run once or more a day to catch a sudden failure.

Or, replace the darned thing now

SEP