LVM Error.

[sudhapage]

Hi All,

I can the see the below errors in one hpux server. Could you please suggest me what will be the cause for this.

bdf: /oracle/PP1/sapreorg: I/O error
bdf: /oracle/PP1/sapdata4: I/O error
bdf: /oracle/PP1/sapdata3: I/O error
bdf: /oracle/PP1/sapdata2: I/O error
bdf: /oracle/PP1/sapdata1: I/O error
bdf: /oracle/PP1/origlogB: I/O error
bdf: /oracle/PP1/origlogA: I/O error
bdf: /oracle/PP1/oraarch: I/O error
bdf: /oracle/PP1/mirrlogB: I/O error
bdf: /oracle/PP1/mirrlogA: I/O error

uxmou01 # vgdisplay -v vg_PP1
--- Volume groups ---
VG Name /dev/vg_PP1
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 14
Open LV 14
Max PV 100
Cur PV 4
Act PV 4
Max PE per PV 16000
VGDA 8
PE Size (Mbytes) 16
Total PE 8892
Alloc PE 6816
Free PE 2076
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg_PP1/PP1origlogB
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 32
Allocated PE 32
Used PV 1

LV Name /dev/vg_PP1/PP1origlogA
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 32
Allocated PE 32
Used PV 1

LV Name /dev/vg_PP1/PP1usrsap
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 32
Allocated PE 32
Used PV 1

LV Name /dev/vg_PP1/PP1sapmnt
LV Status available/syncd
LV Size (Mbytes) 2048
Current LE 128
Allocated PE 128
Used PV 1

LV Name /dev/vg_PP1/PP1oracle
LV Status available/syncd
LV Size (Mbytes) 20480
Current LE 1280
Allocated PE 1280
Used PV 3

LV Name /dev/vg_PP1/PP1sapreorg
LV Status available/syncd
LV Size (Mbytes) 2048
Current LE 128
Allocated PE 128
Used PV 1

LV Name /dev/vg_PP1/PP1sapdata4
LV Status available/syncd
LV Size (Mbytes) 10240
Current LE 640
Allocated PE 640
Used PV 1

LV Name /dev/vg_PP1/PP1sapdata3
LV Status available/syncd
LV Size (Mbytes) 10240
Current LE 640
Allocated PE 640
Used PV 3

LV Name /dev/vg_PP1/PP1sapdata2
LV Status available/syncd
LV Size (Mbytes) 10240
Current LE 640
Allocated PE 640
Used PV 1

LV Name /dev/vg_PP1/PP1sapdata1
LV Status available/syncd
LV Size (Mbytes) 10240
Current LE 640
Allocated PE 640
Used PV 2

LV Name /dev/vg_PP1/PP1oraarch
LV Status available/syncd
LV Size (Mbytes) 20480
Current LE 1280
Allocated PE 1280
Used PV 2

LV Name /dev/vg_PP1/PP1mirrlogB
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 32
Allocated PE 32
Used PV 1

LV Name /dev/vg_PP1/PP1mirrlogA
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 32
Allocated PE 32
Used PV 1

LV Name /dev/vg_PP1/u90_pp1
LV Status available/syncd
LV Size (Mbytes) 20480
Current LE 1280
Allocated PE 1280
Used PV 2


--- Physical volumes ---
PV Name /dev/dsk/c51t0d0
PV Status unavailable
Total PE 2223
Free PE 0
Autoswitch On

PV Name /dev/dsk/c51t0d4
PV Status unavailable
Total PE 2223
Free PE 0
Autoswitch On

PV Name /dev/dsk/c51t1d4
PV Status unavailable
Total PE 2223
Free PE 0
Autoswitch On

PV Name /dev/dsk/c51t1d5
PV Status unavailable
Total PE 2223
Free PE 2076
Autoswitch On

msgcnt 38565 vxfs: mesg 008: vx_direrr: vx_dirscan_2 - /oracle/PP1 file system inode 2 block 23 error 5
msgcnt 38566 vxfs: mesg 025: vx_wsuper - /dev/vg_PP1/PP1oracle file system super-block update failed

Regards,
Sudhakaran.K

[Venkatesh BL]

Looks like certain sectors of the disk has gone bad. Is the disk online right now?

[Prashanth Waugh]

Hi Sudha,

Check the FS integrity using fsck command.
#fsck -F vxfs /dev/vg01/rlvol1

Regards
Prashant

[Prashanth Waugh]

Hi,

check the disk using
#diskinfo /dev/rdsk/c51t1d5


Regards
Prashant

[likid0]

You should check your disks, because the server isn't seeing them, if they are san disks, check that your fc cards have link with the fcmsutil command. If they are disks on a scsi array check out the health of the array and the scsi card

[Torsten.]

PV Status unavailable

You have lost the path to your array.

I wonder why you don't have alternate pathes - or do you use any multipath software?

Investigate the connection!

[Prashanth Waugh]

Hi ,

If ur using FC then check
check the FC card
#ioscan -fnC fc

check its online/enable or not
#fcmsutil

Regards
Prashant

[Bill Hassell]

You have a serious disk failure. You should see lots of errors in /var/adm/syslog/syslog.log. The error code 5 indicates the disk has failed. fsck CANNOT fix a bad disk. It must be replaced and the data restored.

[Torsten.]

Well Bill, I see 4 unavailable LUNs there, so IMHO there is something wrong with the connection or on the array side - but I don't think there is a bad disk. There must be many of them bad ...