I/O error with LVM

[sudheer228]

Hi,

Database online Backup log has following errors on Hp UX:

32023:(pid 8138): cannot stat /clone/ora00/oram0/undo_ts3.dbf: I/O error
32023:(pid 8138): cannot stat /clone/ora00/oram0/this_is: I/O error
6684:(pid 8138): Could not stat /clone/ora00/oram0: I/O error
32023:(pid 8130): cannot stat /clone/ora00/oram2/patrolPANK.dbf: I/O error
32023:(pid 8130): cannot stat /clone/ora00/oram2/this_is: I/O error
6684:(pid 8130): Could not stat /clone/ora00/oram2: I/O error

we are using LVM with VxFS filesytem:

same time we have errors with clone filesystems which are on same lvms in syslog.log also:

Sep 7 06:28:17 katie vmunix: vxfs: WARNING: msgcnt 922 mesg 028: V-2-28: vx_snap_alloc - /dev/vg_SnapShots/vg_pank11G_datam2
_snap snapshot file system out of space
Sep 7 06:28:17 katie vmunix: vxfs: WARNING: msgcnt 923 mesg 032: V-2-32: vx_disable - /dev/vg_SnapShots/vg_pank11G_datam2_sn
ap snapshot file system disabled
Sep 7 06:28:17 katie vmunix: Synchronous Page I/O error occurred while paging to/from disk
Sep 7 06:28:17 katie vmunix: device 0x61000bd3, 1K block #3264832, 0 bytes of 65536 bytes not paged, page addr =dead31.e0000
008763d0000, bflag =40000f, bp = e0000005022c7100

Backup tool is Legato Networker, and it is a cleint initiated backup with save command.the VG is on SAN Disk.
we checked the disk there are no errors on the disk.

Could you please help us regarding this?


Thanks in Advance,
Sudheer

[TTr]

> snapshot file system out of space
> snapshot file system disabled

You are using VxFS snapshots to run backups and as you can see you are running out of space on the snapshot filesystems. This is the result of one or more conditions:
1. Your database is busy and there are too many changes that need to be captured in the snapshot.
2. You snapshot allocation is too small
3. Your database files have grown a lot.
4. The backup session is taking too long to backup the snapshot.

Most of the time you can fix this by increasing the size of the volumes that contain filesystems with snapshots reside.

[Suraj K Sankari]

HI,
>>Sep 7 06:28:17 katie vmunix: vxfs: WARNING: msgcnt 922 mesg 028: V-2-28: vx_snap_alloc - /dev/vg_SnapShots/vg_pank11G_datam2
_snap snapshot file system out of space

Its looks like your destination file system is having out of space.

Suraj

[sudheer228]

But there is 15% space available on snap filesystem and there is no major burst in the database.and we checked incresing the lv snap shot sizes, still facing the problem.

[Suraj K Sankari]

hi,
>> /dev/vg_SnapShots/vg_pank11G_datam2
_snap snapshot file system out of space

The above error indicates there will be shortage of space on File
System /dev/vg_SnapShots/vg_pank11G_datam2
_snap

Suraj

[sudheer228]

Thanks for your help.