High IOPS with low BPS

[Chris Koutras]

I have an HP DL380 w/ dual 3GHz Xeons running Redhat Linus AS 3 Update 5. This system is connected to an EVA-5000 via two HBA 2241 fiber channel cards. The system is also running SecurePath for Linux.

This system functions as an Oracle database server. My issue is while watching Linux 'top' I see high IO wait times. I fired up Qlogic SANsurfer to watch the statistics for each hba. According to SANsurfer the each HBA is processing around 200 IO's per second. However, SANsurfer also show the Bytes Per Second (BPS) as 16. This does not seem right. has anyone else seen this issue? Are there any configuration guides for Linux? I have searched the ITRC and read the documents for the HBA but neither has been very helpful.