Operating System - HP-UX
1748044 Members
5102 Online
108757 Solutions
New Discussion юеВ

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

 
Delrish
Trusted Contributor

Oracle 10g on HP-UX, Terrible Poor Performance!!

Hi All,

I setup an Oracle 10g on HP-UX 11iv1. Server is a HP 9000, 4 CPUs (750 MHZ). It is connected to Disk System 2405 (Virtual Array 7110). Fiber Channels are connected at 2 GB speed.
I installed a cluster 10g database. First I installed CRS and after that I installed oracle database. ( I want to test clustered database with one instance)
I installed every thing line by line as oracle document wrote.
All the things, kernel parameters, patches, are like oracle wrote in its document.
I installed Golden quality package June 2004.
I increased shmmax to 2.3 G . My SGA is 1.7 G And change some other parameters as Sandy Gruver wrote in Best Practices for Oracle on HPUX.
I used oracle new storage system called ASM for this case.
When I put the system under the load, I was monitoring the system carefully.
Attached you can find ├в sar ├в d 5 1000├в result.
I started gmp. When we sent some quarries to database (It is not heavy load, I tested it with a Linux system on proliant ML570 without any problem), suddenly DISK section in gpm changed to red (critical ) I read the warning. It said ├в Disk bottleneck probability = 100%├в . I changed the output of disk report to ├в Report IO by Disk├в
├в DISK%├в was 100% and ├в RAW IO RT├в was about 1000 for two disks ( This two disks dedicated for ASM). In this situation CPU idle time was 1% or 2% for all the CPUs but load average was about 1. Performance is not acceptable at all ( In comparison with Oracle that installed on Linux).
19 REPLIES 19
Eric Antunes
Honored Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Hi,

Why do you use this 1.7Gb huge SGA? It is recomended by Oracle for 10g??

When you get this issue solved, you should read this: http://forums1.itrc.hp.com/service/forums/helptips.do?#28

Best Regards,

Eric Antunes
Each and every day is a good day to learn.
harry d brown jr
Honored Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!


Although glance (gpm) red-lined your disks, is your performance poor based upon transaction throughput or is the red-lined disks the only issue?

Can you point us to the Sandy Gruver document on Oracle Best Practices on HP-UX - specific to 10G + CRS + ASM ??

This is most likely an ASM issue, thus maybe Oracle has a solution.

live free or die
harry d brown jr
Live Free or Die
Jean-Luc Oudart
Honored Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Harry,

this presentation can be found here :
http://h21007.www2.hp.com/dspp/files/unprotected/database/HP3KOracle.ppt


Regards
Jean-Luc
fiat lux
harry d brown jr
Honored Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Jean-Luc,

Exactly what I was getting at. That document is for 9i NOT 10g with CRS and ASM. Thus it's not extremely useful.

live free or die
harry d brown jr
Live Free or Die
Delrish
Trusted Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Thank you,

Yes the presentation is about 9i, but i use some part of that talked about tuning the Oracle for RAW partitions.
The problem that I saw in GPM was bottleneck in Disk. As I said in my first email, I had a warning in glance. It said "Disk bottleneck probability = 100%". And at the same time when I got the Disk report with IO by Disk, "Disk" column was "100%" and "RAW IO RT" column was about "1000" for each disk (I used 2 disks for storage)
Glance reported Disk was in Critical situation.
I think the problem is IO or something about Disks
I used HP Disk System 2405. Fibber channels on both server side and Disk Array side are configured at 2 Gb and topologies are PTTOPT_FABRIC.
Is it ok that RAW IO RT about 1000 for each LUN?
Why Disk% in glance/report IO BY Disk/ was 100%?
Did you see sar result that I sent it with my first email. c6t0d3 & c6t0d4 are the Disks I used for storage. I found an error in STM logs. Attached you can find a picture of this error.(Do not attention to the date of error).

It logged this error about 12 times during the test.Any comment?

Regards,
Alireza
Peyman Javaheri
Frequent Advisor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Hi Alireza,

How is the performance from queries? Do you see any slowness? I ask these questions because Glance may not be showing to you the right info. Its Max threshold may not be set to include your high fiber throughput, so it translates it as bottleneck. I see that same problem all the time with our systems. Glance shows a high I/O, but in fact that is good and we want to use the full capacity of our I/O systems. However, that I/O number that glance shows may not be acceptable for my other regular SCSI disk.

If you are concerned with the I/O you can start by looking more into how your filesystem, lvol, vg, kernel, F/C, Switches (if SAN), and the array are setup since you are not seeing any memory/cpu problems.

Regards,
Peyman;
Delrish
Trusted Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Thank you Peyman,

Yes,The system was very slow and performance was not acceptable at all.
Did you see my SAR results? in the pick time disks are 94% busy.I think the problem is in storage system (Disk array, san switch, fibber cable or fibber channel)
What is your idea? At the time of occurance CPU idle time on all the CPUs is about 2% but load average is acceptable and equal about 1.0 .
Did you see the picture i attached to the last email? STM find a problem but it was temporary problem. During the test i found it. It was repeated 12 times, during the test. Waht is your idea? Do you think my SAN has a hardware problem?
I setup a test. i copied a 5 GB file from server's local HDD to SAN, it took about 6 mins to complete. is it ok? I think it should be very faster.Do you think i detect the problem correctly? IS it realy IO problem or another thing is wrong? Please advice.

Regards,
Alireza
Philip Kernohan
Advisor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Alireza,

Is this array and the layout of the array the same for both Linux and HP-UX? If not, it could be your devices are in contention with each other I'm not certain how the db is laid out.

How much RAM is on your server total?

Size of swap defined on HP-UX? Is paging heavy in sar also?

[
Lastly it is important to most users of these forums to make sure you assign points (You have assigned points to 0 of 29 responses to your questions).
]

Good luck,
PK
It's nice to be important but it's more important to be nice
David Child_1
Honored Contributor

Re: Oracle 10g on HP-UX, Terrible Poor Performance!!

Take a closer look at c1t2d0. According to the sar output you initially attached it doesn't look too good. The utilization is low (~20%), but the average queue gets up to 20 occasionally and wait/service times are very high.

What is that drive used for?

David