topic Re: MC-SG oracle 10g RAC and ASM in Operating System - HP-UX

MC-SG oracle 10g RAC and ASM

tom quach_1 — Thu, 30 Mar 2006 12:20:21 GMT

Hi Everyone,
I am just wonder if anyone has setup oracle 10g RAC using ASM in a HPUX 11.11 and MC-SG 11.16 environment.
i am currently using 9i RAC 2 nodes cluster MC-SG with RAW devices and want to move to 10g RAC, we want to use ASM with RAC.
Please give me some guide line on how to accomplish this.

Regards,
Tom

Re: MC-SG oracle 10g RAC and ASM

Stephen Doud — Thu, 30 Mar 2006 13:04:41 GMT

I don't have a how-to, but the Lab issues this statement:
"Beginning with SGeRAC A.11.17, ASM can be supported in Shared LVM volume groups."

Re: MC-SG oracle 10g RAC and ASM

Julio Yamawaki — Thu, 30 Mar 2006 13:55:30 GMT

Hi,

I setup a RAC Cluster with 9i and SGeRAC 11.16 using shared LVM.
As we have problem to made an update on logical volumes every new lvol we had to create we decided to move to 10g using ASM.
The basic difference is that, instead of using shared LVM I setup ASM using raw disk device (/dev/dsk/cntndn).
In this way, we now don't have problem in creating a new device or making an new datafile in oracle.
Performance basically stays the same.
All the other configuration remains the same also.

Regards,

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Thu, 30 Mar 2006 15:07:03 GMT

Thank you Stephen and Julio for the info.

Julio- Your environment is probably just like mine,
so when you use ASM with raw disk /dev/dsk/cntndn on 1 node, what happens to the other node, I just have to locate the same disk device?

this line below is for package run script

#Since this is Oracle 9iRAC, we must activate in shared mode.
VGCHANGE="vgchange -a s" # Default

since this is ASM using RAW disk and writing , reading to the same disk on both nodes.
What you do with the second node at all?
Please verify these steps for me.

this is for 2 nodes cluster
1- create 5 disks under /dev/rdsk and change owner and group to dba:oracle
DO YOU HAVE TO DO ANY EXPORT
crw-rw-r-- 1 oracle dba 188 0x0d0400 Mar 30 11:38 c13t0d4
crw-rw-r-- 1 oracle dba 188 0x0d0500 Mar 30 11:38 c13t0d5
crw-r----- 1 oracle dba 188 0x0d0600 Feb 20 04:02 c13t0d6
crw-r----- 1 oracle dba 188 0x0d0700 Mar 30 11:38 c13t0d7
crw-r----- 1 oracle dba 188 0x0d1000 Mar 30 11:38 c13t1d0

2--do all the prerequisites and install ASM on node1, in the process of installing, it will see node2 also

3--install oracle database 10g for RAC

4--do you create startup package in MC-SG to monitor your RAC.

if yes in package run script.
do you start ASM and database in a same package?

Thank you,
Tom

Re: MC-SG oracle 10g RAC and ASM

Greg Vaidman — Thu, 30 Mar 2006 15:23:59 GMT

Tom,

A caveat we ran into with a 10gR1 RAC implementation last year was that ASM requires the same devices to have the same filenames throughout the cluster. This was something we found out after the fact and caused us a little bit of grief. By the way, if you're using a multi-pathing disk solution, such as SecurePath, you only need to identify one matching device file for each device for ASM, so that made things a bit easier.

--Greg

Re: MC-SG oracle 10g RAC and ASM

Jose Garcia_7 — Thu, 30 Mar 2006 17:43:47 GMT

We've been using 10g RAC with ASM for over a year here on 11.11. With 10g you don't really need MC-SG, we just use Oracle's clustering software a new feature of 10g.

ASM manages the raw devices and in our two node cluster each node has its own instance and oracle home.

And as was stated earlier if using multipaths use only one raw device as the software (Powerpath) handles the load balancing/redudancy.

Re: MC-SG oracle 10g RAC and ASM

Julio Yamawaki — Thu, 30 Mar 2006 18:01:12 GMT

Hi,

1- create 5 disks under /dev/rdsk and change owner and group to dba:oracle
It's correct, in spite of using same device name, when we configured XP, I asked HP guy to use the same device name, so we had no problem

2--do all the prerequisites and install ASM on node1, in the process of installing, it will see node2 also
We configured all disks in server 1, started ASM and made the same in the other node

3--install oracle database 10g for RAC
Correct, after installing and configuring ASM in both nodes

4--do you create startup package in MC-SG to monitor your RAC.
Yes.

if yes in package run script.
do you start ASM and database in a same package?
In our case, ASM is in the same package as Oracle server, but I think you can have a separate package for ASM. I don't see problem in it.

Regards,

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Thu, 30 Mar 2006 18:22:03 GMT

Thank you Jose and Julio,

Jose,
without MC-SG you just create startup script to start your ASM and database?

Julio, if you don'd mind
can i see a portion of the control run script package.cntl
function customer_defined_run_cmds
{
# ADD customer defined run commands.
: # do nothing instruction, because a function must contain some command.

test_return 51
}

# ADD customer defined halt commands.
: # do nothing instruction, because a function must contain some command.

}

# END OF CUSTOMER DEFINED FUNCTIONS

Thank you,
TOm

Re: MC-SG oracle 10g RAC and ASM

Jose Garcia_7 — Thu, 30 Mar 2006 18:34:57 GMT

Tom,

With 10g there is something called CRS - Cluster ready services, this brings up the database on its own including ASM. Via a shared raw device (voting disk) a single node can bring up the rest of the nodes too.

Its oracle's attempt to automate things, the script is spawned from inittab. It can be disabled if desired or for maintenance reasons.

Re: MC-SG oracle 10g RAC and ASM

Julio Yamawaki — Fri, 31 Mar 2006 08:10:31 GMT

function customer_defined_run_cmds
{
# ADD customer defined run commands.
: # do nothing instruction, because a function must contain some command.
/etc/cmcluster/PROD1/toolkit.sh start
test_return 51
}

# ADD customer defined halt commands.
: # do nothing instruction, because a function must contain some command.
/etc/cmcluster/PROD1/toolkit.sh stop
}

# END OF CUSTOMER DEFINED FUNCTIONS

In /etc/cmcluster/PROD1/toolkit.sh, it calls haoracle_sql.sh:

START:
function start_oracle
{
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <startup;
select INSTANCE_NAME from v\\\$instance;
exit;
SQL

STOP:
function shutdown_oracle
{
..
..
oracle_stop=$?
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <shutdown;
exit;
SQL

Regards,

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Fri, 31 Mar 2006 09:08:54 GMT

Hi Julio

Please clarify,
in haoracle_sql.sh
it starts only 1 ASM1
where is the startup of your main database.

Thanks,
Tom

In /etc/cmcluster/PROD1/toolkit.sh, it calls haoracle_sql.sh:

START:
function start_oracle
{
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <startup;
select INSTANCE_NAME from v\\\$instance;
exit;
SQL

Re: MC-SG oracle 10g RAC and ASM

Delrish — Fri, 31 Mar 2006 09:31:01 GMT

Hi,

There is a step by step procedure at the CTC site.

http://www.hporaclectc.com/cug/assets/RACupgrade9i-10g.doc

Alireza

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Fri, 31 Mar 2006 11:29:11 GMT

Hi Alireza

Thanks for the link
...But i cannot open it.
It is only accessable by employees of Hewlett Packard, Oracle and selected partners
would you please send me the doc

tquach@sunrider.com

Thanks,

Re: MC-SG oracle 10g RAC and ASM

Julio Yamawaki — Fri, 31 Mar 2006 19:26:33 GMT

Hi,

Tom, it's necessary only one ASM for server because you have one instance of RAC and one instance of ASM.
Also, you may have one ASM instance and more than one RAC instance.
I showed you the script of one server, in the other node, we start ASM instance in the same way, but use +ASM2 instead of +ASM1.

Regards,

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Fri, 31 Mar 2006 20:53:30 GMT

Thanks-Julio,

I understook that, but in 10g there are 2 databases, the ASM is the database to mount all drivers for you,and after the ASM is up then you can start your real database. Does it work that way?

Thanks,
Tom

Re: MC-SG oracle 10g RAC and ASM

Julio Yamawaki — Fri, 31 Mar 2006 21:36:09 GMT

Hi,

Yes, you have two databases, one in each server and you need to start at least one ASM instance in each server in order for databases instances to work.
Believe me: it really works.
Before we installed ASM we were thinking about this new version of SGeRAC with Veritas Filesystem, as it lasted too much, we decided in january to upgrade from 9i with ASM.
If you want a good book about RAC, ASM and High Availability in Oracle, try, High Availbility with RAC, Flashback & Data Guard, this book describes how to manage ASM in RAC environment.

Regards,

Re: MC-SG oracle 10g RAC and ASM

tom quach_1 — Sat, 01 Apr 2006 00:05:20 GMT

Thank you very much- Julio

Tom

Re: MC-SG oracle 10g RAC and ASM

ashokan_1 — Tue, 08 Aug 2006 12:35:03 GMT

Greg,

Refering to your note on finding a matching device in SecurePath. What can I do if there is no common device path in both nodes, and Oracle Installer prompts for a single device path for ASM disk? I have an EVA4000 and SecurePath 3.0f installed and none of the device paths in two nodes are common. HP says it is difficult to change the disk device path.

Ashokan.