MC-SG oracle 10g RAC and ASM

[tom quach_1]

Hi Everyone,
I am just wonder if anyone has setup oracle 10g RAC using ASM in a HPUX 11.11 and MC-SG 11.16 environment.
i am currently using 9i RAC 2 nodes cluster MC-SG with RAW devices and want to move to 10g RAC, we want to use ASM with RAC.
Please give me some guide line on how to accomplish this.

Regards,
Tom

[Stephen Doud]

I don't have a how-to, but the Lab issues this statement:
"Beginning with SGeRAC A.11.17, ASM can be supported in Shared LVM volume groups."

[Julio Yamawaki]

Hi,

I setup a RAC Cluster with 9i and SGeRAC 11.16 using shared LVM.
As we have problem to made an update on logical volumes every new lvol we had to create we decided to move to 10g using ASM.
The basic difference is that, instead of using shared LVM I setup ASM using raw disk device (/dev/dsk/cntndn).
In this way, we now don't have problem in creating a new device or making an new datafile in oracle.
Performance basically stays the same.
All the other configuration remains the same also.

Regards,

[tom quach_1]

Thank you Stephen and Julio for the info.

Julio- Your environment is probably just like mine,
so when you use ASM with raw disk /dev/dsk/cntndn on 1 node, what happens to the other node, I just have to locate the same disk device?

this line below is for package run script

#Since this is Oracle 9iRAC, we must activate in shared mode.
VGCHANGE="vgchange -a s" # Default

since this is ASM using RAW disk and writing , reading to the same disk on both nodes.
What you do with the second node at all?
Please verify these steps for me.

this is for 2 nodes cluster
1- create 5 disks under /dev/rdsk and change owner and group to dba:oracle
DO YOU HAVE TO DO ANY EXPORT
crw-rw-r-- 1 oracle dba 188 0x0d0400 Mar 30 11:38 c13t0d4
crw-rw-r-- 1 oracle dba 188 0x0d0500 Mar 30 11:38 c13t0d5
crw-r----- 1 oracle dba 188 0x0d0600 Feb 20 04:02 c13t0d6
crw-r----- 1 oracle dba 188 0x0d0700 Mar 30 11:38 c13t0d7
crw-r----- 1 oracle dba 188 0x0d1000 Mar 30 11:38 c13t1d0

2--do all the prerequisites and install ASM on node1, in the process of installing, it will see node2 also

3--install oracle database 10g for RAC

4--do you create startup package in MC-SG to monitor your RAC.

if yes in package run script.
do you start ASM and database in a same package?

Thank you,
Tom

[Greg Vaidman]

Tom,

A caveat we ran into with a 10gR1 RAC implementation last year was that ASM requires the same devices to have the same filenames throughout the cluster. This was something we found out after the fact and caused us a little bit of grief. By the way, if you're using a multi-pathing disk solution, such as SecurePath, you only need to identify one matching device file for each device for ASM, so that made things a bit easier.

--Greg

[Jose Garcia_7 · Accepted solution]

We've been using 10g RAC with ASM for over a year here on 11.11. With 10g you don't really need MC-SG, we just use Oracle's clustering software a new feature of 10g.

ASM manages the raw devices and in our two node cluster each node has its own instance and oracle home.

And as was stated earlier if using multipaths use only one raw device as the software (Powerpath) handles the load balancing/redudancy.

[Julio Yamawaki]

Hi,

1- create 5 disks under /dev/rdsk and change owner and group to dba:oracle
It's correct, in spite of using same device name, when we configured XP, I asked HP guy to use the same device name, so we had no problem

2--do all the prerequisites and install ASM on node1, in the process of installing, it will see node2 also
We configured all disks in server 1, started ASM and made the same in the other node

3--install oracle database 10g for RAC
Correct, after installing and configuring ASM in both nodes

4--do you create startup package in MC-SG to monitor your RAC.
Yes.

if yes in package run script.
do you start ASM and database in a same package?
In our case, ASM is in the same package as Oracle server, but I think you can have a separate package for ASM. I don't see problem in it.

Regards,

[tom quach_1]

Thank you Jose and Julio,

Jose,
without MC-SG you just create startup script to start your ASM and database?

Julio, if you don'd mind
can i see a portion of the control run script package.cntl
function customer_defined_run_cmds
{
# ADD customer defined run commands.
: # do nothing instruction, because a function must contain some command.

test_return 51
}

# ADD customer defined halt commands.
: # do nothing instruction, because a function must contain some command.

}

# END OF CUSTOMER DEFINED FUNCTIONS


Thank you,
TOm

[Jose Garcia_7]

Tom,

With 10g there is something called CRS - Cluster ready services, this brings up the database on its own including ASM. Via a shared raw device (voting disk) a single node can bring up the rest of the nodes too.

Its oracle's attempt to automate things, the script is spawned from inittab. It can be disabled if desired or for maintenance reasons.

[Julio Yamawaki]

function customer_defined_run_cmds
{
# ADD customer defined run commands.
: # do nothing instruction, because a function must contain some command.
/etc/cmcluster/PROD1/toolkit.sh start
test_return 51
}

# ADD customer defined halt commands.
: # do nothing instruction, because a function must contain some command.
/etc/cmcluster/PROD1/toolkit.sh stop
}

# END OF CUSTOMER DEFINED FUNCTIONS

In /etc/cmcluster/PROD1/toolkit.sh, it calls haoracle_sql.sh:

START:
function start_oracle
{
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <startup;
select INSTANCE_NAME from v\\\$instance;
exit;
SQL

STOP:
function shutdown_oracle
{
..
..
oracle_stop=$?
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <shutdown;
exit;
SQL

Regards,

[tom quach_1]

Hi Julio

Please clarify,
in haoracle_sql.sh
it starts only 1 ASM1
where is the startup of your main database.

Thanks,
Tom

In /etc/cmcluster/PROD1/toolkit.sh, it calls haoracle_sql.sh:

START:
function start_oracle
{
export ORACLE_HOME=${ORACLE_HOME}
export ORACLE_SID=+ASM1
${ORACLE_HOME}/bin/sqlplus '/ as sysdba' <startup;
select INSTANCE_NAME from v\\\$instance;
exit;
SQL

[Delrish]

Hi,

There is a step by step procedure at the CTC site.

http://www.hporaclectc.com/cug/assets/RACupgrade9i-10g.doc

Alireza

[tom quach_1]

Hi Alireza

Thanks for the link
...But i cannot open it.
It is only accessable by employees of Hewlett Packard, Oracle and selected partners
would you please send me the doc

tquach@sunrider.com

Thanks,

[Julio Yamawaki]

Hi,

Tom, it's necessary only one ASM for server because you have one instance of RAC and one instance of ASM.
Also, you may have one ASM instance and more than one RAC instance.
I showed you the script of one server, in the other node, we start ASM instance in the same way, but use +ASM2 instead of +ASM1.

Regards,

[tom quach_1]

Thanks-Julio,

I understook that, but in 10g there are 2 databases, the ASM is the database to mount all drivers for you,and after the ASM is up then you can start your real database. Does it work that way?

Thanks,
Tom

[Julio Yamawaki]

Hi,

Yes, you have two databases, one in each server and you need to start at least one ASM instance in each server in order for databases instances to work.
Believe me: it really works.
Before we installed ASM we were thinking about this new version of SGeRAC with Veritas Filesystem, as it lasted too much, we decided in january to upgrade from 9i with ASM.
If you want a good book about RAC, ASM and High Availability in Oracle, try, High Availbility with RAC, Flashback & Data Guard, this book describes how to manage ASM in RAC environment.

Regards,

[tom quach_1]

Thank you very much- Julio

Tom

[ashokan_1]

Greg,

Refering to your note on finding a matching device in SecurePath. What can I do if there is no common device path in both nodes, and Oracle Installer prompts for a single device path for ASM disk? I have an EVA4000 and SecurePath 3.0f installed and none of the device paths in two nodes are common. HP says it is difficult to change the disk device path.


Ashokan.