Oracle rac 10g and extension for rac problems

[Fernando Jose P de Souz]

Hi

2 servers: rx2660
S.O.: HP-UX 11.23 - HP-UX Foundation Operating Environment Component
HWEnable11i B.11.23.0609.053 Hardware Enablement Patches for HP-UX 11i v2, September 2006
QPKAPPS B.11.23.0703.059a Applications Quality Pack Bundle for HP-UX 11i v2, March 2007
QPKBASE B.11.23.0703.059a Base Quality Pack Bundle for HP-UX 11i v2, March 2007

Oracle 10g RAC

Oracle RAC:
SG-Oracle-Tool B.03.00 Serviceguard Oracle Script Templates
SG-RAC-Tool A.01.00.00 Serviceguard Extension for RAC Toolkit SD Product

===================
cmviewcl:

CLUSTER STATUS
clusterRAC up

NODE STATUS STATE
hprac01 up running
hprac02 up running

MULTI_NODE_PACKAGES

PACKAGE STATUS STATE AUTO_RUN SYSTEM
SG-CFS-pkg up running enabled yes
SG-CFS-DG-dgrac01 up running enabled no
SG-CFS-DG-dgrac02 up running enabled no
SG-CFS-DG-dgrac03 up running enabled no
SG-CFS-DG-dgrac04 up running enabled no
SG-CFS-MP-u02 up running enabled no
SG-CFS-MP-u03 up running enabled no
SG-CFS-MP-u04 up running enabled no
SG-CFS-MP-u05 up running enabled no
unipro_oc up (1/2) running enabled no
unipro_rac up (1/2) running enabled no

===================

Problem:

the Oracle RAC is ok, everything ONLINE.

The node that i execute the start oracle packages, the log wait for rac to terminate and, when

i execute cmviwewcl, show me the message above.

oracle package (crs) LOG:


Message that display (1/2) in the cmviewcl:

########### Node "hprac01": Starting package at Sat Dec 5 03:30:39 SAT 2009 ###########
Dec 5 03:30:39 - Node "hprac01" *** /etc/cmcluster/unipro_oc/toolkit_oc.sh called with start

argument. ***
Dec 5 03:30:39 - Node "hprac01" : Starting Oracle Clusterware at Sat Dec 5 03:30:39 SAT 2009
Attempting to start CRS stack
The CRS stack will be started shortly


Correct message to appear in the log (up running):

########### Node "hprac01": Starting package at Sat Dec 5 03:50:33 SAT 2009 ###########
Dec 5 03:50:33 - Node "hprac01" *** /etc/cmcluster/unipro_oc/toolkit_oc.sh called with start

argument. ***
Dec 5 03:50:33 - Node "hprac01" : Starting Oracle Clusterware at Sat Dec 5 03:50:33 SAT 2009
Attempting to start CRS stack
The CRS stack will be started shortly
Dec 5 03:51:14 - Node "hprac01" Oracle Clusterware successfully started.
Dec 5 03:51:14 - Node "hprac01": Starting service unipro_oc using
"/etc/cmcluster/unipro_oc/toolkit_oc.sh check"
Dec 5 03:51:14 - Node "hprac01" *** /etc/cmcluster/unipro_oc/toolkit_oc.sh called with check

argument. ***

########### Node "hprac01": Package start completed at Sat Dec 5 03:51:14 SAT 2009 ###########


It seems Upgrade bundle Patch

wait

Fernando.

[John Bigg]

Have you performed a rolling upgrade from SGeRAC 11.18 to 11.19? If so then there is a known issue which can prevent Oracle startup after the final node rolls to 11.19.

The workaround is to halt the entire cluster and re-start it. The problem will then no longer occur. If this is not possible, then you can solve the problem by installing PHSS_40598 on each node in turn in a rolling fashion which will keep the cluster online.

[Fernando Jose P de Souz]

no, the serviceguard version:
ServiceGuard A.11.17.00 Serviceguard SD Product

I didnt upgrade the version.

But the oracle is online in these servers, but the output of cmviewcl is (1/2).

oracle@hprac01[unipro1]:/home/oracle$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....01.lsnr application ONLINE ONLINE hprac01
ora....c01.gsd application ONLINE ONLINE hprac01
ora....c01.ons application ONLINE ONLINE hprac01
ora....c01.vip application ONLINE ONLINE hprac01
ora....02.lsnr application ONLINE ONLINE hprac02
ora....c02.gsd application ONLINE ONLINE hprac02
ora....c02.ons application ONLINE ONLINE hprac02
ora....c02.vip application ONLINE ONLINE hprac02
ora.unipro.db application ONLINE ONLINE hprac01
ora....o1.inst application ONLINE ONLINE hprac01
ora....o2.inst application ONLINE ONLINE hprac02

oracle@hprac02[unipro2]:/home/oracle$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....01.lsnr application ONLINE ONLINE hprac01
ora....c01.gsd application ONLINE ONLINE hprac01
ora....c01.ons application ONLINE ONLINE hprac01
ora....c01.vip application ONLINE ONLINE hprac01
ora....02.lsnr application ONLINE ONLINE hprac02
ora....c02.gsd application ONLINE ONLINE hprac02
ora....c02.ons application ONLINE ONLINE hprac02
ora....c02.vip application ONLINE ONLINE hprac02
ora.unipro.db application ONLINE ONLINE hprac01
ora....o1.inst application ONLINE ONLINE hprac01
ora....o2.inst application ONLINE ONLINE hprac02


in attach the log one the servers