Package appears to be specified without virtual IP addresses

[F Verschuren]

Hi,
I can not fingd that I have configured wrong, I have a 11.23 cluster whit the sap extention.
After configureing the /etc/cmcluster/UCR/sap.config
The cluster is not starting.
It is failing whit the folowing error:

.....May 1 10:33:02 - Node "nlxanc01": Adding IP address 10.217.32.26 to subnet 10.217.32.0
May 1 10:33:02 - Node "nlxanc01": Adding IP address 10.217.36.24 to subnet 10.217.36.0
May 1 10:33:02 - Node "nlxanc01": (sapwas_main): Entering SGeSAP start runtime steps ...
May 1 10:33:02 - Node "nlxanc01": (sapwas_main): /etc/cmcluster/UCR/sapwas.cntl: SGeSAP - B.04.01.00 - Last modified 08/10/05
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /etc/cmcluster.conf
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/sap.config
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/sap.functions
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /etc/cmcluster/sap.functions
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/SID/customer.functions
May 1 10:33:02 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/customer.functions
May 1 10:33:02 - Node "nlxanc01": (initialize): TRACE POINT
May 1 10:33:02 - Node "nlxanc01": (check_version): TRACE POINT
May 1 10:33:02 - Node "nlxanc01": (check_parameters): TRACE POINT
May 1 10:33:02 - Node "nlxanc01": (check_parameters): ERROR: Package appears to be specified without virtual IP addresses
May 1 10:33:02 - Node "nlxanc01": (check_parameters): ERROR: Check IP[] array in package control file and verify the
May 1 10:33:02 - Node "nlxanc01": (check_parameters): ERROR: Call syntax in customer_defined_run_commands section
ERROR: Function customer_defined_run_cmds
ERROR: Failed to RUN customer commands
.....

[F Verschuren]

ip settings in cluster cntl:

IP[0]="10.217.32.26"
SUBNET[0]="10.217.32.0"
IP[1]="10.217.36.24"
SUBNET[1]="10.217.36.0"


already added the "" like:
# NFSRELOC
# Specify the (virtual) IP address where the SAP NFS shared filesystems
# can be reached. Format is IPv4: nnn.nnn.nnn.nnn
# The value specifies the default for SQLRELOC, TRANSRELOC, CTEXERELOC
# (see below).
#
# ALL VIRTUAL IP ADDRESSES THAT ARE SPECIFIED IN THIS FILE MIGHT
# ALSO BE CONFIGURED IN THE IP[] ARRAY OF THE PACKAGE CONTROL FILE.
# IF THIS IS THE CASE, EXACTLY THE SAME SYNTAX NEEDS TO BE USED IN
# BOTH PLACES.
#
NFSRELOC="10.217.32.26"

But still gots the errors:
May 1 10:53:51 - Node "nlxanc01": Adding IP address 10.217.32.26 to subnet 10.217.32.0
May 1 10:53:51 - Node "nlxanc01": Adding IP address 10.217.36.24 to subnet 10.217.36.0
May 1 10:53:51 - Node "nlxanc01": (sapwas_main): Entering SGeSAP start runtime steps ...
May 1 10:53:51 - Node "nlxanc01": (sapwas_main): /etc/cmcluster/UCR/sapwas.cntl: SGeSAP - B.04.01.00 - Last modified 08/10/05
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /etc/cmcluster.conf
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/sap.config
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/sap.functions
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /etc/cmcluster/sap.functions
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/SID/customer.functions
May 1 10:53:51 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/customer.functions
May 1 10:53:51 - Node "nlxanc01": (initialize): TRACE POINT
May 1 10:53:51 - Node "nlxanc01": (check_version): TRACE POINT
May 1 10:53:51 - Node "nlxanc01": (check_parameters): TRACE POINT
May 1 10:53:51 - Node "nlxanc01": (check_parameters): ERROR: Package appears to be specified without virtual IP addresses
May 1 10:53:51 - Node "nlxanc01": (check_parameters): ERROR: Check IP[] array in package control file and verify the
May 1 10:53:51 - Node "nlxanc01": (check_parameters): ERROR: Call syntax in customer_defined_run_commands section
ERROR: Function customer_defined_run_cmds
ERROR: Failed to RUN customer commands

[Kent Ostby]

Can you post the script and the conf file.

I actually had a problem like this not too long ago and found it to be in the SAP.conf file I think.

[Steve Lewis]

The SAP config file is a good start.

Also make sure that you put the package name and IP addresses in the hosts files on all machines as well.

Ensure separation of package name and host name within the config file.

[F Verschuren]

the sap.config file:

[F Verschuren]

Here are the two files thate combined are giving properly the errors,
Tanks for helping so far.
vdcudUCR.cntl file

[F Verschuren]

hosts file looks ok to me

[nlxanc01:/etc/cmcluster/vdcudUCR]# cmviewcl

CLUSTER STATUS
VDCUDUCR1 up

NODE STATUS STATE
nlxanc01 up running
nlxanc02 up running

PACKAGE STATUS STATE AUTO_RUN NODE
vdcudUCR up running disabled nlxanc02
[nlxanc01:/etc/cmcluster/vdcudUCR]# grep -i vdcudUCR /etc/hosts
10.217.32.26 vdcuducr # production cluster nlxanc01 nlxanc02
10.217.32.33 vdcuducrl # urc logging server
10.217.36.24 vdcuducrbe # production cluster nlxanc01 nlxanc02
[nlxanc01:/etc/cmcluster/vdcudUCR]#

[Kent Ostby]

Please do the following.

In the etc cmcluster directory, do a :

grep -e specified -e virtual *

Look for a line that would be specifying the message above: "Package appears to be specified without virtual IP addresses" and upload that file.

Then we can check what the exact check the script is doing.

[F Verschuren]

the error is generated in the sap.functions file from the serviveguard extention for sap

I atached the file

[Kent Ostby]

Sorry .. what I'm looking for is this file:

/etc/cmcluster/UCR/sapwas.cntl

[F Verschuren]

the error is generated in the sap.functions file from the serviveguard extention for sap

II have atachted the hp-sap file

[F Verschuren]

Sorry I tought I atached this file already. here is the sapwas.cntl file

[Kent Ostby]

Thanks .. I see the call in the hp-sap functions file, but I'd still like to look at this to see if it somehow modifies the IP[0] entry:

So please post:
/etc/cmcluster/UCR/sapwas.cntl

[F Verschuren]

[nlxanc01:/etc/cmcluster/UCR]# cat sapwas.cntl

[F Verschuren]

to be shure I have psoted all the files I have creates a (compress) tar file of /etc/cmcluster.

nlxanc01:nl11588> ll /etc/cmcluster/UCR/ After the problems I have created the folowing extra files, after creating the links I din't test jet....
total 336
lrwxr-xr-x 1 root sys 25 May 2 09:51 UCR.config -> ../vdcudUCR/vdcudUCR.cntl
lrwxr-xr-x 1 root sys 25 May 2 09:51 UCR.control.script -> ../vdcudUCR/vdcudUCR.conf
-r-xr-xr-x 1 root sys 26270 Apr 26 12:20 sap.config.org
lrwxr-xr-x 1 root sys 25 May 2 09:52 vdcudUCR.config -> ../vdcudUCR/vdcudUCR.cntl
-rwx------ 1 root sys 13842 May 1 16:45 vdcudUCR.config.tmp
lrwxr-xr-x 1 root sys 25 May 2 09:52 vdcudUCR.control.script -> ../vdcudUCR/vdcudUCR.conf
-rwx------ 1 root sys 60319 May 1 16:44 vdcudUCR.control.script.tmp
nlxanc01:nl11588>

[F Verschuren]

I have fount the first problem:
after adding the line:
IP[0]=10.217.32.26
in the file
/etc/cmcluster/UCR/sap.config
(because this was not one of the explained parameters I din't mis it before.
after adding the line the next problem appered: (but I configurend only one databace....) does somebody knows where this error is comming from?

May 4 09:19:39 - Node "nlxanc01": (check_parameters): WARNING: It is not supported to handle two databases in one package
ERROR: Function customer_defined_run_cmds
ERROR: Failed to RUN customer commands

[F Verschuren]

Hp (NL) contacted me and told me to install patch:
PHSS_34637

[F Verschuren]

THe patch ficked the error:
WARNING: It is not supported to handle two databases in one package....

Now we do not get anny erros but sap is not starting up so we still have no working sap cluster...

logfile:
May 4 10:54:58 - Node "nlxanc01": Adding IP address 10.217.32.26 to subnet 10.217.32.0
May 4 10:54:58 - Node "nlxanc01": Adding IP address 10.217.36.24 to subnet 10.217.36.0
May 4 10:54:58 - Node "nlxanc01": (sapwas_main): Entering SGeSAP start runtime steps ...
May 4 10:54:58 - Node "nlxanc01": (sapwas_main): /etc/cmcluster/UCR/sapwas.cntl: SGeSAP - B.04.01.00 - Last modified 08/10/05
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /etc/cmcluster.conf
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/sap.config
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/sap.functions
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /etc/cmcluster/sap.functions
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /opt/cmcluster/sap/SID/customer.functions
May 4 10:54:58 - Node "nlxanc01": (get_source): Found /etc/cmcluster/UCR/customer.functions
May 4 10:54:58 - Node "nlxanc01": (initialize): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (check_version): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (check_parameters): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper 10.217.32.26): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (check_parameters): Package will handle NFS services
May 4 10:54:58 - Node "nlxanc01": (ip_mapper vdcudUCR): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper vdcudUCR): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (ip_mapper): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (check_debug): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (check_access vdcudUCR /usr/sap/trans/bin): TRACE POINT
May 4 10:54:58 - Node "nlxanc01": (watchdog): Watchdog initiated (PID: 11416 Timeout: 200 secs)
May 4 10:54:58 - Node "nlxanc01": (is_node_alive vdcudUCR): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (check_access): Testing NFS setup ...
May 4 10:54:59 - Node "nlxanc01": (watchdog): Watchdog initiated (PID: 11428 Timeout: 200 secs)
May 4 10:54:59 - Node "nlxanc01": (check_access): /usr/sap/trans/bin accessible
May 4 10:54:59 - Node "nlxanc01": (app_handler start): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (check_own_app): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (stop_own_app 4): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (stop_other_inst): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (app_remove_shmem): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (start_saposcol): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (start_own_app): TRACE POINT
May 4 10:54:59 - Node "nlxanc01": (sapwas_main): Leaving SGeSAP start runtime steps

########### Node "nlxanc01": Package start completed at Thu May 4 10:54:59 METDST 2006 ###########

[F Verschuren]

I have pleased set -x in the sap files can you see why sap is not started? see attachment

[F Verschuren]

The probelm was in the sap.config
here we had configured he lines
TRANSRELOC=vdcudUCR
CIRELOC=vdcudUCR
DBRELOC=vdcudUCR
after removing those lines we got the folowing error:
WARNING: /usr/sap/UCR/SYS/exe/ctrun not accessible
so we Hashed out in sap.functions: check_access ${CTEXERELOC} "${CTEXEDIR}"

And sap was running!!!

Kind regards,

Freek Verschuren

[Andres Stickar]

You miss the . in the begining of the /etc/cmcluster//sapwas.cntl

The correct sentence is :

. /etc/cmcluster//sapwas.cntl start

Thats'll solve your problem with the IP

About the 2 databases in the same pakage, search the itrc with the error and you'll find the answer, is a bug in sap.functions.

Regards

Andrés

[F Verschuren]

close