Permission Denied To access Node

[Mousa55]

Hi All,

When I try to create the cluster-wide ASCII configuration file, for two node by using this commands
# cd /etc/cmcluster
# cmquerycl –v –C cmclconfig.ascii –n ruxapp01 –n ruxerp01
but there a Failed to gather configuration information, you can see the output of the command

# cmquerycl -v -C cmclconfig.ascii -n ruxapp01 -n ruxerp01

Begin checking the nodes...
Looking for other clusters ... Done
Gathering configuration information ..
Gathering storage information ..
Found 14 devices on node ruxapp01
Found 0 devices on node ruxerp01
Analysis of 14 devices should take approximately 3 seconds
0%----10%----20%----30%----40%----50%----60%----70%----80%----90%----100%
Found 2 volume groups on node ruxapp01
Found 0 volume groups on node ruxerp01
Analysis of 2 volume groups should take approximately 1 seconds
0%----10%----20%----30%----40%----50%----60%----70%----80%----90%----100%
.....
Gathering Network Configuration ..... Done
Error: Permission denied accessing node ruxerp01.
Note: Disks were discovered which are not in use by either LVM or VxVM.
Use pvcreate(1M) to initialize a disk for LVM or,
use vxdiskadm(1M) to initialize a disk for VxVM.
Error: Permission denied accessing node ruxerp01.
Error: Permission denied accessing node ruxerp01.
Error: Unable to determine network configuration: failed to setup for probing the network on node ruxerp01: Permission denied
Failed to probe network
Warning: Network interface lan0 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan1 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan2 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan3 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan4 on node ruxapp01 couldn't talk to itself.
Failed to gather configuration information.

And also I configured /.rhosts and /etc/cmcluster/cmclnodelist in order to access the remote node

How to solve this problem?


Thanks & kind Regards

[Suraj K Sankari]

Hi,

Are you able to rlogin into ruxerp01 node ?
if yes then using linkloop check all the network card.

Suraj

[Mousa55]

Hi All,

yes i can able to rlogin into ruxerp01 node

but the linkloop command it is need option to work and i don't konw how to use it

thanks

[Michal Kapalka (mikap)]

hi,

for link loop check this thread:

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1340268

mikap

[Mousa55]

Hi All,

all network intrface it is working, i am check with ifconfig command and i can ping from node 1 to node 2 by a 2 networkcard
(primary and heartbeat)and also from node2 to node1



thanks

[Asif Sharif]

Hi Nejad,

First you need to give lanscan command and see the Station Address.

# lanscan
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
0/1/2/0 0x0014C21062D4 0 UP lan0 snap0 1 ETHER Yes 119
0/2/1/0 0x0017A451DE08 1 UP lan1 snap1 2 ETHER Yes 119
0/2/1/1 0x0017A451DE09 2 UP lan2 snap2 3 ETHER Yes 119
# linkloop 0x0014C21062D4
Link connectivity to LAN station: 0x0014C21062D4
-- OK
#

What OS release you are using and did you update the patches?

Regards,
Asif Sharif

[Mousa55]

Hi All,

Only in the heartbeat card there some a problem, although I can ping on this ip in same node and another node
linkloop 0x0016353E459D
Link connectivity to LAN station: 0x0016353E459D
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1

and I have 11.11 OS version and it is updated to latest bundle.
And I have 11.16 SG

Thanks & kind Regards

[Asif Sharif · Accepted solution]

-- FAILED --

That means there is network (e.g. cable/port etc) issue. Please check with your network team.

Regards,
Asif Sharif

[Mousa55]

Hi All,

this is not a network problem because this a heartbeat network card and I am connect a cable between
two server
and this error appeared in all card of node in a cluster.
And I have another cluster and execute this command and the error appeared.

Thanks & kind Regards

[Aneesh Mohan]

Hi Nejad,

Please check and apply the pre-requisties for 11.16 version.


Patches required for 11.16
-----------------------------
PHCO_29605
PHKL_30686
PKSS_30687
PHSS_30688
PHSS_30966
PHCO_27957
PHCO_28693
PHCO_29379
PHCO_30834
PHKL_26719
PHKL_27532
PHKL_27727
PHKL_28114
PHKL_28695
PHKL_28984
PHKL_29527
PHKL_29704
PHKL_29981
PHKL_30032
PHKL_30033
PHKL_30035
PHKL_30036
PHKL_30510
PHKL_30037
PHKL_30511
PHKL_30622
PHKL_30833
PHNE_24384
PHNE_28328
PHNE_28778
PHNE_28799
PHSS_28880
PHNE_29887
PHNE_29945
PHSS_28509
PHSS_31015
PHSS_26056

Thanks,
Aneesh

[John Bigg]

99% of premission denied problems are due to not setting up /etc/hosts or DNS correctly. You need the hostname as an alias on ALL interface primary addresses on all nodes in the cluster.

See http://docs.hp.com/en/B3936-90079/ch05s01.html#babcccdh

[Mousa55]

Hi All,

this the /etc/hosts entry of node 1

10.8.1.56 ruxapp01.sp.local ruxapp01
10.8.1.69 ruxerp01.sp.local ruxerp01
192.168.1.30 ruxapp01-heartbeat
192.168.1.31 ruxerp01-heartbeat
127.0.0.1 localhost loopback

and of node 2

10.8.1.69 ruxerp01.sp.local ruxerp01
10.8.1.56 ruxapp01.sp.local ruxapp01
192.168.1.31 ruxerp01-heartbeat
192.168.1.30 ruxapp01-heartbeat
127.0.0.1 localhost loopback
10.8.33.251 itprt
10.15.9.92 rhom rhom.sp.local # HP OpenView Operations Mgt

and also of cmclnodelist for both node

# more cmclnodelist
ruxapp01 root
ruxerp01 root

thanks

[kemo]

nejad.

your problem may be because of one the following.

1- one network interface is configured as 0.0.0.0.

please check ifconfig lan0 , ifconfig lan1 and .....
if you found any network interface with ip 0.0.0.0 so unplumb it using for example lan2 is 0.0.0.0
ifconfig lan2 unplumb

2- check /usr/adm/inetd.sec and check the content. you should allow nodes in this file.

3- check $HOME/.rhosts and /etc/hosts.equiv if u are not using /etc/cmcluster/cmnodelist.


thanks
kemo

[Suraj K Sankari]

Hi,
what about your syslog.log says did you get any error at syslog.

here how you can used linkloop
1st do
# lanscan
then use linkloop
linkloop â i

see this
# linkloop â i 2 0x00108318AFED #linkloop â i
Link connectivity to LAN station: 0x00108318AFED

Check all the nic card

Suraj

[Mousa55]

Hi all,

the problem is still, i cant create the ascii file. because this error
Gathering Network Configuration ..... Done
Error: Permission denied accessing node ruxerp01.
Note: Disks were discovered which are not in use by either LVM or VxVM.
Use pvcreate(1M) to initialize a disk for LVM or,
use vxdiskadm(1M) to initialize a disk for VxVM.
Error: Permission denied accessing node ruxerp01.
Error: Permission denied accessing node ruxerp01.
Error: Unable to determine network configuration: failed to setup for probing the network on node ruxerp01: Permission denied
Failed to probe network
Warning: Network interface lan0 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan1 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan2 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan3 on node ruxapp01 couldn't talk to itself.
Warning: Network interface lan4 on node ruxapp01 couldn't talk to itself.
Failed to gather configuration information.

Note: I configured /.rhosts and /etc/cmcluster/cmclnodelist that to avoide the password when i try to access the remote node.

thanks

[kemo]

hi nejad

this actually happened if you recovered this system once using ignite backup.

can you please put the output of these command.

ifconfig lan0
ifconfig lan1
ifconfig lan2
ifconfig lan3

in both nodes.

also attach syslog.log to clearly finalize the problem.
and etc/hosts

thank you

[kemo]

hi

also u didn't replied regarding inetd.sec this is very important for security through the network.

thanks

[Mousa55]

Hi All,,

The first Node:

# ifconfig lan0
ifconfig: no such interface
# ifconfig lan1
lan1: flags=1843
inet 192.168.1.30 netmask ffffff00 broadcast 192.168.1.255
# ifconfig lan2
ifconfig: no such interface
# ifconfig lan3
lan3: flags=1843
inet 10.8.1.56 netmask ffffff00 broadcast 10.8.1.255
# ifconfig lan4
ifconfig: no such interface

0.8.1.56 ruxapp01.sp.local ruxapp01
10.8.1.69 ruxerp01
192.168.1.30 ruxapp01-heartbeat
192.168.1.31 ruxerp01-heartbeat
127.0.0.1 localhost loopback

And second Node:

# ifconfig lan0
ifconfig: no such interface
# ifconfig lan1
lan1: flags=1843
inet 192.168.1.31 netmask ffffff00 broadcast 192.168.1.255
# ifconfig lan2
ifconfig: no such interface
# ifconfig lan3
lan3: flags=1843
inet 10.8.1.69 netmask ffffff00 broadcast 10.8.1.255
# ifconfig lan4
ifconfig: no such interface

10.8.1.69 ruxerp01.sp.local ruxerp01
10.8.1.56 ruxapp01
192.168.1.31 ruxerp01-heartbeat
192.168.1.30 ruxapp01-heartbeat
127.0.0.1 localhost loopback
10.8.33.251 itprt
10.15.9.92 rhom rhom.sp.local # HP OpenView Operations Mgt

Thanks & kind Regards

[Asif Sharif]

Hi Nejad,

did you check the network, pls. post the output of lanscan and linkloop of all the interfaces.

Regards,
Asif Sharif

[Suraj K Sankari]

Hi,
please post this outputs

1.netstat -in
2.netstat -rn
3.lanscan
4.linkloop to all lan card which are up

Suraj

[Mousa55]

Hi All,

Thanks for all replay, but I think the problem not in the network because I can ping
To both nodes by using a LAN card and Heartbeat card without problem.
And I can to rlogin to both node without password, a I configured the /etc/cmcluster/cmclnodelist
In both node.
Note: I am connect the Heartbeat card between two server by strate cable not a cross cable.
And please find the attached file for all the output command.


Thanks & kind Regards

[johnsonpk]

Seems You have problem in your Heart beat network.How you connected the HB ? node1 to node2 directly or through switch ?
if directly ,you should use cross cable. please paste the output of below commands

on Node1(ruxapp01)

#linkloop -i 1 0x0015605EE10C
#linkloop 0x0017A43D1856 0x0015605EE10C 0x0015605EE10C 0x0016353E21D2 0x001321EAC998 0x001321EAC968


on node2 (ruxerp01)
#linkloop -i 1 0x0016353E459D
#linkloop 0x0017A43D3812 0x0016353E459D 0x0016353EA074 0x001321EA6945 0x001321EAA9

Thanks!!
Johnson

[Mousa55]

Hi All,

I am connect the heartbeat from lan 1 in cabinet 0 to lan 1 in cabinet 8 by strate cable, and I am try to use cross cable
But the two lan in both nodes are disabled and I am tried to enabled but I canâ t.
After that I am using the strate cable.

on Node1(ruxapp01)

# linkloop -i 1 0x0015605EE10C
Link connectivity to LAN station: 0x0015605EE10C
-- OK
#
# linkloop 0x0017A43D1856 0x0015605EE10C 0x0015605EE10C 0x0016353E21D2 0x001321EAC998 0x001321EAC968
Link connectivity to LAN station: 0x0017A43D1856
-- OK
Link connectivity to LAN station: 0x0015605EE10C
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1
Link connectivity to LAN station: 0x0015605EE10C
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1
Link connectivity to LAN station: 0x0016353E21D2
-- OK
Link connectivity to LAN station: 0x001321EAC998
-- OK
Link connectivity to LAN station: 0x001321EAC968
-- OK
# lanscan
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
1/0/0/1/0 0x0017A43D3812 0 UP lan0 snap0 1 ETHER Yes 119
1/0/8/1/0/6/0 0x0016353E459D 1 UP lan1 snap1 2 ETHER Yes 119
1/0/10/1/0/6/0 0x0016353EA074 2 UP lan2 snap2 3 ETHER Yes 119
1/0/12/1/0 0x001321EA6945 3 UP lan3 snap3 4 ETHER Yes 119
1/0/14/1/0 0x001321EAA938 4 UP lan4 snap4 5 ETHER Yes 119

on node2 (ruxerp01)

# linkloop -i 1 0x0016353E459D
Link connectivity to LAN station: 0x0016353E459D
-- OK
# linkloop 0x0017A43D3812 0x0016353E459D 0x0016353EA074 0x001321EA6945 0x001321EAA9
Link connectivity to LAN station: 0x0017A43D3812
-- OK
Link connectivity to LAN station: 0x0016353E459D
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1
Link connectivity to LAN station: 0x0016353EA074
-- OK
Link connectivity to LAN station: 0x001321EA6945
-- OK
Link connectivity to LAN station: 0x001321EAA9
error: get_msg2 getmsg failed, errno = 4
-- FAILED
frames sent : 1
frames received correctly : 0
reads that timed out : 1
# lanscan
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
3/0/0/1/0 0x0017A43D1856 0 UP lan0 snap0 1 ETHER Yes 119
3/0/8/1/0/6/0 0x0015605EE10C 1 UP lan1 snap1 2 ETHER Yes 119
3/0/10/1/0/6/0 0x0016353E21D2 2 UP lan2 snap2 3 ETHER Yes 119
3/0/12/1/0 0x001321EAC998 3 UP lan3 snap3 4 ETHER Yes 119
3/0/14/1/0 0x001321EAC968 4 UP lan4 snap4 5 ETHER Yes 119

Thanks & kind Regards

[Mousa55]

Hi All,

i am now using a cross cable directly between a two node (server)
but the the problem is still??!!

How solve it ?

thanks

[johnsonpk]

Hi,
Did u try executing linkloop after connecting the cross cables?Is that interface is up and configured with IP?Your lan1 fails on both nodes where ur HB is configured!! try unplugging and do linkloop,try to use any other free NIC for HB

U also may need to check the below on both nodes

#grep -e "ident" -e "hacl" /etc/inetd.conf
#cat /var/adm/inetd.sec
#what /usr/lbin/cmcld

Thanks!!
Johnson