HPE Community read-only access December 15, 2018
This is a maintenance upgrade. You will be able to read articles and posts, but not post or reply.
Hours:
Dec 15, 4:00 am to 10:00 am UTC
Dec 14, 10:00 pm CST to Dec 15, 4:00 am CST
Dec 14, 8:00 pm PST to Dec 15, 2:00 am PST
System Administration
cancel
Showing results for 
Search instead for 
Did you mean: 

node is out of cluster due to DNS issue

 
Sreer
Valued Contributor

node is out of cluster due to DNS issue

Hi Gurus,
Iam facing an issue in a cluster environment.

The DNS was updated in a wrong way so that the node seems failed.

But all packages in this node are up and running.


server1:/#cmviewcl
Permission denied to 127.0.0.1
cmviewcl: Cannot view the cluster configuration: No such file or directory.
Either this node is not configured in a cluster, user doesn't have
access to view the cluster configuration, or there is some obstacle
to viewing the configuration. Check the syslog file for more information.
For a list of possible causes, see the Serviceguard manual for cmviewcl.
server1:/#


Could you pls tell me how to recover from this issue?

I have corrected the resolv.conf by making its contents to its earlier state.

While the resolv.conf was changed it was not able to ping the node also.

pr 13 07:59:51 server1 cmclconfd[13466]: Unable to resolve local hostname server1 to determine the domain name


Apr 13 07:59:52 sn4730a cmclconfd[13467]: Unable to resolve local hostname server1 to determine the domain name


Now the error is rectified and name is getting resolved also.

But still the cmviewcl is giving errors.
as mentioned above.

Could you pls support urgently?

Thanks
Sree
10 REPLIES
R.O.
Esteemed Contributor

Re: node is out of cluster due to DNS issue

Hi,

Have you tried to start the node?

# cmrunnode server1

Regards,
"When you look into an abyss, the abyss also looks into you"
Sreer
Valued Contributor

Re: node is out of cluster due to DNS issue

Hi,

No I did not.Because many packages are still running in this node.
Only issue is cmviewcl is just not running!!

All packages are still live!!!!

I cant move it to other nodes also due to few issues in resources.

Thanks
Sree
Kapil Jha
Honored Contributor

Re: node is out of cluster due to DNS issue

what are /etc/hosts file entries

127.0.0.1 localhost loopback

enter heartbeat and other members IP in hosts file as well.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Kapil Jha
Honored Contributor

Re: node is out of cluster due to DNS issue

Is it a new cluster,

what does /etc/cmcluster/cmnodelist says

BR,
Kapil+
I am in this small bowl, I wane see the real world......
Sreer
Valued Contributor

Re: node is out of cluster due to DNS issue

Hi,
Yes
there is host Ip as well as all the needed Ips are there [like when it was working earlier]

rgds sree
R.O.
Esteemed Contributor

Re: node is out of cluster due to DNS issue

What does it say the cmviewcl command executed from the other node?
"When you look into an abyss, the abyss also looks into you"
Sreer
Valued Contributor

Re: node is out of cluster due to DNS issue

Hi,
Thanks for reply.
Its not a new cluster
The issue is happened only while inserted the wrong DNS entry in /etc/resolv.conf.
entries in
server1:/etc/cmcluster#cat cmclnodelist
server2 root
server3 root
server4 root
server 5 root
server6 root
server1:/etc/cmcluster#
R.O.
Esteemed Contributor

Re: node is out of cluster due to DNS issue

Is "server1" missing in file cmclnodelist?
"When you look into an abyss, the abyss also looks into you"
Kapil Jha
Honored Contributor

Re: node is out of cluster due to DNS issue

Can you try to run
#inetd -c
second
#cmrunnode -v server1

This would not affect ur running package.

BR,
Kapil+
I am in this small bowl, I wane see the real world......
S.N.S
Valued Contributor

Re: node is out of cluster due to DNS issue

Sree,

Give me
1. related syslogs
2. cmviewcl from fully functional node

3. was anything else at all that was done related to the cluster - like moving the cluster config file?

Do it soon

HTH
SNS
"Genius is 1% inspiration, 99% Perspiration" - Edison