node is out of cluster due to DNS issue

[Sreer]

Hi Gurus,
Iam facing an issue in a cluster environment.

The DNS was updated in a wrong way so that the node seems failed.

But all packages in this node are up and running.


server1:/#cmviewcl
Permission denied to 127.0.0.1
cmviewcl: Cannot view the cluster configuration: No such file or directory.
Either this node is not configured in a cluster, user doesn't have
access to view the cluster configuration, or there is some obstacle
to viewing the configuration. Check the syslog file for more information.
For a list of possible causes, see the Serviceguard manual for cmviewcl.
server1:/#


Could you pls tell me how to recover from this issue?

I have corrected the resolv.conf by making its contents to its earlier state.

While the resolv.conf was changed it was not able to ping the node also.

pr 13 07:59:51 server1 cmclconfd[13466]: Unable to resolve local hostname server1 to determine the domain name


Apr 13 07:59:52 sn4730a cmclconfd[13467]: Unable to resolve local hostname server1 to determine the domain name


Now the error is rectified and name is getting resolved also.

But still the cmviewcl is giving errors.
as mentioned above.

Could you pls support urgently?

Thanks
Sree

[R.O.]

Hi,

Have you tried to start the node?

# cmrunnode server1

Regards,

[Sreer]

Hi,

No I did not.Because many packages are still running in this node.
Only issue is cmviewcl is just not running!!

All packages are still live!!!!

I cant move it to other nodes also due to few issues in resources.

Thanks
Sree

[Kapil Jha]

what are /etc/hosts file entries

127.0.0.1 localhost loopback

enter heartbeat and other members IP in hosts file as well.

BR,
Kapil+

[Kapil Jha]

Is it a new cluster,

what does /etc/cmcluster/cmnodelist says

BR,
Kapil+

[Sreer]

Hi,
Yes
there is host Ip as well as all the needed Ips are there [like when it was working earlier]

rgds sree

[R.O.]

What does it say the cmviewcl command executed from the other node?

[Sreer]

Hi,
Thanks for reply.
Its not a new cluster
The issue is happened only while inserted the wrong DNS entry in /etc/resolv.conf.
entries in
server1:/etc/cmcluster#cat cmclnodelist
server2 root
server3 root
server4 root
server 5 root
server6 root
server1:/etc/cmcluster#

[R.O.]

Is "server1" missing in file cmclnodelist?

[Kapil Jha]

Can you try to run
#inetd -c
second
#cmrunnode -v server1

This would not affect ur running package.

BR,
Kapil+