1748156 Members
4364 Online
108758 Solutions
New Discussion юеВ

Re: Nagios not loading

 
Donna Firkser
Regular Advisor

Re: Nagios not loading

That message during Configure is expected/benign since the CMS is the only node you're monitoring. If you have other managed nodes you want to monitor (besides the CMS), then you need to assign an ICE-Linux license to those target nodes and run CRA on them. If you run Configure, Configure will push out the ICE-Linux management agents to the other target nodes.

When you run CRA you should only check the following 4 options. Everything else should be unchecked.
* Set read community string
* Set traps to refer to this instance...
* Configure SSH access authentication
* Host based authentication

And then select "Use the following credentials for all systems" and enter the root username and password.

I get the same "SSH_BAD_API_USAGE You must supply a valid username!" if I specify the incorrect root username and password for the CMS so please verify that you're using the correct root credentials for the CMS.

You should be able to launch Nagios now and see the CMS (aka nh) in the UI.

What happens when you try to launch Nagios?

If you can't launch Nagios, please send me the output from /etc/init.d/nagios status.

Thanks,
Donna
riyan
Frequent Advisor

Re: Nagios not loading

Hi Donna,

Sorry for the delay.I managed to run CRA successfully after changing the
PasswordAuthentication no to yes in the /etc/ssh/sshd_config file.after this i assigned licenses to 3 nodes (because i didn't get permission to run CRA on all the production servers) and ran Configure ICE-Linux Management Services.in the stdout i got

Collecting configuration information from managed systems ...
write 7986, 1, 4, eth0 to db => icelx1 (cms.cpstl.lk)
check_nrpe error: Connection refused by host => icelx3 (erpap101.cpstl.lk)
write 16054, 1, 4, bond0 to db => icelx2 (erpbk101.cpstl.lk)
Vars Warning - icelx2 vars.ini have been resynchronized Nodes icelx[2-3] did not respond

following is the output from nagios status

cms:/var/log # /etc/init.d/nagios status
Checking for nagios
NAGIOS OK: 1 process, status log updated 21 seconds ago
Checking for supermon: running
Checking for mon: running
Gathering status for nrpe ... icelx[1-3]
Error Connection refused by host - erpap101
Ok NRPE v2.12 - erpbk101,cms
Nagios nsca:
cms: 0 data packet(s) sent to host successfully.

when i tried to load nagios i am still getting same old ssl error.please let me know if you need any logs.

Thanks,
Riyan.
Donna Firkser
Regular Advisor

Re: Nagios not loading

Is apache2 running on your CMS?

# /etc/init.d/apache2 status

Do you see any errors in any of the apache2 log files.

# cd /var/log/apache2

I haven't seen this error before so I did some googling and found the information below. Can you please review this information and make sure your ssl set up is correct.

Please try stopping the firewall on your CMS and see if you are able to launch Nagios.

Can you also send me the contents of iceInstallerAnswers.

# cat /opt/hp/icelx/config/iceInstallerAnswers

Thanks,
Donna


-- INFO FOUND ON GOOGLE --
Error code: ssl_error_rx_record_too_long
Your SSL website may fail to load and display the error

Error code: ssl_error_rx_record_too_long

This usually means the implementation of SSL on your server is not correct. The error is usually caused by a server side problem which the server administrator will need to investigate.

Below are some things we recommend trying.

- Ensure that port 443 is open and enabled on your server. This is the standard port for https communications.

- If SSL is using a non-standard port then FireFox 3 can sometimes give this error. Ensure SSL is running on port 443.

- If using Apache2 check that you are using port 443 for SSL. This can be done by setting the ports.conf file as follows

├в clip ├в
Listen 80
Listen 443 https
├в clip ├в

- Make sure you do not have more than one SSL certificate sharing the same IP. Please ensure that all SSL certificates utilise their own dedicated IP.

- If using Apache2 check your vhost config. Some users have reported changing to _default_ resolved the error.

riyan
Frequent Advisor

Re: Nagios not loading

Hi Donna,

A power reboot to the CMS server and Apache restart sorted the issue :).I think may be some configuration was conflicting prior to the reboot.now nagios is working.But need to have a look and try to integrate other servers too.Will update you once everything is OK.Thanks for all the Patience and support.
Donna Firkser
Regular Advisor

Re: Nagios not loading

Good news. Let me know if you need help with anything else.

Thanks,
Donna
riyan
Frequent Advisor

Re: Nagios not loading

Hi Donna,
Problem again :(
any idea why i am getting this

cms:/opt/hptc/nagios/var # /opt/hptc/nagios/libexec/gather_all_data --verbose
write 7986, 1, 4, eth0 to db => icelx1 (cms.cpstl.lk)
check_nrpe error: Connection refused by host => icelx3 (erpap101.cpstl.lk)
write 16054, 1, 4, bond0 to db => icelx2 (erpbk101.cpstl.lk)




cms:/opt/hptc/nagios/var # /etc/init.d/nagios status
Checking for nagios
NAGIOS OK: 1 process, status log updated 34 seconds ago
Checking for supermon: running
Checking for mon: running
Gathering status for nrpe ... icelx[1-3]
Error Connection refused by host - erpap101
Ok NRPE v2.12 - erpbk101,cms
Nagios nsca:
cms: 0 data packet(s) sent to host successfully.
Donna Firkser
Regular Advisor

Re: Nagios not loading

It looks like you may have not run "Configure or Repair Agents" on icelx3 (erpap101.cpstl.lk) and therefore the ICE-Linux management agents didn't get pushed out to erpap101.

Check /var/log/mgmt.log on the CMS to see if you see any messages like "Warning: Cannot distribute pdsh keys to ...".

If you see this message, then you need to run Configure or Repair Agents on the target node and re-run Configure ICE-Linux Management Services.

Let me know how it goes.

Donna
riyan
Frequent Advisor

Re: Nagios not loading

CRA ran successfully.following is the stdout output for configure ICE-LX management services.I have attached mgmt log here.I don't see any error except some proxy connection.

Using node prefix 'icelx'
Reading cached number file /opt/hptc/database/etc/icelx/nodenumbers
Assigning node numbers
Rewriting cached number file /opt/hptc/database/etc/icelx/nodenumbers
Repopulating icelx_Servers
Repopulating icelx_Console_ports
Repopulating icelx_Enclosures
Adding ICE-Linux attributes to objects in
icelx_Servers
icelx_Console_ports
icelx_Enclosures
Creating /opt/hptc/etc/sysconfig/managementData.ini ...
Creating /etc/powerd.conf
Cluster Configuration - ICELX Cluster version HP icelx 2.11 20090610 r15422


Configuring system wide functions / policies / behaviors
Executing C02hptc_cluster_sfs sconfigure
Executing C02ssh_config sconfigure
Executing C10cluster_fstab sconfigure
Executing C20sysparams sconfigure
Executing C25syslimits sconfigure
Executing C66ibbond sconfigure
Executing C75mpiic sconfigure

Configuring service specific functions
Executing C05pdsh gconfigure
Executing C10hptc_cluster_fs gconfigure
Executing C30syslogng_forward gconfigure
Executing C50cmf gconfigure
Executing C50nagios gconfigure
You can create or modify nagios web accounts using the command:
# /usr/sbin/htpasswd2 /opt/hptc/nagios/etc/htpasswd.users nagiosadmin

Creating /opt/hptc/etc/sysconfig/managementData.ini ...
Executing C50supermond gconfigure
Executing C51nagios_monitor gconfigure
info: nconfig started
info: Executing on head node

info: Executing C10hptc_cluster_fs nconfigure
info: Executing C10hptc_cluster_fs_client nconfigure
info: Executing C30syslogng_forward nconfigure
info: Executing C50cmf nconfigure
info: Executing C50gather_data nconfigure
info: Executing C50nagios nconfigure
info: Executing C50supermond nconfigure
info: Executing C51nagios_monitor nconfigure
info: Executing C51nrpe nconfigure
info: Executing C30syslogng_forward cconfigure
info: Executing C50cmf cconfigure
info: Executing C50supermond cconfigure
info: nconfig shut down
info: nconfig started
info: Executing on head node

info: Executing C10hptc_cluster_fs nrestart
info: Executing C10hptc_cluster_fs_client nrestart
info: Executing C30syslogng_forward nrestart
info: Executing C50cmf nrestart
info: Executing C50gather_data nrestart
info: Executing C50nagios nrestart
info: Executing C50supermond nrestart
info: Executing C51nagios_monitor nrestart
info: Executing C51nrpe nrestart
info: Executing C30syslogng_forward crestart
info: Executing C50cmf crestart
info: Executing C50supermond crestart
info: nconfig shut down


setup_management_services started at - Apr 5 18:51:57


Create /opt/hptc/etc/sysconfig/managementData.ini ...

Create /opt/hptc/etc/sysconfig/vars.ini ...

Distribute ssh keys for pdsh...


Installing ICE-Linux Management Agents on nodes:
erpap101,erpbk101,cms

Build ID files ...
erpbk101: Warning: Permanently added 'erpbk101,10.10.10.41' (RSA) to the list of known hosts.
erpap101: Warning: Permanently added 'erpap101,10.10.10.21' (RSA) to the list of known hosts.
erpbk101: Warning: Permanently added 'erpbk101.cpstl.lk' (RSA) to the list of known hosts.
erpap101: Warning: Permanently added 'erpap101.cpstl.lk' (RSA) to the list of known hosts.
Building ID file for icelx1 (cms)
Building ID file for icelx2 (erpbk101)
Building ID file for icelx3 (erpap101)

Create /opt/hptc/supermon/etc/mon.conf ...

Create /opt/hptc/mgmt/tar/mgmt.tar ...

Push out install.sh...
Running tool cp_install_sh with job id 1758.
Task Name :defRunNowTaskId_1270473723916_78
Job ID :1758
Tool Name :cp_install_sh
Job State :Complete
User Name :root
Execute As User :root
Start Time :Monday, April 5, 2010 6:52:03 PM LKT
End Time :Monday, April 5, 2010 6:52:04 PM LKT
Elapsed Time : 118 milliseconds
Node :erpbk101.cpstl.lk
Status :Complete
Exit Code :-1
Files copied :2/2
Source :cms.cpstl.lk:/opt/hptc/mgmt/bin/install.sh
Destination :erpbk101.cpstl.lk:/opt/hptc/mgmt/bin/install.sh
Source :cms.cpstl.lk:/opt/mx/icle/icle.properties
Destination :erpbk101.cpstl.lk:/opt/hptc/mgmt/bin/icle.properties
STDOUT :


Node :erpap101.cpstl.lk
Status :Complete
Exit Code :-1
Files copied :2/2
Source :cms.cpstl.lk:/opt/hptc/mgmt/bin/install.sh
Destination :erpap101.cpstl.lk:/opt/hptc/mgmt/bin/install.sh
Source :cms.cpstl.lk:/opt/mx/icle/icle.properties
Destination :erpap101.cpstl.lk:/opt/hptc/mgmt/bin/icle.properties
STDOUT :



Run install.sh on managed systems ...
erpbk101: --18:53:55-- http://10.10.10.201:60000/management_data/vars.ini
erpbk101: => `/opt/hptc/etc/sysconfig/vars.ini'
erpap101: --18:53:38-- http://10.10.10.201:60000/management_data/vars.ini
erpap101: => `/opt/hptc/etc/sysconfig/vars.ini'
erpbk101: Connecting to 10.10.10.201:60000... connected.
erpbk101: HTTP request sent, awaiting response... 200 OK
erpbk101: Length: 3,515 (3.4K)
erpbk101:
erpap101: Connecting to 10.10.14.2:3128... connected.
erpbk101: 0K ... 100% 335.22 MB/s
erpbk101:
erpbk101: 18:53:55 (335.22 MB/s) - `/opt/hptc/etc/sysconfig/vars.ini' saved [3515/3515]
erpbk101:
erpbk101: --18:53:55-- http://10.10.10.201:60000/management_data/managementData.ini
erpbk101: => `/opt/hptc/etc/sysconfig/managementData.ini'
erpbk101: Connecting to 10.10.10.201:60000... connected.
erpap101: Proxy request sent, awaiting response... 407 Proxy Authentication Required
erpbk101: HTTP request sent, awaiting response... 200 OK
erpap101: 18:53:38 ERROR 407: Proxy Authentication Required.
erpap101:
erpbk101: Length: 452
erpbk101:
erpbk101: 0K 100% 71.84 MB/s
erpbk101:
erpbk101: 18:53:55 (71.84 MB/s) - `/opt/hptc/etc/sysconfig/managementData.ini' saved [452/452]
erpbk101:
erpap101: --18:53:38-- http://10.10.10.201:60000/management_data/managementData.ini
erpap101: => `/opt/hptc/etc/sysconfig/managementData.ini'
erpap101: Connecting to 10.10.14.2:3128... connected.
erpbk101: --18:53:55-- http://10.10.10.201:60000/management_data/mon.conf
erpbk101: => `/opt/hptc/supermon/etc/mon.conf'
erpbk101: Connecting to 10.10.10.201:60000... connected.
erpbk101: HTTP request sent, awaiting response... 200 OK
erpbk101: Length: 783
erpbk101:
erpbk101: 0K 100% 39.30 MB/s
erpbk101:
erpbk101: 18:53:55 (39.30 MB/s) - `/opt/hptc/supermon/etc/mon.conf' saved [783/783]
erpbk101:
erpap101: Proxy request sent, awaiting response... 407 Proxy Authentication Required
erpap101: 18:53:38 ERROR 407: Proxy Authentication Required.
erpap101:
erpap101: --18:53:38-- http://10.10.10.201:60000/management_data/mon.conf
erpap101: => `/opt/hptc/supermon/etc/mon.conf'
erpap101: Connecting to 10.10.14.2:3128... connected.
erpap101: Proxy request sent, awaiting response... 407 Proxy Authentication Required
erpap101: 18:53:38 ERROR 407: Proxy Authentication Required.
erpap101:
erpap101: /opt/hptc/mgmt/bin/install.sh: line 254: /etc/init.d/nrpe: No such file or directory
erpap101: /opt/hptc/mgmt/bin/install.sh: line 258: /opt/hptc/syslog-ng/etc/gconfig.d/syslog-setup: No such file or directory
erpap101: /opt/hptc/mgmt/bin/install.sh: line 259: /opt/hptc/syslog-ng/etc/gconfig.d/syslog-setup: No such file or directory
erpap101: /opt/hptc/mgmt/bin/install.sh: line 262: /opt/hptc/supermon/etc/init.d/mond-setup: No such file or directory
erpap101: /opt/hptc/mgmt/bin/install.sh: line 265: /etc/init.d/mond: No such file or directory
erpbk101: insserv: script ipmi.hp: service ipmidrv already provided!
erpbk101: MOND: Bound to socket 38154
----------------
erpap101
----------------

Configure and start management services ...

----------------
erpbk101
----------------

Configure and start management services ...

Shutting down NRPE service
Configuring NRPE
nrpe 0:off 1:off 2:off 3:on 4:off 5:on 6:off
Starting NRPE service
Configuring syslog-ng to forward events to syslog-ng aggregator
Shutting down syslog services..done
Starting syslog services..done
Starting the MON service: ..done

Collecting configuration information from managed systems ...
write 7986, 1, 4, eth0 to db => icelx1 (cms.cpstl.lk)
check_nrpe error: Connection refused by host => icelx3 (erpap101.cpstl.lk)
write 16054, 1, 4, bond0 to db => icelx2 (erpbk101.cpstl.lk)
Vars Warning - icelx2 vars.ini have been resynchronized Nodes icelx3 did not respond

Install Agents Done

Done
Donna Firkser
Regular Advisor

Re: Nagios not loading

What OS do you have installed on
erpap101.cpstl.lk?

e.g.
# cat /etc/redhat-release
OR
# cat /etc/SuSE-release

Can you log in to erpap101.cpstl.lk and send me the output from the install.sh command. Make sure you do this on erpap101 and not the CMS.

# cd /opt/hptc/mgmt/bin
# ./install.sh

Thanks,
Donna
riyan
Frequent Advisor

Re: Nagios not loading

OS is SLES 10 SP 3

Output from
erpap101# cat /etc/SuSE-release
SUSE Linux Enterprise Server 10 (x86_64)
VERSION = 10
PATCHLEVEL = 3
erpap101:/opt/hptc/mgmt/bin #

Output from .install.sh

erpap101:/opt/hptc/mgmt/bin # ./install.sh
--09:09:07-- http://10.10.10.201:60000/management_data/vars.ini
=> `/opt/hptc/etc/sysconfig/vars.ini'
Connecting to 10.10.14.2:3128... connected.
Proxy request sent, awaiting response... 407 Proxy Authentication Required
09:09:07 ERROR 407: Proxy Authentication Required.

--09:09:07-- http://10.10.10.201:60000/management_data/managementData.ini
=> `/opt/hptc/etc/sysconfig/managementData.ini'
Connecting to 10.10.14.2:3128... connected.
Proxy request sent, awaiting response... 407 Proxy Authentication Required
09:09:07 ERROR 407: Proxy Authentication Required.

--09:09:07-- http://10.10.10.201:60000/management_data/mon.conf
=> `/opt/hptc/supermon/etc/mon.conf'
Connecting to 10.10.14.2:3128... connected.
Proxy request sent, awaiting response... 407 Proxy Authentication Required
09:09:07 ERROR 407: Proxy Authentication Required.


Configure and start management services ...

./install.sh: line 254: /etc/init.d/nrpe: No such file or directory
./install.sh: line 258: /opt/hptc/syslog-ng/etc/gconfig.d/syslog-setup: No such file or directory
./install.sh: line 259: /opt/hptc/syslog-ng/etc/gconfig.d/syslog-setup: No such file or directory
./install.sh: line 262: /opt/hptc/supermon/etc/init.d/mond-setup: No such file or directory
./install.sh: line 265: /etc/init.d/mond: No such file or directory
erpap101:/opt/hptc/mgmt/bin #

is this something to do with the proxy configuration?

Thanks,
Riyan.