Problem with HP Systems Insight Manager initialization

[Davor Bira?]

Hy,

after I have install whole bundle T2414BA(HP Systems Insight Manager for HPUX) and Java2 SDK 1.4 for hpux, and all of that went well, I start with initialization of HP Systems Insight Manager, and command mxinitconfig -a was interrupted with this error:
7. Database Configuration
HP Systems Insight Manager shutting down: Lost connection to database. Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. for db loaded from database.props

Regards,
Davor

[PeterWolfe]

I'm seeing the exact same problem
on 11.23 with SIM V4.1... I had skipped
over the kernel tuning step during the
original install so just for yucks
I just ran the Java2 Out-of-Box but that
has not helped with the database error.

[PeterWolfe]

Poking around some more, I see
this in /var/opt/mx/logs/PgSQL_Config.log:

================= Run Postinstall ===============
Wed Sep 15 10:14:36 EDT 2004 begin postinstall PgSQL
Try to stop PostgreSQL first, maybe it's not started yet.
Stopping postgresql service:
Create database files.
Initializing database:

Starting postgresql service!
Stop PostgreSQL for reconfiguration.
Stopping postgresql service:
cp: cannot access /var/opt/iexpress/postgresql/pg_hba.conf: No such file or dire
ctory
Try to start PostgreSQL for configuration.
Initializing database:

Starting postgresql service!
Wed Sep 15 10:14:55 EDT 2004 end postinstall PgSQL

[hpuxsa]

Hello,

I am facing a similar problem. Could you please let me know if you have got a solution for this.

Thanks,
Franklin.

[David Libby_4]

I have exactly the same symptoms on my machine. I'm using the most recent 4.1 package "T2414BA_4.01.00.01_11.11.depot".

"/opt/mx/bin/mxinitconfig -a" runs okay until DB configuration. During which it falls over... and this is the last line left in /var/opt/mx/logs/initconfig.log

=============
8. Database Configuration
HP Systems Insight Manager shutting down: Lost connection to database. Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. for db loaded from database.props
==============

The bizarre thing is that I have already installed it on another similar machine in the same manner without any problems at all.

[David Libby_4]

Forgot to say that I'm on HP-UX 11.11

[Jose Javier Sianes Ruiz]

I have exactly the same problem instaling latest version of SIM on HPUX 11i. I even try to update PostGre DB with same error:

root@asterix:/root> /opt/mx/bin/mxinitconfig -a
Checking Prerequisites (15):
1. Check Kernel Parameters
- Requisite : Warning
2. Node Security File
- Requisite : Acceptable
3. Server Property File
- Requisite : Acceptable
4. Server Authentication Keys
- Requisite : Acceptable
5. SSH Keys
- Requisite : Acceptable
6. Status Property File
- Requisite : Acceptable
7. Task Results Output Cleanup
- Requisite : Acceptable
8. Database Configuration
- Requisite : Acceptable
9. Database Content
- Requisite : Acceptable
10. Setup Property File
- Requisite : Acceptable
11. Web Server
- Requisite : Acceptable
12. Setup Property File
- Requisite : Acceptable
13. Management Services
- Requisite : Acceptable
14. Agent Configuration
- Requisite : Acceptable
15. Database Population
- Requisite : Acceptable
Prerequisite scan completed successfully.
Configuring Server Components (15):
1. Check Kernel Parameters
- Successful
2. Node Security File
- Successful
3. Server Property File
- Successful
4. Server Authentication Keys
- Successful
5. SSH Keys
- Successful
6. Status Property File
- Successful
7. Task Results Output Cleanup
- Successful
8. Database Configuration
root@asterix:/root> echo $?
209
root@asterix:/root> tail -n 100 /var/opt/mx/logs/initconfig.log
5. SSH Keys
- Successful
6. Status Property File
- Successful
7. Task Results Output Cleanup
- Successful
8. Database Configuration
HP Systems Insight Manager shutting down: Lost connection to database. Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. for db loaded from database.props
root@asterix:/root> tail /var/opt/mx/logs/PgSQL_Config.log

================= Run Postinstall ===============
Wed Nov 10 13:08:30 MET 2004 begin postinstall PgSQL
Try to stop PostgreSQL first, maybe it's not started yet.
Stopping postgresql service:
Try to start PostgreSQL for configuration.

Starting postgresql service!
sh: $PGSQL_DIR/bin/pg_ctl -o -i -D /var/opt/iexpress/postgresql -p /opt/iexpress/postgresql/bin/postmaster start >> /var/opt/iexpress/postgresql/postgresql.log 2>&1: Cannot find or open the file.
Wed Nov 10 13:08:49 MET 2004 end postinstall PgSQL
root@asterix:/root>

[David Libby_4]

I have a call open with HP as soon as there's a result I'll post it here.

[Bernhard Mueller]

Davor and David,

what about this case? any news?

I found that thread searching the forums for the above error message and thought, well looks like I just need to wait a day or two, no use in wasting time on that myself...

Regards,
Bernhard

[David Libby_4]

HP are still working on it... the current engineer just asked me to run "mxinitconfig -a" again but with tracing switched on.

So I guess if you guys wanna do your own exploring... you could do the same and have a look in the .dbg files... (see below).

=====================
1. Edit the /etc/opt/mx/config/mx.properties file and add:
MX_DEBUG_TRACE=on

2. Verify that the mx daemons are not running:
# ps -ef | grep mx
[Should not be processes for mxdomainmgr, mxdtf, or mxagent.]

3. If the daemons are running, stop them:
# mxstop

4. Run mxinitconfig:
# /opt/mx/bin/mxinitconfig -a

5. Capture any output from the mxinitconfig command and send it in.

6. Disable debug: remove or comment out MX_DEBUG_TRACE=on from
the /etc/opt/mx/config/mx.properties file.

7. cd /var/opt/mx/logs

8. Send the debug files: *.dbg
====================

As promised will post any solutions as and when they come in...

[Bernhard Mueller]

David,

thanks for letting us know, that this thread won't turn into a dead end.

Appreciate your fast response.

Regards,
Bernhard

[Eric Herberholz]

fyi: check to see if the PostgreSQL.POSTGRESQL-SHA fileset is installed. For example, use: swlist -l fileset PostgreSQL.POSTGRESQL-SHA

If not installed, then this is known to cause this "Lost connection to database" symptom.

[David Libby_4]

Thanks for the suggestion Eric, but it's not the cause in this particular instance...

====================
root@s000 # swlist -l fileset PostgreSQL.POSTGRESQL-SHA
# Initializing...
# Contacting target "s000121"...
#
# Target: s000:/
#

PostgreSQL.POSTGRESQL-SHA A.01.00-7.3.1 PostgreSQL Share File
root@s000 #
===================

Still waiting for news from HP-Holland... will update when I get info.

[Richard Plourde_3]

I'm experiencing the same problems. HP-UX 11.11, HP Systems Insight Manager 4.1 with patch 1 - HP-UX C.04.01.00.01 ( 2004-08-12 11:54 ).

I pass the mxinitconfig -l. When I execute mxinitconfig -a, I get the error:

>"HP Systems Insight Manager shutting down: >Lost connection to database. Connectio
>n refused. Check that the hostname and port >are correct and that the postmaster
>is accepting TCP/IP connections. for db >loaded from database.props"

There's another log file, PgSQL_Config.log, which give some indication of whats going on:

>"Starting postgresql service!
>Stop PostgreSQL for reconfiguration.
>Stopping postgresql service:
>cp: cannot >access /var/opt/iexpress/postgresql/pg_hba.c>onf: No such file or directory
>Try to start PostgreSQL for configuration.
>Initializing database:

>Starting postgresql service!
>Wed Nov 24 14:45:43 EST 2004 end >postinstall PgSQL"

I look in the /var/opt/iexpress/postgresql directory and here are the file and their permissions:

-rw------- 1 postgres sys 369 Nov 24 14:45 pg_hba.conf
-rw------- 1 postgres sys 5186 Nov 24 14:45 postgresql.conf
-rw-r--r-- 1 postgres users 572 Nov 24 14:45 postgresql.log

I've switched on tracing and it produced a
"mxinitconfig-11-24-2004-14-44-56.dbg" file.
I tried to make some sense of it but no luck.

Debug file is attached to this note.

I will keep you posted on my findings!

Cheers!

[Bernhard Mueller]

Hi all,

exactly the same over here:
first I found what Eric mentioned, that a fileset was missing. Installed that and re-ran mxinitconfig.

Still the issue is unresolved. Same errors in the log file. Tried to fool with permissions under /var/opt/iexpress, however, that direcory and files get recreated upon setup...

David, I'd suggest you through the URL of this thread at HP Holland to get them going (and escalate the issue). The people here sure are only the top of an iceberg.

Regards,
Bernhard

[David Libby_4]

Okay will do that.... actually, had another response from them yesterday but was tied up on another project... have just followed another procedure and sent output for checking. Let's see....

[David Libby_4]

I just ran through this and sent output... but step 6 is a tricky one because our problem relates to db initialization failure...

============
Here is a method to get more information about
why mxinitconfig is failing with the PostgreSQL
database.

1. swremove ixPostgreSQL
2. swinstall iXPostgreSQL
3. cd /var/adm/sw/products/PostgreSQL/pfiles
4. Save backup copy:
# cp -p configure configure.orig
5. Edit configure:
a. Add the following line after line 1:
set -x
b. Change the following line from:
su postgres -c "/opt/iexpress/postgresql/bin/initdb -D
/var/opt/iexpress
/postgresql" 2>/dev/null 1>dev/null
to:
su postgres -c "/opt/iexpress/postgresql/bin/initdb -D
/var/opt/iexpress
/postgresql"
6. cd /opt/iexpress/postgresql/bin
7. Save backup copy:
# cp -p initdb initdb.orig
8. Edit initdb:
a. Change line 1 from:
#!/bin/sh
to:
#!/bin/ksh
b. Add the following line after line 1:
set -x
9. Rename the /var/opt/iexpress/postgresql directory:
# mv /var/opt/iexpress/postgresql /var/opt/iexpress/postgresql.bak
9. swconfig -u PostgreSQL
10. swconfig PostgreSQL
11. Capture the output of the command "swjob -a log <...>" as listed in the swconfig output from step 10:
# swjob -a log - @ :/ > /tmp/swcfg.out
12. Send /tmp/swcfg.out in for analysis.
13. Restore original configure and initdb scripts from backup copies.
======================

[David Libby_4]

Well the call I have open seems to have hit a dead end and and with a new version arriving in around a week it seems futile to carry on troubleshooting this.

So the long and the short of it is don't wait for a result from my direction.

[Richard Plourde_3]

Many thanks to Ute Kavanaugh, HPRC.

It's all in the order in which you install the different componants.

The manual:

http://www.docs.hp.com/hpux/onlinedocs/5990-8181/5990-8181.html

mentions 2 steps to install SIM:

1-swinstall -s /directory/depot T1458AA ixPostgreSQL T1471AA B8465BA

2-swinstall -s /directory/depot T2414BA

If the first step is omitted most of the configuration works but
mxinitconfig fails with the error you reported.
The following filesets should be on the system:

# swlist -l fileset ixPostgreSQL

ixPostgreSQL.PostgreSQL.HPUXIXWEBMIN
ixPostgreSQL.PostgreSQL.POSTGRESQL-DOC
ixPostgreSQL.PostgreSQL.POSTGRESQL-INC
ixPostgreSQL.PostgreSQL.POSTGRESQL-LIB
ixPostgreSQL.PostgreSQL.POSTGRESQL-MAN
ixPostgreSQL.PostgreSQL.POSTGRESQL-RUN
ixPostgreSQL.PostgreSQL.POSTGRESQL-SHA
ixPostgreSQL.PostgreSQL.POSTGRESQL-SRC

I would expect some of them to be missing. To resolve this,
the best approach is to completely remove the software
and left over files and reinstall:

# swremove T2414BA
# swremove T1458AA ixPostgreSQL T1471AA B8465BA

# rm -rf /opt/mx
# rm -rf /opt/hpwebadmin
# rm -rf /var/opt/mx
# rm -rf /var/opt/wbem
# rm -rf /var/opt/iexpress/postgresql
# rm -rf /etc/opt/mx
# rm -rf /etc/opt/wbem

Then reinstall first the database, ssh, wbem and java. This
command is all one line:
# swinstall -s /tmp/T2414BA_4.01.00_11.11.depot T1458AA ixPostgreSQL
T1471AA
B8465BA

Then install SIM:
# swinstall -s /tmp/T2414BA_4.01.00_11.11.depot T2414BA

Now mxinitconfig should complete:
# /opt/mx/bin/mxinitconfig -l
# /opt/mx/bin/mxinitconfig -a

Cheers!
Rikk

[David Libby_4]

Cool... thanks for that Rikk!

I'll give it a go...

[David Libby_4]

Hi Rikk,

I have just now removed *all* the associated packages except SSH and reinstalled using the exact sequence you outlined and *again* the DB bombs out... I'm gonna wait for 4.2.. apparently out next week.

================
root@s000121 # /opt/mx/bin/mxinitconfig -a
Checking Prerequisites (15):
1. Check Kernel Parameters
- Requisite : Acceptable
2. Node Security File
- Requisite : Acceptable
3. Server Property File
- Requisite : Acceptable
4. Server Authentication Keys
- Requisite : Acceptable
5. SSH Keys
- Requisite : Acceptable
6. Status Property File
- Requisite : Acceptable
7. Task Results Output Cleanup
- Requisite : Acceptable
8. Database Configuration
- Requisite : Acceptable
9. Database Content
- Requisite : Acceptable
10. Setup Property File
- Requisite : Acceptable
11. Web Server
- Requisite : Acceptable
12. Setup Property File
- Requisite : Acceptable
13. Management Services
- Requisite : Acceptable
14. Agent Configuration
- Requisite : Acceptable
15. Database Population
- Requisite : Acceptable
Prerequisite scan completed successfully.
Configuring Server Components (15):
1. Check Kernel Parameters
- Successful
2. Node Security File
- Successful
3. Server Property File
- Successful
4. Server Authentication Keys
- Successful
5. SSH Keys
- Loading public key algorithms
- JAVA version is 1.4.2.02
- Successful
6. Status Property File
- Successful
7. Task Results Output Cleanup
- Successful
8. Database Configuration
root@s000121 #
==========================

[Jose Javier Sianes Ruiz]

I solved the problem deleting all packages (except SSH), deleting also files includes in /opt related with PostGreSQL DataBase and installing all packages includes in SIM depot (except SSH). I have a more coherent reply, there must be something bad with this package and sometime runs, and others not. If next week a new package version is comming, better wait for it.

[Yogeeraj_1]

Thanks Rikk,

was having the same problem and did the steps as you outlined. It worked!

================
# /opt/mx/bin/mxinitconfig -a
Checking Prerequisites (15):
1. Check Kernel Parameters
- Requisite : Acceptable
2. Node Security File
- Requisite : Acceptable
3. Server Property File
- Requisite : Acceptable
4. Server Authentication Keys
- Requisite : Acceptable
5. SSH Keys
- Requisite : Acceptable
6. Status Property File
- Requisite : Acceptable
7. Task Results Output Cleanup
- Requisite : Acceptable
8. Database Configuration
- Requisite : Acceptable
9. Database Content
- Requisite : Acceptable
10. Setup Property File
- Requisite : Acceptable
11. Web Server
- Requisite : Acceptable
12. Setup Property File
- Requisite : Acceptable
13. Management Services
- Requisite : Acceptable
14. Agent Configuration
- Requisite : Acceptable
15. Database Population
- Requisite : Acceptable
Prerequisite scan completed successfully.
Configuring Server Components (15):
1. Check Kernel Parameters
- Successful
2. Node Security File
- Successful
3. Server Property File
- Successful
4. Server Authentication Keys
- Successful
5. SSH Keys
- Successful
6. Status Property File
- Successful
7. Task Results Output Cleanup
- Successful
8. Database Configuration
- Successful
9. Database Content
- Successful
10. Setup Property File
- Successful
11. Web Server
- Successful
12. Setup Property File
- Updating
- Successful
13. Management Services
- Updating
- Successful
14. Agent Configuration
- Successful
15. Database Population
- Current Status, % Completed : 10%
- Current Status, % Completed : 20%
- Current Status, % Completed : 20%
- Current Status, % Completed : 20%
- Current Status, % Completed : 45%
- Current Status, % Completed : 45%
- Current Status, % Completed : 45%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 50%
- Current Status, % Completed : 55%
- Current Status, % Completed : 55%
- Current Status, % Completed : 55%
- Current Status, % Completed : 55%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 60%
- Current Status, % Completed : 65%
- Current Status, % Completed : 65%
- Current Status, % Completed : 65%
- Current Status, % Completed : 65%
- Current Status, % Completed : 100%
- Successful
Completed all tasks successfully.
Details can be found in the log file at /var/opt/mx/logs/initconfig.log
#
==========================
cheers
Yogeeraj

[David Libby_4]

Hi Everyone,

It's working for me too now... but that level of clean-up should be managed by the package. I'm running 4.2 now and it's running fine so far.

Cleaning up very thoroughly and installing postgres first does work.

What made the difference in my case was manually stripping out /var/opt/iexpress/postgresql immediately after removing postgres with swremove.

Have fun.
David

[Ute Kavanaugh]

Hi,

I updated the ITRC document. There are less "rm" commands required than I originally thought and there is an issue with HP SIM 4.2 and kernel parameters. If anyone still encounters a similar problem while installing a new CMS please check:
USIMKBRC00016173
HP SIM Insight Manager, mxinitconfig fails Database Configuration

Kind regards

Ute