Inetd takes about half an hour to start

[Roberto Martinez_6]

Hi, we have an rp7410 box, hpux 11i, NO dns configured (just /etc/hosts). When I reboot the server, inetd takes about 20-30 minutes to finish the start (to end printing messages in syslog).
During that period of time, no inetd services are available (telnet ,ftp, chargen, echo, ...), but if I try to telnet to the server I don't get a "connection refused" error, but a "connected to xxxx, escape character is ^[, and it stays stuck there (same thing for ftp). At that moment, netstat -a shows the telnet and ftp connections as ESTABLISHED.
No errors or warnings in the syslog. Only after 20-30 mins. after booting, the server starts responding to telnet.
Any hints? There's no DNS resolution, just /etc/hosts, I have double-checked resolv.conf and nsswitch.conf.

NOTE to Bill Hassell and Gerhard Roets: My ITRC ID has been changed so I cant assign you points for your help in thread 831710. Please post an answer to this thread so I can give you the points.

[Steve Steel]

Hi


If you do not have it add PHNE_31097
to your machine and try again

Steve Steel

[Jdamian]

More information needed...

1. may you post those messages from inetd in syslog.log ?
2. may you check /etc/rc.log file ?
3. when does it ocurr since ?
4. Is it named daemon running ?

[Roberto Martinez_6]

answers:

1. I enclose the first lines of syslog since boot on March 9. I killed inetd a coouple of times, as you can see.
The typical behaviour can be seen with inetd with pid 2734: apparently starts without errors, then some "above message repeats x times" messages appear, and in this case does not finish to start services after 19 minutes. in all this period of time no telnet,ftp, etc. is available.
The error "no buffer space available" does not show until 19 minutes after starting.
finally, at 09:11:38, ftp (and the rest of services) are available.

I've replaced the name of the server and several ip addresses. NO dnsnames anywhere, there are just IP addresses.

2. /etc/rc.log has no warning or errors. I enclose you rc.txt

3. Not sure, since the server is relatively new and I was not in charge for it until I had to modify several kernel parameters (see thread 831710. Initially I thought this change was the culprit, but I'm in doubt now. The server is relatively new, so it may have happened since os installation.

4. named is NOT running.

5. Patch PHNE: not sure if it's already installed, I have:
Required Patch Bundle for HP-UX 11i, June 2003

[Stephen Keane]

Just one thing, on your attached log files, did you strip the hostname for security reasons, or does your syslog.log really say ?

[Roberto Martinez_6]

just for security reasons. The server name, as it's in /etc/hosts, appears instead of . same for ip addresses. NO dns names, every xx.xx.xx.xx corresponds to an ip address.

[Henk Geurts]

hi Roberto

just a suggestion:
as the inetd seems to take a long time to start
the registrar, recserv and swat service
comment them out in the inetd.conf
and reboot.
see what happens, it might give a clue...

Henk

[Roberto Martinez_6]

It's a production server, as soon as I can reboot I'll do the changes, but not able to do it by now.

[Henk Geurts]

can you post /etc/services ?

[Roberto Martinez_6]

# @(#)B.11.11_LRservices $Revision: 1.32.214.7 $ $Date: 97/09/10 14:50:42 $
#
# This file associates official service names and aliases with
# the port number and protocol the services use.
#
# Some of the services represented below are not supported on HP-UX.
# They are provided solely as a reference.
#
# The form for each entry is:
#
#
# See the services(4) manual page for more information.
# Note: The entries cannot be preceded by a blank space.
#
tcpmux 1/tcp # TCP port multiplexer (RFC 1078)
echo 7/tcp # Echo
echo 7/udp #
discard 9/tcp sink null # Discard
discard 9/udp sink null #
systat 11/tcp users # Active Users
daytime 13/tcp # Daytime
daytime 13/udp #
qotd 17/tcp quote # Quote of the Day
chargen 19/tcp ttytst source # Character Generator
chargen 19/udp ttytst source #
ftp-data 20/tcp # File Transfer Protocol (Data)
ftp 21/tcp # File Transfer Protocol (Control)
telnet 23/tcp # Virtual Terminal Protocol
smtp 25/tcp # Simple Mail Transfer Protocol
time 37/tcp timeserver # Time
time 37/udp timeserver #
rlp 39/udp resource # Resource Location Protocol
whois 43/tcp nicname # Who Is
domain 53/tcp nameserver # Domain Name Service
domain 53/udp nameserver #
bootps 67/udp # Bootstrap Protocol Server
bootpc 68/udp # Bootstrap Protocol Client
tftp 69/udp # Trivial File Transfer Protocol
rje 77/tcp netrjs # private RJE Service
finger 79/tcp # Finger
http 80/tcp www # World Wide Web HTTP
http 80/udp www # World Wide Web HTTP
link 87/tcp ttylink # private terminal link
supdup 95/tcp #
hostnames 101/tcp hostname # NIC Host Name Server
tsap 102/tcp iso_tsap iso-tsap # ISO TSAP (part of ISODE)
pop 109/tcp postoffice pop2 # Post Office Protocol - Version 2
pop3 110/tcp pop-3 # Post Office Protocol - Version 3
portmap 111/tcp sunrpc # SUN Remote Procedure Call
portmap 111/udp sunrpc #
ident 113/tcp authentication # RFC1413
sftp 115/tcp # Simple File Transfer Protocol
uucp-path 117/tcp # UUCP Path Service
nntp 119/tcp readnews untp # Network News Transfer Protocol
ntp 123/udp # Network Time Protocol
netbios_ns 137/tcp # NetBIOS Name Service
netbios_ns 137/udp #
netbios_dgm 138/tcp # NetBIOS Datagram Service
netbios_dgm 138/udp #
netbios_ssn 139/tcp # NetBIOS Session Service
netbios_ssn 139/udp #
bftp 152/tcp # Background File Transfer Protocol
snmp 161/udp snmpd # Simple Network Management Protocol Agent
snmp-trap 162/udp trapd # Simple Network Management Protocol Traps
bgp 179/tcp # Border Gateway Protocol
# PV performance tool services entries
pvserver 382/tcp # PV server
pvalarm 383/tcp # PV alarm management
# Ports for IPSec
isakmp 500/tcp isakmp # IPSec Key Management (ISAKMP)
isakmp 500/udp isakmp # IPSec Key Management (ISAKMP)
#
# UNIX services
#
biff 512/udp comsat # mail notification
exec 512/tcp # remote execution, passwd required
login 513/tcp # remote login
who 513/udp whod # remote who and uptime
shell 514/tcp cmd # remote command, no passwd used
syslog 514/udp # remote system logging
printer 515/tcp spooler # remote print spooling
talk 517/udp # conversation
ntalk 518/udp # new talk, conversation
route 520/udp router routed # routing information protocol
efs 520/tcp # Extended file name server
timed 525/udp timeserver # remote clock synchronization
tempo 526/tcp newdate #
courier 530/tcp rpc #
conference 531/tcp chat #
netnews 532/tcp readnews #
netwall 533/udp # Emergency broadcasting
uucp 540/tcp uucpd # uucp daemon
remotefs 556/tcp rfs_server rfs # Brunhoff remote filesystem
ingreslock 1524/tcp #
#
# Other HP-UX services
#
lansrm 570/udp # SRM/UX Server
DAServer 987/tcp # SQL distributed access
instl_boots 1067/udp # installation bootstrap protocol server
instl_bootc 1068/udp # installation bootstrap protocol client
nfsd-keepalive 1110/udp # Client status info
nfsd-status 1110/tcp # Cluster status info
msql 1111/tcp # Mini SQL database server
rlb 1260/tcp # remote loopback diagnostic
clvm-cfg 1476/tcp # HA LVM configuration
diagmond 1508/tcp # Diagnostic System Manager
nft 1536/tcp # NS network file transfer
sna-cs 1553/tcp # SNAplus client/server
sna-cs 1553/udp # SNAplus client/server
ncpm-pm 1591/udp # NCPM Policy Manager
ncpm-hip 1683/udp # NCPM Host Information Provider
cvmon 1686/udp # Clusterview cvmon-cvmap communication
registrar 1712/tcp # resource monitoring service
registrar 1712/udp # resource monitoring service
ncpm-ft 1744/udp # NCPM File Transfer
psmond 1788/tcp # Predictive Monitor
psmond 1788/udp # Hardware Predictive Monitor
pmlockd 1889/tcp # SynerVision locking daemon
pmlockd 1889/udp #
nfsd 2049/udp # NFS remote file system
nfsd 2049/tcp # NFS remote file system
netdist 2106/tcp # update(1m) network distribution service
cvmmon 2300/tcp # ClusterView Management cluster support
hp-clic 3384/tcp #Cluster Management Services
hp-clic 3384/udp #Hardware Management
rfa 4672/tcp # NS remote file access
veesm 4789/tcp # HP VEE service manager
hacl-hb 5300/tcp # High Availability (HA) Cluster heartbeat
hacl-gs 5301/tcp # HA Cluster General Services
hacl-cfg 5302/tcp # HA Cluster TCP configuration
hacl-cfg 5302/udp # HA Cluster UDP configuration
hacl-probe 5303/tcp # HA Cluster TCP probe
hacl-probe 5303/udp # HA Cluster UDP probe
hacl-local 5304/tcp # HA Cluster Commands
hacl-test 5305/tcp # HA Cluster Test
hacl-dlm 5408/tcp # HA Cluster distributed lock manager
omni 5555/tcp # HP OpenView OmniBack
lanmgrx.osB 5696/tcp # LAN Manager/X for B.00.00 OfficeShare
r4-sna-cs 5707/tcp # SNA client/server (up to Release 4.1)
SNAplus 5708/udp # SNA logical network A (up to Release 4.1)
r4-sna-ft 5709/tcp # SNA file transfer (up to Release 4.1)
hcserver 5710/tcp # HP Cooperative Services
grmd 5999/tcp # graphics resource manager
spc 6111/tcp # sub-process control
desmevt 6868/tcp # DE/ Services Monitor, Event Service
pdclientd 6874/tcp # Palladium print client daemon
pdeventd 6875/tcp # Palladium print event daemon
iasqlsvr 7489/tcp # Information Access
recserv 7815/tcp # SharedX Receiver Service
p7_c33upd 8545/tcp #TSD acceSS7 configuration update RPC server
p7_c33 8546/tcp #TSD acceSS7 configuration RPC server
p7_c32 8547/tcp #TSD acceSS7 communications status RPC server
p7_c35 8548/tcp #TSD acceSS7 communications configuration RPC server
p7_g06 8549/tcp #TSD acceSS7 application version registration RPC server
p7_e30 8550/tcp #TSD acceSS7 event manager RPC server
comms_normal 8551/tcp # acceSS7 normal priority messages
comms_high 8552/tcp # acceSS7 high priority messages
c34_main 8553/udp # acceSS7 Inter-Server messages
ftp-ftam 8868/tcp # FTP->FTAM Gateway
mcsemon 9999/tcp # MC/System Environment monitor
console 10000/tcp # MC/System Environment console multiplexor
actcp 31766/tcp # ACT Call Processing Server
SrpSiteDaemon 6178/tcp # acceSS7 Statistics Remote Site query daemon
SrpCentralDaemon 6179/tcp # acceSS7 Statistics Central Server query daemon
erdb_svr 35100/tcp # acceSS7 Statistics Central Database
erdb_bck 35101/tcp # acceSS7 Statistics Database Backup
hp-sco 19410/tcp # HP SCO port number
hp-sco 19410/udp # HP SCO port number
hp-sca 19411/tcp # HP SCA port number
hp-sca 19411/udp # HP SCA port number

#
# Kerberos (Project Athena/MIT) services
#
kerberos5 88/udp kdc # Kerberos 5 kdc
klogin 543/tcp # Kerberos rlogin -kfall
kshell 544/tcp krcmd # Kerberos remote shell -kfall
ekshell 545/tcp krcmd # Kerberos encrypted remote shell -kfall
kerberos 750/udp kdc # Kerberos (server) udp -kfall
kerberos 750/tcp kdc # Kerberos (server) tcp -kfall
kerberos_master 751/tcp kadmin # Kerberos kadmin
krbupdate 760/tcp kreg # Kerberos registration -kfall
kpasswd 761/tcp kpwd # Kerberos "passwd" -kfall
eklogin 2105/tcp # Kerberos encrypted rlogin -kfall
# The X10_LI server for each display listens on ports 5800 + display number.
# The X10_MI server for each display listens on ports 5900 + display number.
# The X11 server for each display listens on ports 6000 + display number.
# The X11 font server listens on port 7000.
# Do NOT associate other services with these ports.
# Refer to the X documentation for details.

hpoms-ci-lstn 5403/tcp #SAP spooler support
hpoms-dps-lstn 5404/tcp #SAP spooler support
samd 3275/tcp # sam daemon

dtspc 6112/tcp #subprocess control
eusrv 9142/tcp # eusrv daemon

swat 901/tcp # SAMBA Web-based Admin Tool

[Jdamian]

please, post the output of the following command lines

what /usr/sbin/inetd

swapinfo -tam

lvlnboot -v vg00

[Jdamian]

please, post the /etc/inetd.conf file.

[Mark Nieuwboer]

Hi,

We have also a rp7410 and it takes about 45 minutes to start. also servicesguard.
after seeing your /etc/services you start a lot i don't thing it's rare that it takes that time to start up.

grtz. Mark

[Jdamian]

Sorry, Nieuwboer... but your box has a problem.

Inetd in my box lasts a few seconds:

eb 14 11:34:41 myname inetd[807]: Reading configuration
Feb 14 11:34:41 myname inetd[807]: ftp/tcp: Added service, server /usr/lbin/ftpd
Feb 14 11:34:41 myname inetd[807]: telnet/tcp: Added service, server /usr/lbin/telnetd
Feb 14 11:34:41 myname inetd[807]: tftp/udp: Added service, server /usr/lbin/tftpd
.
.
.
.
Feb 14 11:34:41 myname inetd[807]: rpc.ttdbserver/tcp: Added service, server /usr/dt/bin/rpc.ttdbserver
Feb 14 11:34:41 myname inetd[807]: Thru with configuration
Feb 14 11:34:41 myname inetd[807]: Configuration complete

[Mark Nieuwboer]

Sorry,
I ment to start the complete system.
please ignore by post i didn't read it well.

[Roberto Martinez_6]

#what /usr/sbin/inetd
/usr/sbin/inetd:
$Revision: vw: -RW selectors: 'ic27d' -proj integ -- ph_ic27d_i80 'cupi80_ic27dbase_pb(08-Nov-00.16:48:14)' 'BE11.11_IC27A'
Wed Nov 8 18:23:18 PST 2000 $
Copyright (c) 1983 Regents of the University of California.


#swapinfo -tam
Mb Mb Mb PCT START/ Mb
TYPE AVAIL USED FREE USED LIMIT RESERVE PRI NAME
dev 4096 0 4096 0% 0 - 1 /dev/vg00/lvol2
reserve - 785 -785
memory 4669 3476 1193 74%
total 8765 4261 4504 49% - 0 -



#lvlnboot -v vg00
Boot Definitions for Volume Group /dev/vg00:
Physical Volumes belonging in Root Volume Group:
/dev/dsk/c0t6d0 (1/0/0/3/0.6.0) -- Boot Disk
/dev/dsk/c3t6d0 (1/0/1/1/0/1/1.6.0) -- Boot Disk
Boot: lvol1 on: /dev/dsk/c0t6d0
/dev/dsk/c3t6d0
Root: lvol3 on: /dev/dsk/c0t6d0
/dev/dsk/c3t6d0
Swap: lvol2 on: /dev/dsk/c0t6d0
/dev/dsk/c3t6d0
Dump: lvol2 on: /dev/dsk/c0t6d0, 0






#cat /etc/inetd.conf

ftp stream tcp nowait root /usr/lbin/ftpd ftpd -l -u 002
telnet stream tcp nowait root /usr/lbin/telnetd telnetd

# Before uncommenting the "tftp" entry below, please make sure
# that you have a "tftp" user in /etc/passwd. If you don't
# have one, please consult the tftpd(1M) manual entry for
# information about setting up this service.

#tftp dgram udp wait root /usr/lbin/tftpd tftpd
#bootps dgram udp wait root /usr/lbin/bootpd bootpd
#finger stream tcp nowait bin /usr/lbin/fingerd fingerd
login stream tcp nowait root /usr/lbin/rlogind rlogind
shell stream tcp nowait root /usr/lbin/remshd remshd
exec stream tcp nowait root /usr/lbin/rexecd rexecd
#uucp stream tcp nowait root /usr/sbin/uucpd uucpd
ntalk dgram udp wait root /usr/lbin/ntalkd ntalkd
ident stream tcp wait bin /usr/lbin/identd identd

##
#
# Other HP-UX network services
#
##
printer stream tcp nowait root /usr/sbin/rlpdaemon rlpdaemon -i

##
#
# inetd internal services
#
##
daytime stream tcp nowait root internal
daytime dgram udp nowait root internal
time stream tcp nowait root internal
#time dgram udp nowait root internal
echo stream tcp nowait root internal
echo dgram udp nowait root internal
discard stream tcp nowait root internal
discard dgram udp nowait root internal
chargen stream tcp nowait root internal
chargen dgram udp nowait root internal

##
#
# rpc services, registered by inetd with portmap
# Do not uncomment these unless your system is running portmap!
#
##
# WARNING: The rpc.mountd should now be started from a startup script.
# Please enable the mountd startup script to start rpc.mountd.
##
#rpc stream tcp nowait root /usr/sbin/rpc.rexd 100017 1 rpc.rexd
#rpc dgram udp wait root /usr/lib/netsvc/rstat/rpc.rstatd 100001 2-4 rpc.rstatd
#rpc dgram udp wait root /usr/lib/netsvc/rusers/rpc.rusersd 100002 1-2 rpc.rusersd
#rpc dgram udp wait root /usr/lib/netsvc/rwall/rpc.rwalld 100008 1 rpc.rwalld
#rpc dgram udp wait root /usr/sbin/rpc.rquotad 100011 1 rpc.rquotad
#rpc dgram udp wait root /usr/lib/netsvc/spray/rpc.sprayd 100012 1 rpc.sprayd

##
#
# The standard remshd and rlogind do not include the Kerberized
# code. You must install the InternetSvcSec/INETSVCS-SEC fileset and
# configure Kerberos as described in the SIS(5) man page.
#
##
kshell stream tcp nowait root /usr/lbin/remshd remshd -K
klogin stream tcp nowait root /usr/lbin/rlogind rlogind -K


##
#
# NCPM programs.
# Do not uncomment these unless you are using NCPM.
#
##

#ncpm-pm dgram udp wait root /opt/ncpm/bin/ncpmd ncpmd
#ncpm-hip dgram udp wait root /opt/ncpm/bin/hipd hipd

dtspc stream tcp nowait root /usr/dt/bin/dtspcd /usr/dt/bin/dtspcd
rpc xti tcp swait root /usr/dt/bin/rpc.ttdbserver 100083 1 /usr/dt/bin/rpc.ttdbserver
registrar stream tcp nowait root /etc/opt/resmon/lbin/registrar /etc/opt/resmon/lbin/registrar
recserv stream tcp nowait root /usr/lbin/recserv recserv -display :0
rpc dgram udp wait root /usr/dt/bin/rpc.cmsd 100068 2-5 rpc.cmsd
swat stream tcp nowait.400 root /opt/samba/bin/swat swat

[Jdamian]

According to the output of what command, I suggest to install patches for inetd as Steve Steel suggested.

What command shows inetd is not patched.

[Roberto Martinez_6]

ok, i'll install the patch and reboot this weekend, I'll update this thread on monday.

[rick jones]

unless bundled with something else an inetd patch shouldn't _need_ a reboot, just an inetd restart. does the patch info say reboot?

[Mic V.]

Roberto,

Good luck this weekend. Just an FYI for the future -- to see if the patch is installed, try this:

swlist -l product | grep PHNE_31097

(You can also just "grep 31097" to find the single patch, or "grep PHNE" to see all the networking patches)

Mic

[Roberto Martinez_6]

According to patch database, a reboot is required (Patch description is " s700_800 11.11 ONC/NFS General Release/Performance Patch"), and it has 2 dependencies. So, apparently it's better to reboot, which I'm gonna do right now.

bad luck. after rebooting, same behaviour...sigh. any hints?

[Tony Scully_2]

You mentioned checking the /etc/nsswitch.conf file, and /etc/resolv.conf - can you post these if possible. If you are only using files you could remove the latter. Also re-check that you can resolve the host itself both forward and reverse, and that this is instantaneous. other than that, perhaps try (as suggested before) removing from inetd.conf swat, recserv and any other services that appear to take a long time for inetd to configure. Do you have a /var/adm/inetd.sec file? I think that has no impact except for incoming connections, but might be worth checking it has nothing wrong in there.

Cheers,

Tony.

[rick jones]

If the inetd takes a long time to restart _after_ boot - as in kill the inetd and start a new one - then you might try starting the inetd by hand after boot, but with tusc watching the system calls. I would use the option to follow forks, display process id and be verbose. Also include timestamps, and perhaps hav it trace both syscall entry and exit. From that it may be possible to see more precisely where it is stalling.

[Roberto Martinez_6]

nsswitch.conf:
hosts: files [NOTFOUND=return UNAVAIL=return]
aliases: files [NOTFOUND=return UNAVAIL=return]
automount: files [NOTFOUND=return UNAVAIL=return]
group: files [NOTFOUND=return UNAVAIL=return]
netgroup: files [NOTFOUND=return UNAVAIL=return]
networks: files [NOTFOUND=return UNAVAIL=return]
passwd: files [NOTFOUND=return UNAVAIL=return]
protocols: files [NOTFOUND=return UNAVAIL=return]
publickey: files[NOTFOUND=return UNAVAIL=return]
rpc: files [NOTFOUND=return UNAVAIL=return]
services: files [NOTFOUND=return UNAVAIL=return]


resolv.conf: (just one line, replaced the domain name by xxx here)

domain xxxx.xx

inetd.sec: (the default, replaced hostname by the real one):

dtspc allow 127.0.0.1 loopback hostname


Rick, good idea about manually restarting and watching system calls. As soon as I can have 30 free minutes to do the test (the server is a production one), I'll check.

[rick jones]

If you have no DNS servers configured, probably best, as I think someone else suggested, to _not_ have a /etc/resolv.conf file. With no DNS servers configured, there isn't much point in configuring a domain name, since you don't _really_ have one at that point. (In broad handwaving terms)