- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Re: Intermittent no outgoing connections possible
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-26-2009 10:43 PM
тАО08-26-2009 10:43 PM
Intermittent no outgoing connections possible
We have an RP8420 with 4 vpars HP-UX 11v1, patched up to December 2008 plus some critical patches up to August 2009, with Oracle 10.2.0.4 and intermittently on one of the vpars, always in the afternoon on different times of the day, new outgoing connections can not be made.
We only see errors in the applicationlog, but while testing we could see the errors also with a ssh and telnet session from this vpar to other nodes. This error also occurs intermittent with a ssh localhost.
# ssh localhost
Can't assign requested address
There are no errors reported in /var/adm/syslog/syslog.log.
On a testsystem we can not reproduce the errors although system settings are identical.
Aug 25 host005.gps.ro.mj.nl java.net.BindException: bind() failed,
errno = 227
Aug 25 host005.gps.ro.mj.nl at java.net.PlainSocketImpl.socket
Bind(PlainSocketImpl.java)
Aug 25 host005.gps.ro.mj.nl at java.net.PlainSocketImpl.bind(P
lainSocketImpl.java)
Aug 25 host005.gps.ro.mj.nl at java.net.Socket.bind(Socket.java)
Aug 25 host005.gps.ro.mj.nl at java.net.Socket.
Aug 25 host005.gps.ro.mj.nl at java.net.Socket.
Aug 25 host005.gps.ro.mj.nl at HTTPClient.HTTPConnection.getSo
cket(HTTPConnection.java)
Aug 25 host005.gps.ro.mj.nl at HTTPClient.HTTPConnection.doCon
nect(HTTPConnection.java)
Aug 25 host005.gps.ro.mj.nl at HTTPClient.HTTPConnection.sendR
equest(HTTPConnection.java:3007)
Aug 25 host005.gps.ro.mj.nl at HTTPClient.HTTPConnection.handl
eRequest(HTTPConnection.java)
It seems this error is a result from the error above:
Aug 25 12:55:43 host005.gps.ro.mj.nl gps 2009-08-25 12:55:43,094 KOEGELBJ01
(1-69351315) ERROR hfa_hfapi_p.perform_login: error ORA-29260: network error: Connect failed because target host or object does not exist
Aug 25 12:55:43 host005.gps.ro.mj.nl gps 2009-08-25 12:55:43,095 KOEGELBJ01
(1-69351315) ERROR hfa_hfapi_p.handle_network_error: network error ->DO disconnect
Also this one:
Aug 25 host005.gps.ro.mj.nl java.net.SocketException: Can't assign requested address
Several searches on the internet and ITRC pointed us in the direction of a lack of sockets but we can not determine if that is truly the case.
Netstat -an | wc -l never shows more than 4200 sockets in use.
A sar -v at the time of the error shows:
14:48:00 N/A N/A 1293/4096 0 2361/34816 0 38365/63498 0
CPU and memory usage is below 50%.
host005:/var/adm/sa# netstat -ian
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
lo0 4136 127.0.0.0 127.0.0.1 3769745 0 3769745 0 0
lan13:1 1500 10.32.20.0 10.32.20.22 80 0 0 0 0
lan15 1500 10.32.4.192 10.32.4.195 2 0 1 0 0
lan13 1500 10.32.20.0 10.32.20.20 63473125 0 120101929 0 0
lan16 1500 10.32.5.224 10.32.5.229 1 0 1 0 0
host005:/var/adm/sa# netstat -rn
Routing tables
Destination Gateway Flags Refs Interface Pmtu
127.0.0.1 127.0.0.1 UH 0 lo0 4136
10.32.20.20 10.32.20.20 UH 0 lan13 4136
10.32.20.22 10.32.20.22 UH 0 lan13:1 4136
10.32.5.229 10.32.5.229 UH 0 lan16 4136
10.32.4.195 10.32.4.195 UH 0 lan15 4136
10.32.4.192 10.32.4.195 U 2 lan15 1500
10.32.5.224 10.32.5.229 U 2 lan16 1500
10.32.20.0 10.32.20.20 U 3 lan13 1500
10.32.20.0 10.32.20.22 U 3 lan13:1 1500
127.0.0.0 127.0.0.1 U 0 lo0 4136
default 10.32.20.1 UG 0 lan13 1500
All suggestions are very welcome and will be rewarded.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-27-2009 12:19 AM
тАО08-27-2009 12:19 AM
Re: Intermittent no outgoing connections possible
If outgoing connections cant be done there may be a possibility of lack of anonymous ports on the system. The defaults are 49152 through 65535. You can try to set it to lower values and give a try:
ndd -set /dev/tcp tcp_smallest_anon_port ...
>>Netstat -an | wc -l never shows more than 4200 sockets in use.
Did you take this value at the time when problem occurs?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-27-2009 12:29 AM
тАО08-27-2009 12:29 AM
Re: Intermittent no outgoing connections possible
The settings are:
ndd -get /dev/tcp tcp_smallest_anon_port
49152
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-27-2009 12:39 AM
тАО08-27-2009 12:39 AM
Re: Intermittent no outgoing connections possible
>>Netstat -an | wc -l never shows more than 4200 sockets in use.
Did you take this value at the time when problem occurs?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-27-2009 02:20 AM
тАО08-27-2009 02:20 AM
Re: Intermittent no outgoing connections possible
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-28-2009 09:35 AM
тАО08-28-2009 09:35 AM
Re: Intermittent no outgoing connections possible
I'm working with Han on this issue.
Anybody else with suggestions?
Also we would like to know how to determine the number of sockets in use.
netstat -an | wc -l
or /usr/contrib/bin/lsof /dev/ip | wc -l
or ?
We know we can expand the range 49152-65535 with lowering tcp_smallest_anon_port but do we need that?
Regards,
Roland
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-30-2009 09:07 PM
тАО08-30-2009 09:07 PM
Re: Intermittent no outgoing connections possible
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-02-2009 11:06 PM
тАО09-02-2009 11:06 PM
Re: Intermittent no outgoing connections possible
HP's tool "xportshow" does show BOUND states.
We are currently monitoring the use of the ports and calculating the totals.
Here's an example.
The amount of BOUND state session is rapidly increasing over time. The peak is expected in about 2 hours from now (11:00am).
time total establ listen finwt2 timewt dynamc total dynamc client tcpudp dynamc bound bound total
08:58:52 1717 1195 77 6 438 759 557 244 734 2274 1003 3242 0 5516
08:59:28 1777 1233 77 6 460 815 556 243 735 2333 1058 3225 0 5558
09:00:05 1809 1279 77 5 447 857 562 246 737 2371 1103 3233 0 5604
09:00:41 1783 1291 77 5 409 808 562 247 741 2345 1055 3265 0 5610
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-03-2009 12:09 AM
тАО09-03-2009 12:09 AM
Re: Intermittent no outgoing connections possible
- do you use XTI connections?
- do you use access right send over unix sockets?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-16-2009 03:33 AM
тАО09-16-2009 03:33 AM
Re: Intermittent no outgoing connections possible
The solution is to switch off the keepalive option on the IIS server.
The amount of tcp bound status ports is now only two instead of thousands.