VM's randomly lose Network connection

[Paul_King]

We currently have a BL860iC running two virtual machines. On a random basis these machines drop off the network. The machines were stable for the last 60 days but over the last two days the machines have dropped off the network again.

The VM's do not ping but we can console into them. 

- from the VM console, /sbin/init.d/net stop  and /sbin/init.d/net start does not solve the issue

- rebooting the VM solves the issue

- restarting the virtual switch solves the issue

We get the following error when the issue occurs:

Apr  5 08:07:37 soem2 vmunix: Dead gateway detection can't ping the last remaining default gateway at 0xa63b8c01 .See ndd -h ip_ire_gw_
probe for more info

# nwmgr -c lan0 -v
lan0:
   Interface State =UP
   MAC Address = 0xCA5XXXX5B9A
   Subsystem = igssn
   Interface Type = 1000Base-T
   Hardware Path = 0/0/1/0
   NMID = 1
   Feature Capabilities = Physical Interface
                          IPV4 Recv CKO
                          IPV4 Send CKO
                          VLAN Tag Offload
                          64Bit MIB Support
                          IPV4 TCP Segmentation Offload
                          UDP Multifrag CKO
   Feature Settings = Physical Interface
                      IPV4 Recv CKO
                      IPV4 Send CKO
                      VLAN Tag Offload
                      64Bit MIB Support
                      IPV4 TCP Segmentation Offload
                      UDP Multifrag CKO
   MTU = 1500
   Speed = 2.0 Gbps Full Duplex

The odd thing today was that the VM's came back without a restart of the virtual switch or the actual VM

on the host we are running:

VMGuestLib                    B.04.30        Integrity VM Guest Support Libraries
  VMMGR                         A.6.1.0.89662  HP-UX Integrity Virtual Server Manager

# swlist | grep AVIO
  GuestAVIOStor                                 B.11.31.1211   HPVM Guest AVIO Storage Software
  GuestAvioLan                                  B.11.31.1211   HPVM Guest AVIO LAN Software
  HostAVIOStor                                  B.11.31.1211   HPVM Host AVIO Storage Software
  HostAvioLan                                   B.11.31.1211   HPVM Host AVIO LAN Software

[Torsten.]

>> Speed = 2.0 Gbps Full Duplex


So the host is running APA?

It is worth to check if APA config, drivers and LOM firmware is correct and up to date.

[Paul_King]

Hello

Thanks for the response. I am pretty new to the virtualised solution. How do I find if I am running APA and if so what drivers?

 The network setup on the host is:

bash-4.0# nwmgr -c lan0 -v
lan0:
   Interface State =UP
   MAC Address = 0x3CDXXXXF934A
   Subsystem = iexgbe
   Interface Type = 10GBASE-KR
   Related Interface = lan900
   Hardware Path = 0/0/0/3/0/0/0
   NMID = 1
   Feature Capabilities = Physical Interface
                          IPV4 Recv CKO
                          IPV4 Send CKO
                          VLAN Tag Offload
                          64Bit MIB Support
                          IPV4 TCP Segmentation Offload
                          UDP Multifrag CKO
   Feature Settings = Physical Interface
                      IPV4 Recv CKO
                      IPV4 Send CKO
                      VLAN Tag Offload
                      64Bit MIB Support
                      IPV4 TCP Segmentation Offload
                      UDP Multifrag CKO
   MTU = 1500
   Speed = 1000 Mbps Full Duplex

[Torsten.]

Just run

# nwmgr -S apa

on the host and we will see if this is used or not.

[Paul_King]

Hello

bash-4.0# nwmgr -S apa
Class    Mode        Load      Speed-               Membership
Instance             Balancing Duplex
======== =========== ========= ==================== ===========================
lan900   MANUAL      LB_MAC    2 Gbps Full Duplex   0,1
lan901   Not_Enabled LB_MAC    0 Mbps                -
lan902   Not_Enabled LB_MAC    0 Mbps                -
lan903   Not_Enabled LB_MAC    0 Mbps                -
lan904   Not_Enabled LB_MAC    0 Mbps                -

[Torsten.]

OK, lan0 and lan1 are trunced on the host.

Now check with swlist what version is running, e.g. B.11.31.60.
(swlist | grep -i apa or auto port)

[Paul_King]

Thanks Torsten

bash-4.0# swlist | grep -i apa
  HPUXExtns-Jpn                 B.11.31        Japanese font, input methods and printer extensions
  HPUXMan-Jpn                   B.11.31.1203   Minimum and Essential Japanese man pages
  HPUXMsgs-Jpn                  B.11.31        Minimum and Essential HP-UX Japanese Language Message Catalogs
  hpuxws22Apache                B.2.2.15.09    HP-UX Apache-based Web Server

bash-4.0# swlist | grep -i auto*
  DSAUtilities                  C.01.00.20     HP-UX Distributed Systems Administration Utilities
  J4240AA                       B.11.31.60     Auto-Port Aggregation Software

[Torsten.]

It is meanwhile newer:

https://h20392.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=HPUX-APA

but your version

J4240AA B.11.31.60 Auto-Port Aggregation Software

is better than the older versions. I don't know about fixes yet.

Is this a BL860c or BL860c i2?

[Torsten.]

Sounds like you better should have the newer version:

http://bizsupport1.austin.hp.com/bc/docs/support/SupportManual/c03684559/c03684559.pdf

[Paul_King]

Hello

It is a Integrity BL860c i2.