APA error

[mjos]

Hi Gurus,
Need help with an APA error message that came up while rebooting a rp3440 server.
The server is configured for APA.

LinkAgg0 0x001A4BF2E082 900 UP lan900 snap900 8 ETHER Yes 119

We had to reboot the server for a maintanence activity. While rebooting, the server gave the following error -
**********************Auto-Port Aggregation/9000 Networking*****************@#%

Tue May 12 EDT 2009 12:04:29.890006 DISASTER Subsys:HP_APA Loc:00000

<1006> HP Auto-Port Aggregation product found that ports in failover

group lan900 are no longer connected to each other. Port 0 did

not receive any poll packets.

It rebooted fine after some time & the APA link was also up & the server was on the network. Can somebody please help me with the reason behind this error message & the casue for this.
hp_apaportconf file has the following entries -
HP_APAPORT_INTERFACE_NAME[0]=lan0
HP_APAPORT_CONFIG_MODE[0]=LAN_MONITOR
HP_APAPORT_INTERFACE_NAME[1]=lan1
HP_APAPORT_CONFIG_MODE[1]=LAN_MONITOR

lanconfig.ascii has the following entries

NODE_NAME boixyz23

POLLING_INTERVAL 10000000
DEAD_COUNT 3

LM_RAPID_ARP off
LM_RAPID_ARP_INTERVAL 1000000
LM_RAPID_ARP_COUNT 10


FAILOVER_GROUP lan900
STATIONARY_IP 10.45.24.124
PRIMARY lan0 5
STANDBY lan1 3

Thanks.

[Michal Kapalka (mikap)]

Hi,

check this link :
http://book.soundonair.ru/hall2/ch15lev1sec14.html

- search for this message :

<1006> HP Auto-Port Aggregation product found that ports in failover

mikap

[Ganesan R]

Hi,

>>>
<1006> HP Auto-Port Aggregation product found that ports in failover

group lan900 are no longer connected to each other. Port 0 did

not receive any poll packets.
<<<

The above message give some hints. Lan ports part of the failover group suppose to have layer 2 connectivity and able to communicate each other. From the above message, it looks lan0 and lan1 were not able to communicate for a while. Is the switch or cables disturbed for a while during that period?

[mjos]

Thanks, there was no problem from the switch or cable end. All the other servers in the same subnet were up & running.
Is it advisable to stop APA before rebooting the server.

[Michal Kapalka (mikap)]

Hi,

if you are reboot the server, you don't need to stop APA, it will be automaticaly done.

I always use shutdown -r instead of reboot.

mikap

[mjos]

nh1a1t16#lanadmin -x -v 900
Link Aggregate PPA # : 900
Number of Ports : 1
Ports PPA : 0
Link Aggregation State : LINKAGG MANUAL
Load Balance Mode : Hot Standby (LB_HOT_STANDBY)

In arp -an I dont find the IP address of the server binded to any mac address.

[Michal Kapalka (mikap)]

hi,

it a example:

hostname:/#lanadmin -x -v 900
Link Aggregate PPA # : 900
Number of Ports : 2
Ports PPA : 1 2
Link Aggregation State : LINKAGG MANUAL
Group Capability : 5
Load Balance Mode : Hot Standby (LB_HOT_STANDBY)

hostname:/#lanscan -qa
0x0014C2441A4A 0
0x00306EF5A899 900 1 2
0x000000000000 901
0x000000000000 902
0x000000000000 903
0x000000000000 904

mikap

[mjos]

Ok got it

#lanscan -qa
0x001E0B887708 1
0x001E0B887709 2
0x001E0B88770A 3
0x001E0B88770B 4
0x001A4BF2E082 900 0
0x000000000000 901
0x000000000000 902
0x000000000000 903
0x000000000000 904

[Michal Kapalka (mikap)]

Hi,

so from your out seems to be only LAN0 bind to the lan900, please check the link status with lanadmin if the lan1 is up => change PPA.

mikap

[Michal Kapalka (mikap)]

Configuration files :

/etc/rc.config.d/hp_apaconf

#####################################################################
HP_APA_INTERFACE_NAME[0]=lan900
HP_APA_LOAD_BALANCE_MODE[0]=LB_MAC
HP_APA_MANUAL_LA[0]=1,2
HP_APA_HOT_STANDBY[0]=on
###########################################################################
# The HP_APA_INIT_ARGS are reserved by HP. They are NOT user changable.
HP_APA_START_LA_PPA=900
HP_APA_DEFAULT_PORT_MODE=MANUAL

HP_APA_INIT_ARGS="HP_APA_LOAD_BALANCE_MODE HP_APA_GROUP_CAPABILITY HP_APA_HOT_ST
ANDBY HP_APA_MANUAL_LA HP_APA_INIT HP_APA_KEY"



/etc/rc.config.d/hp_apaportconf

HP_APAPORT_INTERFACE_NAME[0]=lan1
HP_APAPORT_GROUP_CAPABILITY[0]=5
HP_APAPORT_PRIORITY[0]=0
HP_APAPORT_CONFIG_MODE[0]=MANUAL

HP_APAPORT_INTERFACE_NAME[1]=lan2
HP_APAPORT_GROUP_CAPABILITY[1]=5
HP_APAPORT_PRIORITY[1]=0
HP_APAPORT_CONFIG_MODE[1]=MANUAL
###########################################################################
# The HP_APAPORT_INIT_ARGS are reserved by HP. They are NOT user changable.

HP_APAPORT_INIT_ARGS="HP_APAPORT_GROUP_CAPABILITY HP_APAPORT_PRIORITY HP_APAPORT
_CONFIG_MODE HP_APAPORT_KEY HP_APAPORT_SYSTEM_PRIORITY"

[mjos]

# HP_APA_INTERFACE_NAME[0]=lan900
# HP_APA_LOAD_BALANCE_MODE[0]=LB_CPU
# HP_APA_GROUP_CAPABILITY[0]=3
# HP_APA_HOT_STANDBY[0]=off

HP_APA_START_LA_PPA=900
HP_APA_INIT_ARGS="HP_APA_LOAD_BALANCE_MODE HP_APA_GROUP_CAPABILITY HP_APA_HOT_STANDBY HP_APA_MANUAL_LA HP_APA_INIT HP_APA_KEY"
#####################################################################

HP_APA_DEFAULT_PORT_MODE=MANUAL

Do i need to uncomment & put the below entries -
HP_APA_LOAD_BALANCE_MODE[0]=LB_MAC
HP_APA_MANUAL_LA[0]=0,1
HP_APA_HOT_STANDBY[0]=on

[Michal Kapalka (mikap)]

yes,

and let me know if its working.

mikap

[mjos]

Thanks Michal, can you please let me know how do i test it. I made the changed in the hp_apaconf file, now how do i test it.

Thanks.

[Michal Kapalka (mikap)]

Hi,

if you can reboot the server, them do it, if not you need tu restart the services, for APA,

If you are done editing all configuration modes, activate the
configuration by typing:
/sbin/init.d/hplm stop {optional--for failover groups}
/sbin/init.d/hpapa stop and then
/sbin/init.d/hpapa start
/sbin/init.d/hplm start {optional--for failover groups}

and if you check the

lanscan -qa and you see both adapters joined to the lan900 interface it sholud be working.

But actulay if I configure a server, I reboot the server and them test ping for example other server and disconnect a primary LAN interface for you LAN 0, and check if the APA is working.

mikap

[mjos]

I got the below error while trying to start the services -

#/sbin/init.d/hpapa start
/sbin/init.d/hpapa started.
Please be patient. This may take about 40 seconds.
HP_APA_DEFAULT_PORT_MODE = MANUAL
/usr/sbin/hp_apa_util -S 0 LAN_MONITOR
/usr/sbin/hp_apa_util -S 1 LAN_MONITOR
lan900
/usr/sbin/lanadmin -X -l LB_MAC 900
New Load Balancing = 2
/usr/sbin/lanadmin -X -y on 900
New Hot Standby = ON
/usr/sbin/lanadmin -X -a 0 1 900
ERROR: Error: The mode of the port 0 is invalid for this command

/sbin/init.d/hpapa Completed with failures.
#/sbin/init.d/hplm start
/sbin/init.d/hplm started.
Reading ASCII file /etc/lanmon/lanconfig.ascii
WARNING: Failed link-level connectivity checks for ports in Fail-Over Group 900.
For more information, see nettl log messages for HP_APA.
Creating Fail-Over Group lan900
Updated binary file /etc/lanmon/lanconfig
/sbin/init.d/hplm Completed successfully.

[Michal Kapalka (mikap)]

Hi,
that strange, could you send a information ???

ioscan -fnC lan

lanscan && lanscan -qa

mikap

[Michal Kapalka (mikap) · Accepted solution]

Hi,

read this docu ist a quick guide for APA.

mikap

[mjos]

#ioscan -fnC lan
Class I H/W Path Driver S/W State H/W Type Description
========================================================================
lan 0 0/1/2/0 igelan CLAIMED INTERFACE HP PCI 1000Base-T Core
lan 1 0/2/1/0/4/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 2 0/2/1/0/4/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 3 0/2/1/0/6/0 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
lan 4 0/2/1/0/6/1 iether CLAIMED INTERFACE HP AB545-60001 PCI/PCI-X 1000Base-T 4-port 1000B-T Adapter
#lanscan
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
0/2/1/0/4/0 0x001E0B887708 1 UP lan1 snap1 2 ETHER Yes 119
0/2/1/0/4/1 0x001E0B887709 2 UP lan2 snap2 3 ETHER Yes 119
0/2/1/0/6/0 0x001E0B88770A 3 UP lan3 snap3 4 ETHER Yes 119
0/2/1/0/6/1 0x001E0B88770B 4 UP lan4 snap4 5 ETHER Yes 119
LinkAgg0 0x001A4BF2E082 900 UP lan900 snap900 8 ETHER Yes 119
LinkAgg1 0x000000000000 901 DOWN lan901 snap901 9 ETHER Yes 119
LinkAgg2 0x000000000000 902 DOWN lan902 snap902 10 ETHER Yes 119
LinkAgg3 0x000000000000 903 DOWN lan903 snap903 11 ETHER Yes 119
LinkAgg4 0x000000000000 904 DOWN lan904 snap904 12 ETHER Yes 119
#lanscan -qa
0x001E0B887708 1
0x001E0B887709 2
0x001E0B88770A 3
0x001E0B88770B 4
0x001A4BF2E082 900 0
0x000000000000 901
0x000000000000 902
0x000000000000 903
0x000000000000 904

[Michal Kapalka (mikap)]

hi,

the error is that you would like to bind to APA two diferent type of lan card.


and the lan0 is from core/IO, please try to

make APA configuration with a LAN1 <=> LAN2,

It's 4 port LAN card, so if this card failed the servers is without network, it will be better to have 2x 2 PORT cards.


mikap

[mjos]

I edited the hp_apaconf file & made the below changed, replaced 0,1 with 1,2

HP_APA_MANUAL_LA[0]=1,2

Stopped & started hpapa & found it is giving the error for port 1 now

nh1a1t16#/sbin/init.d/hpapa start
/sbin/init.d/hpapa started.
Please be patient. This may take about 40 seconds.
HP_APA_DEFAULT_PORT_MODE = MANUAL
/usr/sbin/hp_apa_util -S 0 LAN_MONITOR
/usr/sbin/hp_apa_util -S 1 LAN_MONITOR
lan900
/usr/sbin/lanadmin -X -l LB_MAC 900
New Load Balancing = 2
/usr/sbin/lanadmin -X -y on 900
New Hot Standby = ON
/usr/sbin/lanadmin -X -a 1 2 900
ERROR: Error: The mode of the port 1 is invalid for this command

[Michal Kapalka (mikap)]

hi,

check this link,

http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=779242

hope it helps.

or : send mi the conf files from APA as attachemnt.

mikap

[mjos]

The APA quick guide doc was really helpfull.
Here APA is configured in LAN_Monitor mode.
I followed the doc & reverted back the changes made to the hp_apaconf file & start the hpapa & hplm services & it came up fine.

-------------------------------------------------------------------------------
Hardware Station Crd Hdw Net-Interface NM MAC HP-DLPI DLPI
Path Address In# State NamePPA ID Type Support Mjr#
LinkAgg0 0x001A4BF2E082 900 UP lan900 snap900 8 ETHER Yes 119

Extended Station LLC Encapsulation
Address Methods
0x001A4BF2E082 IEEE HPEXTIEEE SNAP ETHER NOVELL

Driver Specific Information
hp_apa

#lanscan -q
1
2
3
4
900 0
901
902
903
904

The above output shows that lan0 in link aggregrate 900. But since I have both lan0 & lan1 in the hp_apaportconf file, why doesnt lan1 also show up in link aggregrate 900

[Michal Kapalka (mikap)]

hi,

if its possible try to restart the server,

sometimes if i changed the APA, i wasn't able to start it.

mikap

[mjos]

I will try to get a schedule for restart & check the status.

Thanks once again for all you help.

[mjos]

Michal,

Can you explain the below.
Port state for lan0 & lan1 configured in APA for LAN_MONITOR mode shows as off.
The port state should be up - isn't it?

#lanadmin -x -p 0 900

**** PORT NUMBER: 0 *******
Port Mode : LAN_MONITOR
Port State : PROTOCOL OFF
Port Group Capability : 5
Port Priority : 5
#lanadmin -x -p 1 900

**** PORT NUMBER: 1 *******
Port Mode : LAN_MONITOR
Port State : PROTOCOL OFF
Port Group Capability : 5
Port Priority : 3