HPE Community
Comware Based
1753523 Members
9250 Online
108795 Solutions
New Discussion

Re: IRF and link aggregation problems

 
RexRay
Occasional Visitor

‎10-02-2014 12:28 PM - edited ‎10-02-2014 12:33 PM

‎10-02-2014 12:28 PM - edited ‎10-02-2014 12:33 PM

IRF and link aggregation problems

Hi everybody,

 

I want to first thank to the people here respondisng to post and sharing their knowlage :)

 

We have two HP 5900AF switches that we want to deploy into on our office netwotk in order to take the
advantage of redundancy and bigger bandwith, I configured it the best I could but we running in
to trouble with the end points (servers running CentOs)  when they don't want ro talk to each other, no even on the same switch!!! (pinging just time out every time) I'm runnng the servers with static IPs on VLAN 60.


We want IRF and link aggreagation so here is my configuration and a little schematic:

 

<SWITCH#1> system-view

[SWITCH#1] irf mac-address persistent always (Enable MAC address persistance)

[SWITCH#1] Irf member 1 priority 10

[SWITCH#1] interface ten-gigabitethernet 1/0/17

[SWITCH#1] Ten-GigabitEthernet1/0/17] shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/18

[SWITCH#1] Ten-GigabitEthernet1/0/18] shutdown

[SWITCH#1] irf-port 1/1

[SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

 

( Here I recieved a warning telling me to also shutdown port 19 and 20 because they belong to the
same group so I did and I aso added them to the IRF even knowing that I will only link 17 and 18)

 

[SWITCH#1] interface ten-gigabitethernet 1/0/19

[SWITCH#1] Ten-GigabitEthernet1/0/19] shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/20

[SWITCH#1] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

[SWITCH#1] irf-port1/1] quit

[SWITCH#1] irf-port 1/2

[SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

[SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

[SWITCH#1] irf-port1/2] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/17

[SWITCH#1] Ten-GigabitEthernet1/0/17] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/18

[SWITCH#1] Ten-GigabitEthernet1/0/18] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/19

[SWITCH#1] Ten-GigabitEthernet1/0/19] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/20

[SWITCH#1] Ten-GigabitEthernet1/0/20] undo shutdown

[SWITCH#1] Ten-GigabitEthernet1/0/20] save

[SWITCH#1] irf-port-configuration active


-------------------------------------------------------------------------------------------------
------------------------------


<SWITCH#2> system-view
[SWITCH#2] irf member 1 renumber 2
[SWITCH#2]save
[SWITCH#2]reboot

[SWITCH#2] irf mac-address persistent always (Enable MAC address persistance)

[SWITCH#2] Irf member 2 priority 1

[SWITCH#2] interface ten-gigabitethernet 2/0/17

[SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#1] interface ten-gigabitethernet 2/0/18

[SWITCH#2] Ten-GigabitEthernet1/0/21] shutdown

[SWITCH#2] irf-port 1/1

[SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

( Here I recieved the same warning as Switc#1)

[SWITCH#2] interface ten-gigabitethernet 1/0/19

[SWITCH#2] Ten-GigabitEthernet1/0/19] shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/20

[SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

[SWITCH#2] irf-port1/1] quit

[SWITCH#2] irf-port 1/2

[SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

[SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

[SWITCH#2] irf-port1/2] quit

[SWITCH#2] interface ten-gigabitethernet 1/0/17

[SWITCH#2] Ten-GigabitEthernet1/0/17] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/18

[SWITCH#2] Ten-GigabitEthernet1/0/18] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/19

[SWITCH#2] Ten-GigabitEthernet1/0/19] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/20

[SWITCH#2] Ten-GigabitEthernet1/0/20] undo shutdown

[SWITCH#2] Ten-GigabitEthernet1/0/20] save

[SWITCH#2] irf-port-configuration active


At this pont I connected the DAC like this:

 

port ten-gigabitethernet 1/0/17 to ten-gigabitethernet 2/0/18 and port ten-gigabitethernet 1/0/18
to ten-gigabitethernet 2/0/17

 

Then Switch#1 start propagating his image to swtich#2 and when this prosess is done I see that the
sysname of Switch#2 changed to Switch#1 and can see with the <disp irf> command that member 1 is
"master" and member 2 is "standby", I see on irf topology the links are UP and on irf configuration
the interfaces that belong to each IRF port.

So up to here I can assume I have the IRF links with a 20G pipe.


***There is a step on the H3C site about changing mode with the <chassis convert mode irf> but I
don't know if this step is required now that the IRF is up ?????***


I then configured BFD MAD creating a separate VLAN and assigning to diffrent IP adresses per
member:

 

[SWITCH#1] vlan 30

[SWITCH#1-vlan30] port ten-gigabitethernet 1/0/21 ten-gigabitethernet 2/0/21

[SWITCH#1] quit


[SWITCH#1] vlan 30

[SWITCH#1] interface vlan-interface 30

[SWITCH#1-Vlan-interface30] mad bfd enable

[SWITCH#1-Vlan-interface30] mad ip address 192.168.5.1 24 member 1

[SWITCH#1-Vlan-interface30] mad ip address 192.168.5.2 24 member 2

[SWITCH#1] save

[SWITCH#1] quit


Now I created the VLAN for the LACPs:


[SWITCH#1] ip route 0.0.0.0 0.0.0.0 10.0.0.254 (default gateway)

[SWITCH#1] vlan 60

[SWITCH#1] interface vlan-interface 1000

[SWITCH#1-Vlan-interface60] ip address 10.0.0.1 255.255.255.0

[SWITCH#1-Vlan-interface60] description all servers


[SWITCH#1-Vlan-interface60] save


[SWITCH#1-Vlan-interface60]quit


[SWITCH#1] vlan 61

[SWITCH#1] interface vlan-interface 61

[SWITCH#1-Vlan-interface61] description for 2530 Switches


LACP ports for SERVER 2:


<SWITCH#1> system-view

[SWITCH#1] port access permit vlan 60

[SWITCH#1] interface bridge-aggregation 1

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type access

[SWITCH#1] port access permit vlan 60

[SWITCH#1] interface bridge-aggregation 1


[SWITCH#1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/3

[SWITCH#1-Ten-GigabitEthernet1/0/3] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet1/0/3] quit


[SWITCH#1] interface ten-gigabitethernet 2/0/3

[SWITCH#1-Ten-GigabitEthernet2/0/3] port link-aggregation group 1


[SWITCH#1-Ten-GigabitEthernet2/0/3] quit


LACP ports for SERVER 1:


[SWITCH#1] interface bridge-aggregation 2

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type access

[SWITCH#1] port access permit vlan 60

[SWITCH#1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/1

[SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet1/0/1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/2

[SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet1/0/2] quit

[SWITCH#1] interface ten-gigabitethernet 2/0/1

[SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet2/0/1] quit

[SWITCH#1]interface ten-gigabitethernet 2/0/2

SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet2/0/2] quit


LACP for 2530 switches:

 

SWITCH#1] interface bridge-aggregation 3

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type trunk

[SWITCH#1] port access vlan 60

[SWITCH#1] port access vlan 61

[SWITCH#1] quit


[SWITCH#1] interface ten-gigabitethernet 1/0/25

[SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 3

[SWITCH#1-Ten-GigabitEthernet1/0/1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/26

[SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 3

[SWITCH#1-Ten-GigabitEthernet1/0/2] quit

[SWITCH#1] interface ten-gigabitethernet 2/0/25

[SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet2/0/1] quit

[SWITCH#1]interface ten-gigabitethernet 2/0/26

SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet2/0/2] quit

 

If you guys can share a little light on this subject I will really appreciate!!

0 Kudos
3 REPLIES 3
Peter_Debruyne
Honored Contributor

‎10-05-2014 05:36 AM

‎10-05-2014 05:36 AM

Re: IRF and link aggregation problems

order of config is important:

1/ define bagg

2/ assign physical ports

3/ configure bagg with vlans

 

In your example, you define bagg and set the vlans first. Since no physical members exist, the vlan propagation will not be effective on the member ports.

By simply assigning a member port to the link-agg later on, the vlan config is not propagated.

Since the physical member port vlan config does not match the bagg port, the port cannot be used in the link-agg, so no traffic will be forwarded.

 

Basic validation for a bagg1 with sample g1/0/1 and g2/0/1 ports:

dis cur int bagg 1

dis cur int g1/0/1

dis cur int g2/0/1

> verify same port type and vlan configuration

 

Linkagg validation:

dis link-agg summary

dis link-agg verbose

 

best regards,Peter

SambathKH
New Member

‎02-26-2015 08:33 PM

‎02-26-2015 08:33 PM

Re: IRF and link aggregation problems

Hi @RexRay, 

 

I am having the samilar issue as yours. Could you please let me know your status of this setup? 
Much appreciate with your answer. 

Sambath, 

@RexRay wrote:

Hi everybody,

 

I want to first thank to the people here respondisng to post and sharing their knowlage :)

 

We have two HP 5900AF switches that we want to deploy into on our office netwotk in order to take the
advantage of redundancy and bigger bandwith, I configured it the best I could but we running in
to trouble with the end points (servers running CentOs)  when they don't want ro talk to each other, no even on the same switch!!! (pinging just time out every time) I'm runnng the servers with static IPs on VLAN 60.


We want IRF and link aggreagation so here is my configuration and a little schematic:

 

<SWITCH#1> system-view

[SWITCH#1] irf mac-address persistent always (Enable MAC address persistance)

[SWITCH#1] Irf member 1 priority 10

[SWITCH#1] interface ten-gigabitethernet 1/0/17

[SWITCH#1] Ten-GigabitEthernet1/0/17] shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/18

[SWITCH#1] Ten-GigabitEthernet1/0/18] shutdown

[SWITCH#1] irf-port 1/1

[SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

 

( Here I recieved a warning telling me to also shutdown port 19 and 20 because they belong to the
same group so I did and I aso added them to the IRF even knowing that I will only link 17 and 18)

 

[SWITCH#1] interface ten-gigabitethernet 1/0/19

[SWITCH#1] Ten-GigabitEthernet1/0/19] shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/20

[SWITCH#1] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#1] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

[SWITCH#1] irf-port1/1] quit

[SWITCH#1] irf-port 1/2

[SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

[SWITCH#1] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

[SWITCH#1] irf-port1/2] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/17

[SWITCH#1] Ten-GigabitEthernet1/0/17] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/18

[SWITCH#1] Ten-GigabitEthernet1/0/18] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/19

[SWITCH#1] Ten-GigabitEthernet1/0/19] undo shutdown

[SWITCH#1] interface ten-gigabitethernet 1/0/20

[SWITCH#1] Ten-GigabitEthernet1/0/20] undo shutdown

[SWITCH#1] Ten-GigabitEthernet1/0/20] save

[SWITCH#1] irf-port-configuration active


-------------------------------------------------------------------------------------------------
------------------------------


<SWITCH#2> system-view
[SWITCH#2] irf member 1 renumber 2
[SWITCH#2]save
[SWITCH#2]reboot

[SWITCH#2] irf mac-address persistent always (Enable MAC address persistance)

[SWITCH#2] Irf member 2 priority 1

[SWITCH#2] interface ten-gigabitethernet 2/0/17

[SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#1] interface ten-gigabitethernet 2/0/18

[SWITCH#2] Ten-GigabitEthernet1/0/21] shutdown

[SWITCH#2] irf-port 1/1

[SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/17

( Here I recieved the same warning as Switc#1)

[SWITCH#2] interface ten-gigabitethernet 1/0/19

[SWITCH#2] Ten-GigabitEthernet1/0/19] shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/20

[SWITCH#2] Ten-GigabitEthernet1/0/20] shutdown

[SWITCH#2] irf-port1/1] port group interface ten-gigabitethernet 1/0/19

[SWITCH#2] irf-port1/1] quit

[SWITCH#2] irf-port 1/2

[SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/18

[SWITCH#2] irf-port1/2] port group interface ten-gigabitethernet 1/0/20

[SWITCH#2] irf-port1/2] quit

[SWITCH#2] interface ten-gigabitethernet 1/0/17

[SWITCH#2] Ten-GigabitEthernet1/0/17] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/18

[SWITCH#2] Ten-GigabitEthernet1/0/18] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/19

[SWITCH#2] Ten-GigabitEthernet1/0/19] undo shutdown

[SWITCH#2] interface ten-gigabitethernet 1/0/20

[SWITCH#2] Ten-GigabitEthernet1/0/20] undo shutdown

[SWITCH#2] Ten-GigabitEthernet1/0/20] save

[SWITCH#2] irf-port-configuration active


At this pont I connected the DAC like this:

 

port ten-gigabitethernet 1/0/17 to ten-gigabitethernet 2/0/18 and port ten-gigabitethernet 1/0/18
to ten-gigabitethernet 2/0/17

 

Then Switch#1 start propagating his image to swtich#2 and when this prosess is done I see that the
sysname of Switch#2 changed to Switch#1 and can see with the <disp irf> command that member 1 is
"master" and member 2 is "standby", I see on irf topology the links are UP and on irf configuration
the interfaces that belong to each IRF port.

So up to here I can assume I have the IRF links with a 20G pipe.


***There is a step on the H3C site about changing mode with the <chassis convert mode irf> but I
don't know if this step is required now that the IRF is up ?????***


I then configured BFD MAD creating a separate VLAN and assigning to diffrent IP adresses per
member:

 

[SWITCH#1] vlan 30

[SWITCH#1-vlan30] port ten-gigabitethernet 1/0/21 ten-gigabitethernet 2/0/21

[SWITCH#1] quit


[SWITCH#1] vlan 30

[SWITCH#1] interface vlan-interface 30

[SWITCH#1-Vlan-interface30] mad bfd enable

[SWITCH#1-Vlan-interface30] mad ip address 192.168.5.1 24 member 1

[SWITCH#1-Vlan-interface30] mad ip address 192.168.5.2 24 member 2

[SWITCH#1] save

[SWITCH#1] quit


Now I created the VLAN for the LACPs:


[SWITCH#1] ip route 0.0.0.0 0.0.0.0 10.0.0.254 (default gateway)

[SWITCH#1] vlan 60

[SWITCH#1] interface vlan-interface 1000

[SWITCH#1-Vlan-interface60] ip address 10.0.0.1 255.255.255.0

[SWITCH#1-Vlan-interface60] description all servers


[SWITCH#1-Vlan-interface60] save


[SWITCH#1-Vlan-interface60]quit


[SWITCH#1] vlan 61

[SWITCH#1] interface vlan-interface 61

[SWITCH#1-Vlan-interface61] description for 2530 Switches


LACP ports for SERVER 2:


<SWITCH#1> system-view

[SWITCH#1] port access permit vlan 60

[SWITCH#1] interface bridge-aggregation 1

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type access

[SWITCH#1] port access permit vlan 60

[SWITCH#1] interface bridge-aggregation 1


[SWITCH#1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/3

[SWITCH#1-Ten-GigabitEthernet1/0/3] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet1/0/3] quit


[SWITCH#1] interface ten-gigabitethernet 2/0/3

[SWITCH#1-Ten-GigabitEthernet2/0/3] port link-aggregation group 1


[SWITCH#1-Ten-GigabitEthernet2/0/3] quit


LACP ports for SERVER 1:


[SWITCH#1] interface bridge-aggregation 2

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type access

[SWITCH#1] port access permit vlan 60

[SWITCH#1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/1

[SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet1/0/1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/2

[SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet1/0/2] quit

[SWITCH#1] interface ten-gigabitethernet 2/0/1

[SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet2/0/1] quit

[SWITCH#1]interface ten-gigabitethernet 2/0/2

SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 2

[SWITCH#1-Ten-GigabitEthernet2/0/2] quit


LACP for 2530 switches:

 

SWITCH#1] interface bridge-aggregation 3

[SWITCH#1] link-aggregation mode dynamic

[SWITCH#1] port link-type trunk

[SWITCH#1] port access vlan 60

[SWITCH#1] port access vlan 61

[SWITCH#1] quit


[SWITCH#1] interface ten-gigabitethernet 1/0/25

[SWITCH#1-Ten-GigabitEthernet1/0/1] port link-aggregation group 3

[SWITCH#1-Ten-GigabitEthernet1/0/1] quit

[SWITCH#1] interface ten-gigabitethernet 1/0/26

[SWITCH#1-Ten-GigabitEthernet1/0/2] port link-aggregation group 3

[SWITCH#1-Ten-GigabitEthernet1/0/2] quit

[SWITCH#1] interface ten-gigabitethernet 2/0/25

[SWITCH#1-Ten-GigabitEthernet2/0/1] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet2/0/1] quit

[SWITCH#1]interface ten-gigabitethernet 2/0/26

SWITCH#1-Ten-GigabitEthernet2/0/2] port link-aggregation group 1

[SWITCH#1-Ten-GigabitEthernet2/0/2] quit

 

If you guys can share a little light on this subject I will really appreciate!!

 

0 Kudos
sdide
Respected Contributor

‎02-26-2015 11:58 PM

‎02-26-2015 11:58 PM

Re: IRF and link aggregation problems

Hi Rexray

 

ok. Lots of config here.

 

1: Have you tried just connecting your CentOS servers in a single access port (no BAGG) and then just testing for normal connectivity?

 

2: When you enable LACP, what does your CentOS config look like (assuming interfaces tgeX and tgeY bonds to bond0)? Your bond0 interface should be up, etc.

 

Regards

 

 

 

Søren Dideriksen, Network Administrator
Region Midtjylland
0 Kudos
The opinions expressed above are the personal opinions of the authors, not of Hewlett Packard Enterprise. By using this site, you accept the Terms of Use and Rules of Participation.