Community discussions

MikroTik App
 
lwi
just joined
Topic Author
Posts: 2
Joined: Wed Jan 05, 2022 1:49 am

MLAG: What traffic actually goes through the peer ports?

Wed Jan 05, 2022 2:04 am

I did a little miscalculation and forgot to account for the traffic flowing between the peer ports.

I bought two CRS326-24G-2S+ and was planning on using one or two of the SFP+-ports as uplinks. However, that'd only leave gigabit ports for the MLAG-interconnect.

If I only use one SFP+ per switch for the interconnect and one for the uplink, assuming actual traffic flows through the interconnect, I'd already have it run at it's max capacity, leaving nothing for the other 24 gigabit ports.

So my question is: What and how much traffic actually goes through the interconnect - how much did I mess up?
 
connectlife
Member Candidate
Member Candidate
Posts: 100
Joined: Tue Sep 01, 2020 10:20 pm

Re: MLAG: What traffic actually goes through the peer ports?

Wed Jan 05, 2022 2:40 pm

From the tests I carried out assuming an optimal network condition, where all the ports are UP, the traffic passes through the bonding interfaces, without therefore asking the peer port. The traffic on the peer port passes when the client must necessarily do so from the peer port to reach the destination, for example:

Switch 1:
Bonding 1> Client 1> SFP1
Bonding 2> Client 2> SFP2

Switch 2:
Bonding 1> Client 1 SFP1
Bonding 2> Client 2> SFP2

The two switches can be seen from the peer port, for example SFP24

If you interrupt the SFP1 / Client1 / Switch 1 and the SFP2 / Client2 / Switch2 you will see that the traffic passes from the SFP24 or the peer port ..
Hello
 
lwi
just joined
Topic Author
Posts: 2
Joined: Wed Jan 05, 2022 1:49 am

Re: MLAG: What traffic actually goes through the peer ports?

Mon Jan 10, 2022 6:55 pm

That makes sense, thank you! Much appreciated.
 
rooin
newbie
Posts: 47
Joined: Tue Feb 22, 2011 10:44 am

Re: MLAG: What traffic actually goes through the peer ports?

Mon Jan 10, 2022 11:21 pm

From the tests I carried out assuming an optimal network condition, where all the ports are UP, the traffic passes through the bonding interfaces, without therefore asking the peer port. The traffic on the peer port passes when the client must necessarily do so from the peer port to reach the destination, for example:

Switch 1:
Bonding 1> Client 1> SFP1
Bonding 2> Client 2> SFP2

Switch 2:
Bonding 1> Client 1 SFP1
Bonding 2> Client 2> SFP2

The two switches can be seen from the peer port, for example SFP24

If you interrupt the SFP1 / Client1 / Switch 1 and the SFP2 / Client2 / Switch2 you will see that the traffic passes from the SFP24 or the peer port ..
This is not the behavior I have seen with my MLAG configuration.
2x CRS354-48G peer'd via QSFP 1-1 (01/02)
MLAG 2x2-4Port total LACP to adjacent switch (Procurve)
A third CRS354-48G (03) is connected to switch 354-01 via single QSFP 2-1

Video server connected to 354-03 while cameras are fed from Procurve.
I see Bulk of data streams going to 354-02, traversing the PEER to get to SW-01 to then traverse the standard QSFP link to 354-03.
Even though the most direct path is MLAG to 354-01 > QSFP > 354-03.
MLAG_example.png
So while in your example two clients MLAG between the two switches directly may work as expected, it's not always the case and PEER link capacity does need to be considered.
You do not have the required permissions to view the files attached to this post.
 
User avatar
mkx
Forum Guru
Forum Guru
Posts: 11628
Joined: Thu Mar 03, 2016 10:23 pm

Re: MLAG: What traffic actually goes through the peer ports?

Tue Jan 11, 2022 7:18 am

Device which uses LAG to connect to two different switches doesn't know (nor care) about topology beyond its link peer(s) and selects one of physical links for Tx acording to selected Tx strategy (e.g. L2+L3 hash). If it selects "wrong" link, then of course switch has to pass that traffic to the other MLAG peer over peer link.
And vice versa: in your particular case CRS-01 will pass all traffic towards Procurve directly, none of that traffic will pass MLAG peer link (as long as direct link is alive). If you had a (normal) LAG link with two members between CRS-01 and Procurve, then CRS-01 might select different physical links for part of traffic (depending on Tx strategy).
 
rooin
newbie
Posts: 47
Joined: Tue Feb 22, 2011 10:44 am

Re: MLAG: What traffic actually goes through the peer ports?

Tue Jan 11, 2022 8:19 pm

Yeah I am aware an not surprised by the way my traffic is traversing the switches.
I was just adding insight to OP's question about what traffic can travers the PEER interface. In a scenario where two clients are MLAG to the same pair of switches its unlikely to see much PEER link traffic, however in my scenario it totally needs to be included in the topology decision.
Fortunately for me 40Gb links between the CRS354s is completely future proof for my needs an I will never have to worry about link saturation.

Who is online

Users browsing this forum: qatar2022 and 182 guests