Community discussions

MikroTik App
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Cisco Bonding not working

Sat Nov 16, 2019 2:15 pm

Hi all,

I have Cisco 7606 and CCR1036, Huawei S5701.
I have connected 2 gig ports on bonding but the traffic is not sharing for both Ports.
I did 2 Bondings for LAN and Wan, Lan is connected to Huawei switch with balance rr and Wan is connected is on 802.3ad.
For LAN Balance rr is working fine.
For WAN I have tried all options but same issue in all things and some are not going to up also.
bonding.PNG
bond.PNG
LAN = Huawei switch
WAN= Cisco 7606

In the Cisco port config:
interface Port-channel101
description "***MTK101***"
ip address 1.1.1.1 255.255.255.252
speed nonegotiate
---
interface GigabitEthernet2/28
no ip address
channel-protocol lacp
channel-group 101 mode active
!
interface GigabitEthernet2/29
no ip address
speed nonegotiate
channel-protocol lacp
channel-group 101 mode active
====
In the Huawei switch config below screenshot
huawei.PNG
You do not have the required permissions to view the files attached to this post.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Sat Nov 16, 2019 2:25 pm

But i can see traffic in both ether1 and ether2...
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Sat Nov 16, 2019 2:43 pm

Yes traffic is going on but when i used 1gig more traffic it was not sharing on both.
But i can see traffic in both ether1 and ether2...
bond1.PNG
speedtest.PNG
You do not have the required permissions to view the files attached to this post.
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Sat Nov 16, 2019 3:17 pm

802.3ad can't spread a single connection to multiple links.

And even more: L2+L3 hash means that even multiple connections between two particular hosts will use only one of the links.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Sun Nov 17, 2019 10:29 am

802.3ad can't spread a single connection to multiple links.
That is true
L2+L3 hash means that even multiple connections between two particular hosts will use only one of the links.
You mean LACP does not work on L2+L3 hash ?
Because even in the wiki the example uses L2+L3
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:02 pm

You mean LACP does not work on L2+L3 hash ?
Because even in the wiki the example uses L2+L3
No, it means L2+L3 hash is "maximum level" hash for LACP bonding.
LACP does not support L3+L4 hash.

Balance-xor does, and also switch chip on CRS always uses L2+L3+L4 hash policy.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:08 pm

L2+L3
No, it means L2+L3 hash is "maximum level" hash for LACP bonding.
LACP does not support L3+L4 hash.
I do not understand what is your point...
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:25 pm

L2+L3
No, it means L2+L3 hash is "maximum level" hash for LACP bonding.
LACP does not support L3+L4 hash.
I do not understand what is your point...
My point is you can't test throughput of a bond that is using L2+L3 hash with bandwidth test between only two devices at a time, even if you establish multiple connections.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:29 pm

So you say that LACP does not work when L2+L3 hash is used right?
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:35 pm

So you say that LACP does not work when L2+L3 hash is used right?
No.
I say, that when L2+L3 is used the hash result between two hosts will always be the same, resulting all connections between these two host will always end up to use one particular link.
So to fully utilise the bond you need multiple host pairs.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Sun Nov 17, 2019 12:44 pm

Ok got it now...
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 9:59 am

HI all,

Can you please suggest me for Cisco to CCR bond issue.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Mon Nov 18, 2019 10:12 am

HI all,

Can you please suggest me for Cisco to CCR bond issue.
Did you read all the posts above ?
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 12:45 pm

If i have changed from 802.3ad bond link getting down.
802.3ad can't spread a single connection to multiple links.

And even more: L2+L3 hash means that even multiple connections between two particular hosts will use only one of the links.
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 12:51 pm

So can i try as below setup?
wan-bond.PNG
You mean LACP does not work on L2+L3 hash ?
Because even in the wiki the example uses L2+L3
No, it means L2+L3 hash is "maximum level" hash for LACP bonding.
LACP does not support L3+L4 hash.

Balance-xor does, and also switch chip on CRS always uses L2+L3+L4 hash policy.
You do not have the required permissions to view the files attached to this post.
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Mon Nov 18, 2019 1:00 pm

You can try balance-xor if cisco supports it, yes, but that's not the point: there is nothing wrong with 802.3ad, you just don't test it right.
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 1:07 pm

I have tried with Balance xor so the bond was no network on it.
You can try balance-xor if cisco supports it, yes, but that's not the point: there is nothing wrong with 802.3ad, you just don't test it right.
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 1:13 pm

If i want to add 2more ports which one is work ?
Total 4 eth ports.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: Cisco Bonding not working

Mon Nov 18, 2019 1:25 pm

As @xvo said, there is nothing wrong with the 802.3 ad.
Just test it with more that one hosts, eg computers. Generate traffic from 2-3 Computers to your server, computer etc and then see if the traffic is balanaced.
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Mon Nov 18, 2019 1:28 pm

I have issue with it when i reach more than 1 gig Traffic i have got packet drops issue.
Only 1 Interface is working full traffic other interfaces are going with 100 to 200Mbps traffic.
As @xvo said, there is nothing wrong with the 802.3 ad.
Just test it with more that one hosts, eg computers. Generate traffic from 2-3 Computers to your server, computer etc and then see if the traffic is balanaced.
 
mbovenka
Member
Member
Posts: 338
Joined: Mon Oct 14, 2019 10:14 am

Re: Cisco Bonding not working

Mon Nov 18, 2019 2:41 pm

I have issue with it when i reach more than 1 gig Traffic i have got packet drops issue.
Only 1 Interface is working full traffic other interfaces are going with 100 to 200Mbps traffic.
That means that one (or more, if they get sorted to the same interface) of your flows tries to send more than 1Gbps total. The packet drops will push back at TCP to fix that, assuming the flows are TCP. If the other interfaces in the channel do carry traffic, the load balancing is doing what it can, and your traffic just doesn't have enough entropy for the LB algorithm to load balance it better.
 
User avatar
danunjaya123
Member Candidate
Member Candidate
Topic Author
Posts: 101
Joined: Thu Oct 03, 2019 7:36 am
Location: India

Re: Cisco Bonding not working

Tue Nov 19, 2019 7:49 am

I have tried same Bandwidth test from LAN Bond in that i have seen 2Gig reaching both ports are using full fledge.
I have issue with it when i reach more than 1 gig Traffic i have got packet drops issue.
Only 1 Interface is working full traffic other interfaces are going with 100 to 200Mbps traffic.
That means that one (or more, if they get sorted to the same interface) of your flows tries to send more than 1Gbps total. The packet drops will push back at TCP to fix that, assuming the flows are TCP. If the other interfaces in the channel do carry traffic, the load balancing is doing what it can, and your traffic just doesn't have enough entropy for the LB algorithm to load balance it better.
 
User avatar
xvo
Forum Guru
Forum Guru
Posts: 1237
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: Cisco Bonding not working

Tue Nov 19, 2019 9:08 am

I have tried same Bandwidth test from LAN Bond in that i have seen 2Gig reaching both ports are using full fledge.
That is not surprising: on LAN bond you are using balance-rr mode that can utilise both links even for single connection, so it can be properly tested by single bandwidth test.

Who is online

Users browsing this forum: No registered users and 16 guests