Community discussions

MikroTik App
 
fcoulloudon
just joined
Topic Author
Posts: 13
Joined: Tue May 02, 2023 9:10 pm

LACP and download speed

Tue May 30, 2023 5:51 pm

Good afternoon all.

I have two machines connected via twin 25GBPS links each to my MikroTik CRS510-8XS-2XQ-IN

On the first machine
cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v5.15.0-72-generic

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 200
Down Delay (ms): 200
Peer Notification Delay (ms): 0

802.3ad info
LACP active: on
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable

Slave Interface: enp65s0f1
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 3
Permanent HW addr: 50:7c:6f:22:8f:23
Slave queue ID: 0
Aggregator ID: 2
Actor Churn State: none
Partner Churn State: none
Actor Churned Count: 1
Partner Churned Count: 1

Slave Interface: enp65s0f0
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 3
Permanent HW addr: 50:7c:6f:22:8f:22
Slave queue ID: 0
Aggregator ID: 2
Actor Churn State: none
Partner Churn State: none
Actor Churned Count: 0
Partner Churned Count: 1
On the second machine
cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v5.15.0-72-generic

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 200
Down Delay (ms): 200
Peer Notification Delay (ms): 0

802.3ad info
LACP active: on
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable

Slave Interface: enp65s0f1
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 50:7c:6f:22:8e:f1
Slave queue ID: 0
Aggregator ID: 1
Actor Churn State: none
Partner Churn State: none
Actor Churned Count: 0
Partner Churned Count: 0

Slave Interface: enp65s0f0
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 50:7c:6f:22:8e:f0
Slave queue ID: 0
Aggregator ID: 1
Actor Churn State: none
Partner Churn State: none
Actor Churned Count: 0
Partner Churned Count: 0
And Mikrotik configuration
[admin@MikroTik] /interface/bonding> print
Flags: X - disabled; R - running
0 R name="Bond1" mtu=9000 mac-address=48:A9:8A:93:2B:17 arp=enabled arp-timeout=auto slaves=qsfp28-1-1,qsfp28-1-2 mode=802.3ad primary=none link-monitoring=mii arp-interval=100ms arp-ip-targets="" mii-interval=100ms
down-delay=200ms up-delay=200ms lacp-rate=1sec transmit-hash-policy=layer-2 min-links=1

The communication is great but when testing network speed with iperf (Ubuntu 20.04), I can only reach 24.7 Gbits/sec.
Any idea why I can't reach double the bandwith?

From the switch UI, I can see:
Last Link Down Time May/30/2023 16:17:34
Last Link Up Time May/30/2023 16:18:18
Link Downs 15
Mode 802.3ad
Active Ports
qsfp28-1-1
qsfp28-1-2
Inactive Ports (none)
LACP System ID 48:A9:8A:93:2B:17
LACP System Priority 65535
LACP Partner System ID CE:96:5B:7F:F1:5F

Any suggestion to get double the bandwidth?
 
fcoulloudon
just joined
Topic Author
Posts: 13
Joined: Tue May 02, 2023 9:10 pm

Re: LACP and download speed

Tue May 30, 2023 5:55 pm

Who is online

Users browsing this forum: Google [Bot] and 59 guests