Hey
I am one of whose guys with 25 Gbit/s Fiber in Switzerland.
I use a Mikrotik ccr2004-1g-12s+2xs as the Router and directly behind it I have a CRS309 Switch. I also, have another CRS309 in another room. Both CRS309 are connected with each other. The Mikrotik ccr2004-1g-12s+2xs is only connected via an SFP28 Modul to WAN, and via one (two when I tried bonding) cable with the first CRS309 Switch.
So far, my Threadripper Pro System could achieve around 8 Gbit/s via iperf to the WAN via the 10G Ethernet Port. The Router was near 100% with that traffic.
Now I tried bonding via DAC cables between the Router (Mikrotik ccr2004-1g-12s+2xs?) and the Switch (CRS309). I tried 802.3ad (MII Link Monitoring) and balance rr Mode (ARP Monitoring). Both worked. However, it seems that bonding eats so much CPU Power on the Mikrotik ccr2004-1g-12s+2xs that then iperf went even down to 4 Gbit/s (with the Router being at 100% CPU Load).
Is there a trick to reduce CPU load on the Router or does bonding really that useless on it because it even halves the maximum bandwidth?
Settings for 802.3ad and ARP Link Monitoring:
Switch:
/interface bonding add slaves=sfp-sfpplus2,sfp-sfpplus3 name=bond
/ip address add address=172.16.0.200/24interface=bond
/interface bonding set [find name=bond1] link-monitoring=arp arp-ip-targets=172.16.0.255
Router:
/interface bonding add slaves=sfp-sfpplus4,sfp-sfpplus5 name=bond
/ip address add address=172.16.0.255/24interface=bond
/interface bonding set [find name=bond1] link-monitoring=arp arp-ip-targets=172.16.0.200
For 802.3.ad I just switched to 802.3ad / Mii / Layer in WinBox. Effect is the same.