Community discussions

MikroTik App
 
25Gbits
just joined
Topic Author
Posts: 2
Joined: Wed Apr 20, 2022 10:04 pm

Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Wed Apr 20, 2022 10:21 pm

Hey

I am one of whose guys with 25 Gbit/s Fiber in Switzerland.

I use a Mikrotik ccr2004-1g-12s+2xs as the Router and directly behind it I have a CRS309 Switch. I also, have another CRS309 in another room. Both CRS309 are connected with each other. The Mikrotik ccr2004-1g-12s+2xs is only connected via an SFP28 Modul to WAN, and via one (two when I tried bonding) cable with the first CRS309 Switch.

So far, my Threadripper Pro System could achieve around 8 Gbit/s via iperf to the WAN via the 10G Ethernet Port. The Router was near 100% with that traffic.

Now I tried bonding via DAC cables between the Router (Mikrotik ccr2004-1g-12s+2xs?) and the Switch (CRS309). I tried 802.3ad (MII Link Monitoring) and balance rr Mode (ARP Monitoring). Both worked. However, it seems that bonding eats so much CPU Power on the Mikrotik ccr2004-1g-12s+2xs that then iperf went even down to 4 Gbit/s (with the Router being at 100% CPU Load).

Is there a trick to reduce CPU load on the Router or does bonding really that useless on it because it even halves the maximum bandwidth?

Settings for 802.3ad and ARP Link Monitoring:

Switch:
/interface bonding add slaves=sfp-sfpplus2,sfp-sfpplus3 name=bond
/ip address add address=172.16.0.200/24interface=bond
/interface bonding set [find name=bond1] link-monitoring=arp arp-ip-targets=172.16.0.255

Router:
/interface bonding add slaves=sfp-sfpplus4,sfp-sfpplus5 name=bond
/ip address add address=172.16.0.255/24interface=bond
/interface bonding set [find name=bond1] link-monitoring=arp arp-ip-targets=172.16.0.200

For 802.3.ad I just switched to 802.3ad / Mii / Layer in WinBox. Effect is the same.
 
User avatar
Znevna
Forum Guru
Forum Guru
Posts: 1347
Joined: Mon Sep 23, 2019 1:04 pm

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Thu Apr 21, 2022 7:57 pm

bonding is done in software in a lot of devices, read the documentation.
 
25Gbits
just joined
Topic Author
Posts: 2
Joined: Wed Apr 20, 2022 10:04 pm

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Thu Apr 21, 2022 8:13 pm

So what is the verdict of your posting? Since bonding is done on a software level, one should expect a 50% throughput decrease?

Actually, I was looking for ideas to improve the situation and make it less cpu hungry.
 
Guscht
Member Candidate
Member Candidate
Posts: 236
Joined: Thu Jul 01, 2010 5:32 pm

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Fri Apr 22, 2022 12:18 am

This CCR2004 has no hardware-switch chip, so all L2-Features have to be CPU-emulated.
It seems this is the best the CPUs can do. In the test-results (https://mikrotik.com/product/ccr2004_1g ... estresults), 25 Firewall-Filter-Rules will also decrease the througput to ~4,5GBit.

But as of today, 25GBit is more a joke than really useable. Almost nothing can handle this speed, the network equipment, your "PC", your storage, the remote server, the WiFi. This speed is beyond the scope of most of the enterprise equipment out there. Even ROSv7 cant Queue this, because there is 2^32 Bit Limit (~4,3GBit). So basically you see simply the border of the "state of the art" as of today. Thats like: Its 1995 and your Win95-Hardware + your half-duplex hub should be able to provide full VDSL-Speed, but everyone around you usese a 56k dial-up connection.

My only "tipp" for you, be happy to have such a decent speed. And for the 25GBit, wait 5 or 10 years until hardware is out, which can handle these speeds. Or buy really high-end quipment, which can handle 25GBit. But thats in the year 2022 not Mikrotik. Look for Cisco, Brocade, Juniper...
 
glow
newbie
Posts: 29
Joined: Sun Dec 05, 2021 1:56 am

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Fri Apr 22, 2022 1:43 am

This CCR2004 has no hardware-switch chip, so all L2-Features have to be CPU-emulated.
It seems this is the best the CPUs can do. In the test-results (https://mikrotik.com/product/ccr2004_1g ... estresults), 25 Firewall-Filter-Rules will also decrease the througput to ~4,5GBit.

But as of today, 25GBit is more a joke than really useable. Almost nothing can handle this speed, the network equipment, your "PC", your storage, the remote server, the WiFi. This speed is beyond the scope of most of the enterprise equipment out there. Even ROSv7 cant Queue this, because there is 2^32 Bit Limit (~4,3GBit). So basically you see simply the border of the "state of the art" as of today. Thats like: Its 1995 and your Win95-Hardware + your half-duplex hub should be able to provide full VDSL-Speed, but everyone around you usese a 56k dial-up connection.

My only "tipp" for you, be happy to have such a decent speed. And for the 25GBit, wait 5 or 10 years until hardware is out, which can handle these speeds. Or buy really high-end quipment, which can handle 25GBit. But thats in the year 2022 not Mikrotik. Look for Cisco, Brocade, Juniper...

I would recommend looking at what your fellow Swiss are doing:
https://medium.com/@sdier/new-internet- ... bebbdc6dbd
https://michael.stapelberg.ch/posts/202 ... -pc-build/
Both were/are 10Gbps setups at the time. The second one replaced the CCR2004 with a custom router build.
 
adcre
newbie
Posts: 27
Joined: Fri Dec 10, 2021 4:18 pm

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Sat Apr 23, 2022 12:54 am

Hello,

What software version are you using?

I did got a test setup with 7beta doing test between 2 ccr2004-1g-12s with crs317 and mlag and btest were about your speed but router should give a bit more as lot of cpu was used by btest in my setup.
(Note that is not good to measure speed from router as I did. Documentation said: "Bandwidth Test uses a lot of resources. If you want to test real throughput of a router, you should run bandwidth test through the tested router not from or to it")

Best Regards,

Diego
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: Bonding useless on Mikrotik CCR2004-1G-12S+2XS?

Sat Apr 23, 2022 1:21 am

Same question as another user... what version of software do you have on the 2004?

I have 7.2.1 on mine and it made a huge difference in performance (compared to 7.1 and 6.47/48/49). That said, I doubt it'll be able to route much above 10Gbps.

The most I've successfully tested through mine is 6Gbps bridged from a 10Gbps port to a 25Gbps port (both using 10Gbps SFP+ modules; 6Gbps bottleneck was the 27km 80GHz uplink to the datacenter).

Who is online

Users browsing this forum: baragoon, Bing [Bot], fposavec, FranMercedesG, keithy, korg and 92 guests