After 4 years & a WAN upgrade to 2.5Gbps, I have reached the limits of RB5009. I wanted to take a moment to share the journey so far, talk about the current setup, and share what is coming next. I am making this time to acknowledge all the great answers in this thread, and share something that I hope will be useful to others as they experience the best that MikroTik has to offer.
To set the context, I have just under 10 hosts which are 10Gbps capable. Most are running Linux (including a TrueNAS host), a few Macs and one Windows machine. I have a home office, have a few TBs of 4k content that I produce, transfer large files on a daily basis and my TrueNAS + another Linux host are often sync-ing 4k video files @ 10Gbps. Two of my Linux hosts are 100Gbps capable (Mellanox ConnectX-5 via DAC) and I often benchmark CDN-like software that hits CPU & NVMe limits first, before it maxes out 100Gbps (the goal is to benchmark the software, not be bottlenecked by the network).
HOW IT STARTED: RB5009 running 1Gbps PPPoE WAN & 10Gbps LAN
THE GAME CHANGER: CRS312
The only significant network equipment that I added in the last years was the CRS312-4C+8XG-RM which is the core switch for all 10Gbps-capable devices. It’s a fantastic piece of kit! Once I got some proper CAT6A cables for the long runs, and CAT7 & CAT8 for the short runs (including patch cables) I had 0 issues since (2+ hassle-free years). Cables are super important important. I had issues with some thin & fancy patch network cables that looked good (like the ones on the RB5009), but ended up introducing instability in the network (packet loss, random connection drops, etc.).
As my hardware kept improving, the RB5009UG+S+IN has been chugging along like a champ, providing a consistent 2Gbps symmetric WAN. It’s running a lightweight firewall & some simple queues, but nothing else (no BGP, VPN, etc.). I had no reboots, no heat issues, the RB5009 is as solid as they come.
As for the S+RJ10 module that I mentioned previously, I ended up fitting a few tiny Pi Zero heatsinks. While it still ran hot - ~80C - after years of use, it turned out to be OK.
END OF THE ROAD: RB5009 running 2.5Gbps PPPoE WAN & 10Gbps LAN
4 years later, as I started preparing for the 5Gbps WAN upgrade, the RB5009 is no longer sufficient. It has a single (10Gbps) SFP+ port, and a single 2.5Gbps RJ45 port which forced me to look at alternatives. As far as MikroTik routers go, there are only three alternatives today:
- CCR2004-1G-12S+2XS
- CCR2216-1G-12XS-2XQ
- RDS2216
Considering the price of 2 & 3, the only sensible alternative for a 5Gbps WAN and 10Gbps LAN is the CCR2004.
I now have the CCR2004 finally set up, the 10Gbps capable WAN uplink is running on one of the SFP28 ports via the S+RJ10 and while I am still waiting for 5Gbps to become available, here is a speedtest on the 2.5Gbps WAN to see how much CPU pressure this puts on the CCR2004:
To be honest, I was not expecting the CCR2004 CPUs to run at 41% utilisation across all cores, with 2/4 cores at 66% capacity for 2.5Gbps WAN. That PPPoE penalty seems to be more significant than I initially thought…
I have FastTrack enabled, and I have confirmed that the packets are using it, but this makes me wonder if the 5Gbps WAN is going to be as much as the CCR2004 is able to handle. Given that 2.5Gbps use 41% of the CPU, simple math makes me assume that 7-8Gbps PPPoE WAN is the most that this router can handle. If I am still running the CCR2004 by the time I get the 5Gbps upgrade, I intend to circle back with those numbers.
By the way, I benchmarked 2 of the hosts connected directly to the router, and iperf3 topped at 8Gbps after I tuned the interface queues (only-hardware-queue was maxing out at 6Gbps). CPU utilisation was at 80-90%, with 3/4 cores fully maxed out. This makes me realise that the “all port” wording in the ethernet test results is important. FWIW:
Some resources that I found useful when considering the CCR2004:
While I expect a 5Gbps PPPoE WAN to be the most that the CCR2004 can handle, I don’t see myself keeping it for 10Gbps, and definitely not for 25Gbps. While today my primary core router after the RB5009 is the CCR2004, it’s hard to imagine sticking with it long-term.
As I take a step back and consider upgrade paths, I wanted to share one last picture from 2025, with my network cabinet that got some care & attention over the winter holidays (even though that patch panel needs an entire strip-down so that ports can be re-arranged - they are all over the place):
I’m curious, what would the seasoned MikroTik users recommend for a 10Gbps PPPoE WAN?