Help needed: Choosing an alternative for CCR2216

[lojasyst]

Hello everyone,

I’m currently facing an issue with my CCR2216 when using a full BGP routing table. The device starts to lose packets, and the CPU usage spikes to 95%. I need a solution capable of handling approximately 100 Gbps of traffic.

Here are the options I’ve considered so far:

1. Install Mikrotik CHR on a PROXMOX server with an Intel Xeon CPU E5-2699C v4 (88 cores) that I already own.
2. Install Mikrotik ISO on an Ampere Altra Q80-30 server (which I would need to purchase).

I’m open to exploring other solutions as well. Your advice and recommendations would be greatly appreciated.

Thanks in advance!

[anavk0]

Probably your setup, the router is spec’d at handling up to approx 180Gbps of traffic with filter rules.

[Maggiore81]

1. Install Mikrotik CHR on a PROXMOX server with an Intel Xeon CPU E5-2699C v4 (88 cores) that I already own.

I’m open to exploring other solutions as well. Your advice and recommendations would be greatly appreciated.

Thanks in advance!

That CPU is 22 core, dont confuse cores with threads.
I suggest you for your kind of setup, a Juniper MX204 (that I have for sale brand new boxed)

Unfortunately your post doesnt have any conf so we cannot see where issues are on the conf… we are not wizards!
the 2216 should do that traffic in the right scenario.

[lojasyst]

That CPU is 22 ore, dont confuse cores with thread.
I suggest you for your kind of setup, a Juniper MX204 (that I have for sale brand new boxed)

Unfortunately your post doesnt have any conf so we cannot see where issues are on the conf… we are not wizards!
the 2216 should do that traffic in the right scenario.

Thank you, please PM to discuss about Juniper MX204.

[Maggiore81]

Hello
My mail is admin at spadhausen dot com
I dont know how PM here works.

[holvoetn]

I dont know how PM here works.

It doesn’t.

[lojasyst]

Any other sugestion?

[sirbryan]

Any other sugestion?

Your question is missing important detail:

How many upstream peers?
How many downstream peers (if any)?
Do you need full BGP tables?
Are you using L3HW offload, and if so, is the router configured properly to support hardware offload?
What does the profiler say is pegging your CPU?

[lojasyst]

hi,

Three upstream and downstream peers, I need full BGP tables, I have enabled L3HW offload.

Currently without full BGP tables the CPU is at 60% at peak tiemes, of course I have no firewall rules, no nat, just BGP. A couple of bonding and some VLANs

[Maggiore81]

Are you using the single-bridge configuration to benefit from l3-hw?
can you post your config?

[lojasyst]

I have no bridge.

Should I create a bridge with all physical ports or bonds that I am using and set up properly in VLAN tab of the bridge?

[Maggiore81]

Absolutely yes! You should do a single bridge and put VLAN there, otherwhise they are via CPU!
Attaching the VLAN to the phisical port is an old-way procedure that has been replaced by the single bridge!


https://help.mikrotik.com/docs/spaces/ROS/pages/30474317/CRS3xx+CRS5xx+CCR2116+CCR2216+switch+chip+features

[sirbryan]

I have no bridge.

Should I create a bridge with all physical ports or bonds that I am using and set up properly in VLAN tab of the bridge?

Double yes.

[merkkg]

Absolutely yes! You should do a single bridge and put VLAN there, otherwhise they are via CPU!
Attaching the VLAN to the phisical port is an old-way procedure that has been replaced by the single bridge!


https://help.mikrotik.com/docs/spaces/ROS/pages/30474317/CRS3xx+CRS5xx+CCR2116+CCR2216+switch+chip+features

Either I’m reading help page incorrectly but It didn’t occur to me that all interface that you want to use L3HW offloading has to be done via bridge… I’m not sure it’s clear enough in documentation. The L3HW offloading is under the bridge and switching section though.

So we can’t just have 2 or more ports that are part of any bridge to be routed and take advantage of L3HW? Why do I still see the H on my routes then…

[chechito]

the main objective using single bridge is to use bridge vlan filtering

https://help.mikrotik.com/docs/spaces/ROS/pages/328068/Bridging+and+Switching#BridgingandSwitching-BridgeVLANFiltering

[merkkg]

the main objective using single bridge is to use bridge vlan filtering

https://help.mikrotik.com/docs/spaces/ROS/pages/328068/Bridging+and+Switching#BridgingandSwitching-BridgeVLANFiltering

Yes agreed but in my case particularly I don’t need vlans

Example:
Ether1 is isp with public ip and bgp
Ether2…10 is internal network with public ip from own as number…

No vlans, no bridge, no dhcp, no firewall, no nat, no connection tracking, just routing packets from ether1 to ether2 and back as example.

[chechito]

No vlans, no bridge

then you won’t have L3 hardware offload acceleration, which is the key feature of ccr2216

even if you dont use vlans (or tag vlans), you can implement/convert your scheme to using bridge vlan filtering

[jvanhambelgium]

Then why use RouterOS / CCR-box ? do this on native Linux ?
Get yourself some 25/40/100Gbps NIC’s and perform some tuning.

https://fasterdata.es.net/host-tuning/linux/100g-tuning/

[merkkg]

No vlans, no bridge

then you won’t have L3 hardware offload acceleration, which is the key feature of ccr2216

even if you dont use vlans (or tag vlans), you can implement/convert your scheme to using bridge vlan filtering

Yes I understand that now but It wasn’t perfectly clear to me that L3HW is directly linked to working off bridge.

I can convert the configuration very easy to use the bridge setup but I didn’t know was full requirement.

Thank you for clearing this up for me.

[merkkg]

Then why use RouterOS / CCR-box ? do this on native Linux ?
Get yourself some 25/40/100Gbps NIC’s and perform some tuning.

https://fasterdata.es.net/host-tuning/linux/100g-tuning/

The setup I gave was an example, not specifically my setup.