I am in the middle of migrating my Cisco 10G Network to a Mikrotik 100 G. Actually I got less than a 3.5G of network traffic, 2 OSPF neigborhs (IPv4 / IPv4) and some SVI on the switch. Routing table has about 436 routes.
Yesterday night, I tried to replace the Cisco Layer 3 Switch to CRS510-8XS-2XQ-IN, but immediately the CPU went up to 100%. I check and the networking process was consuming entre 55 and 60% of the CPU.
Do you have any clue how to optimized the CPU consumption in my environment.
CRS devices are essentially switches … as in L2 devices. Yes, running ROS on them does add L3 (routing), but without careful configuration those functions will be done by (slow) CPU.
I tried activating the L3HW using the following commands:
Switch Configuration
/interface/ethernet/switch set 0 l3-hw-offloading=yes
Switch Port Configuration
/interface/ethernet/switch/port set sfp-sfpplus1 l3-hw-offloading=yes
But it didn’t have a positive impact on the cpu uitilization.
You have to enable it on all ports that are participating in routing.
Likewise, if you’re using IP addresses on VLAN interfaces, all ports with VLANs need to be a part of the bridge, with all VLANs with IP’s tagged to the bridge, along with any ports that need the traffic.
Perhaps try the following commands to see if L3 offload is not present somewhere.
With 400+ routes, you might want to write it to a file, so you can examine it in a text editor or similar.
/ip route
print [file=somefilename]
Flags: D - DYNAMIC; A - ACTIVE; c - CONNECT, o - OSPF, d - DHCP; H - HW-OFFLOADED
Columns: DST-ADDRESS, GATEWAY, DISTANCE
DST-ADDRESS GATEWAY DISTANCE
DAdH 0.0.0.0/0 192.168.95.1 1
DAcH 192.168.40.0/24 ether1 0
DAc 192.168.41.0/24 vlan41 0
DAcH 192.168.42.0/24 vlan42 0
Doc mentions that larger prefixes (eg /32) are preferred by HW engine, so I assume this might mean that
0.0.0.0/0 might be the first to fall out of HW offload if too many routes.
(In this case vlan41 has no devices attached)
/interface/ethernet/switch/
print [file=…]
Columns: NAME, TYPE, L3-HW-OFFLOADING, QOS-HW-OFFLOADING
# NAME TYPE L3-HW-OFFLOADING QOS-HW-OFFLOADING
0 switch1 Marvell-98DX3236 yes yes
If you have an interface that is not part of the bridge, but has an IP address on it, it will route using hw offload.
However if you have a vlan on this interface with an IP address on it, the vlan will use the CPU.