Community discussions

MikroTik App
 
gcsuri
newbie
Topic Author
Posts: 35
Joined: Wed Sep 03, 2008 10:20 am

CRS318 and L3HW routing

Fri Mar 04, 2022 12:54 pm

Hi,

I have installed 7.1.3 to CRS318-16P-2S+. I tried to setup the L3HW interVLAN routing based on the website documentation. I think it doesn't work because I always got high CPU percent.
Is it possible on this device?
(I tried to enable l3hw on the ether1 also, but doesn't work...)

best regards, Gabor

Here is the export coming...
/interface bridge
add ingress-filtering=no name=bridge protocol-mode=none vlan-filtering=yes
/interface vlan
add interface=bridge name=vlan10 vlan-id=10
add interface=bridge name=vlan60 vlan-id=60
/interface ethernet switch
set 0 l3-hw-offloading=yes
/interface ethernet switch port
set 0 l3-hw-offloading=no
/interface bridge port
add bridge=bridge interface=ether1 pvid=10
add bridge=bridge interface=ether2 pvid=60
add bridge=bridge interface=ether3 pvid=60
add bridge=bridge interface=ether4 pvid=60
/interface bridge vlan
add bridge=bridge tagged=bridge vlan-ids=10
add bridge=bridge tagged=bridge vlan-ids=60
/ip address
add address=10.100.64.1/24 interface=vlan60
/ip dhcp-client
add interface=vlan10
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2990
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: CRS318 and L3HW routing

Fri Mar 04, 2022 5:51 pm

check for
l3-hw-offloading=yes
in

/interface/ethernet/switch/port
 
tdw
Forum Guru
Forum Guru
Posts: 1843
Joined: Sat May 05, 2018 11:55 am

Re: CRS318 and L3HW routing

Fri Mar 04, 2022 7:55 pm

And for inter-VLAN routing you also need
/ip firewall filter
add action=fasttrack-connection chain=forward connection-state=established,related hw-offload=yes
 
gcsuri
newbie
Topic Author
Posts: 35
Joined: Wed Sep 03, 2008 10:20 am

Re: CRS318 and L3HW routing

Sat Mar 05, 2022 7:47 pm

And for inter-VLAN routing you also need
/ip firewall filter
add action=fasttrack-connection chain=forward connection-state=established,related hw-offload=yes
This device doesn't support hw-offload with fasttrack. :(
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2990
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: CRS318 and L3HW routing

Sun Mar 06, 2022 11:12 pm

And for inter-VLAN routing you also need
/ip firewall filter
add action=fasttrack-connection chain=forward connection-state=established,related hw-offload=yes
This device doesn't support hw-offload with fasttrack. :(
did you manage to enable L3 hardware offload ?
 
OlofL
Member Candidate
Member Candidate
Posts: 113
Joined: Mon Oct 12, 2015 2:37 pm

Re: CRS318 and L3HW routing

Mon Mar 07, 2022 12:45 am

And for inter-VLAN routing you also need
/ip firewall filter
add action=fasttrack-connection chain=forward connection-state=established,related hw-offload=yes
This device doesn't support hw-offload with fasttrack. :(
Doesnt it support it in 7.2rc2?

*) l3hw - added HW offloaded FastTrack support for inter-VLAN routing;
*) l3hw - fixed HW offloaded NAT;
 
sebweb3r
just joined
Posts: 2
Joined: Sun Dec 05, 2021 5:36 pm

Re: CRS318 and L3HW routing

Mon Mar 07, 2022 2:17 am

Doesnt it support it in 7.2rc2?
Nope, explained here:
https://help.mikrotik.com/docs/display/ ... iceSupport
 
OlofL
Member Candidate
Member Candidate
Posts: 113
Joined: Mon Oct 12, 2015 2:37 pm

Re: CRS318 and L3HW routing

Mon Mar 07, 2022 3:03 pm

Doesnt it support it in 7.2rc2?
Nope, explained here:
https://help.mikrotik.com/docs/display/ ... iceSupport
I have read that document, but I still dont understand. To my understanding, it should be able to?
I also read viewtopic.php?t=183142#p913605 and after this I thought one should be able to for sure?
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2990
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: CRS318 and L3HW routing

Mon Mar 07, 2022 3:26 pm

I have read that document, but I still dont understand. To my understanding, it should be able to?
I also read viewtopic.php?t=183142#p913605 and after this I thought one should be able to for sure?

NOT all CRS 3xx switches support Offloading Fasttrack Connections

devices based on Marvell 98DX224S, 98DX226S, or 98DX3236
only support support L3 HW Offloading, do not support Fasttrack or NAT connection offloading.

CRS318-16P-2S+ is based on 98DX226S
CRS318-1Fi-15Fr-2S is based on 98DX224S

Offloaded Fasttrack connections (applies only to certain switch models)
Offloaded NAT for Fasttrack connections (applies only to certain switch models)

explained here
https://help.mikrotik.com/docs/display/ ... ureSupport

and here
https://help.mikrotik.com/docs/display/ ... p+features
 
gcsuri
newbie
Topic Author
Posts: 35
Joined: Wed Sep 03, 2008 10:20 am

Re: CRS318 and L3HW routing

Mon Mar 07, 2022 11:18 pm

it seems fixed in 7.2rc4
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: CRS318 and L3HW routing

Thu Mar 24, 2022 9:41 am

hi, CRS328-24P-4S+RM, after reboot device no load default route to hwl3. Route is in routing table with mark DAoH but not function. After off/on /interface/ethernet/switch set 0 l3-hw-offloading default route is function. Same with CRS326. With the CRS326, this happens after a few hours of operation.

RouterOS v7.1.5
 
User avatar
loloski
Member Candidate
Member Candidate
Posts: 296
Joined: Mon Mar 15, 2021 9:10 pm

Re: CRS318 and L3HW routing

Thu Mar 24, 2022 10:50 am

i believed CRS 328 is not supported, please check your hardware if supported

https://help.mikrotik.com/docs/display/ ... iceSupport
 
EdPa
MikroTik Support
MikroTik Support
Posts: 278
Joined: Fri Sep 15, 2017 10:05 am
Location: Riga
Contact:

Re: CRS318 and L3HW routing

Thu Mar 24, 2022 1:41 pm

Thanks hapi, the same problem is reproduced in our labs and we look forward to fixing it in future RouterOS releases. No release date available at the moment.
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: CRS318 and L3HW routing

Fri Mar 25, 2022 2:48 pm

If it helps. OSPF is used.

Thank you for your effort. HW L3 allows you to plan own network in a different way.
Last edited by hapi on Fri Mar 25, 2022 5:53 pm, edited 1 time in total.
 
User avatar
raimondsp
MikroTik Support
MikroTik Support
Posts: 267
Joined: Mon Apr 27, 2020 10:14 am

Re: CRS318 and L3HW routing

Fri Mar 25, 2022 5:52 pm

We have found a few semi-severe issues on 98DX2xxx/98DX3xxx switch chips (CRS305, CRS318, CRS328, etc.) when L3HW is used together with dynamic routing protocols (OSPF, BGP). Most of the issues have already been fixed in v7.2rc5. The remaining ones will be fixed in the next version. Unfortunately, fixes will not be backported to the v7.1 branch, so you must switch to 7.2 to use OSPF/BGP with L3HW.
 
ofca
Member Candidate
Member Candidate
Posts: 228
Joined: Fri Aug 20, 2004 7:18 pm

Re: CRS318 and L3HW routing

Wed Mar 30, 2022 12:25 pm

We have found a few semi-severe issues on 98DX2xxx/98DX3xxx switch chips (CRS305, CRS318, CRS328, etc.) when L3HW is used together with dynamic routing protocols (OSPF, BGP). Most of the issues have already been fixed in v7.2rc5. The remaining ones will be fixed in the next version. Unfortunately, fixes will not be backported to the v7.1 branch, so you must switch to 7.2 to use OSPF/BGP with L3HW.
Routes received via BGP were not properly installed to switch chip on CRS328-4C-20S-4S+ with 7.2rc5.
Symptoms:
establish a BGP session, connectivity is normal
enable L3-hw-offloading, connectivity still normal
restart BGP session, connectivity is lost until L3-hw-offloading is disabled.

Is there a point in upgrading to rc6, i.e. was something like this addressed?
 
User avatar
raimondsp
MikroTik Support
MikroTik Support
Posts: 267
Joined: Mon Apr 27, 2020 10:14 am

Re: CRS318 and L3HW routing

Wed Mar 30, 2022 6:54 pm

Routes received via BGP were not properly installed to switch chip on CRS328-4C-20S-4S+ with 7.2rc5.
Symptoms:
establish a BGP session, connectivity is normal
enable L3-hw-offloading, connectivity still normal
restart BGP session, connectivity is lost until L3-hw-offloading is disabled.

Is there a point in upgrading to rc6, i.e. was something like this addressed?

Maybe, you've encountered the following issue:
*) l3hw - fixed default route offloading for CRS305, CRS326-24G-2S+, CRS328, netPower, netFiber devices;

7.2rc6 is definitely worth trying.
 
ofca
Member Candidate
Member Candidate
Posts: 228
Joined: Fri Aug 20, 2004 7:18 pm

Re: CRS318 and L3HW routing

Thu Mar 31, 2022 12:54 am

Something surely changed for the better with rc6, however I'm uncertain what fixed things. There was never any lost connectivity post-upgrade, however packets were routed by CPU. This was fixed by adjusting vlan interface's MTU (port had 9000, yet I didn't notice that vlan had 1500). Tests seen 3 gbit/s with cpu load at 1%, so as long as things are stable, I'm happy. Good job guys. :)
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: CRS318 and L3HW routing

Fri Apr 01, 2022 3:21 pm

We have found a few semi-severe issues on 98DX2xxx/98DX3xxx switch chips (CRS305, CRS318, CRS328, etc.) when L3HW is used together with dynamic routing protocols (OSPF, BGP). Most of the issues have already been fixed in v7.2rc5. The remaining ones will be fixed in the next version. Unfortunately, fixes will not be backported to the v7.1 branch, so you must switch to 7.2 to use OSPF/BGP with L3HW.

I am upgraded to 7.2rc7 in night. Default route is functional on CRS328 after reboot and no loss on CRS326. Excellent 👍
 
mhugo
Member Candidate
Member Candidate
Posts: 179
Joined: Mon Sep 19, 2005 11:48 am

Re: CRS318 and L3HW routing

Sun Apr 03, 2022 12:04 pm

We have found a few semi-severe issues on 98DX2xxx/98DX3xxx switch chips (CRS305, CRS318, CRS328, etc.) when L3HW is used together with dynamic routing protocols (OSPF, BGP). Most of the issues have already been fixed in v7.2rc5. The remaining ones will be fixed in the next version. Unfortunately, fixes will not be backported to the v7.1 branch, so you must switch to 7.2 to use OSPF/BGP with L3HW.
Im trying to enable L3HW routing on some 317s. They have 900 (all incl 0.0.0.0/0 from OSPF) routes and right now I tried only with switches having one uplink.

When I use

/interface/ethernet/switch set 0 l3-hw-offloading=yes
/interface/ethernet/switch/port set [find] l3-hw-offloading=yes

The traffic seems to flow fine for the users but I loose local loopback reachability outside for things like routeros upgrades.

Same on 7.2rc7 so it might be one of still not solved usecases?

Any ideas?
 
User avatar
raimondsp
MikroTik Support
MikroTik Support
Posts: 267
Joined: Mon Apr 27, 2020 10:14 am

Re: CRS318 and L3HW routing

Mon Apr 04, 2022 12:35 pm


Im trying to enable L3HW routing on some 317s. They have 900 (all incl 0.0.0.0/0 from OSPF) routes and right now I tried only with switches having one uplink.

When I use

/interface/ethernet/switch set 0 l3-hw-offloading=yes
/interface/ethernet/switch/port set [find] l3-hw-offloading=yes

The traffic seems to flow fine for the users but I loose local loopback reachability outside for things like routeros upgrades.

Same on 7.2rc7 so it might be one of still not solved usecases?

Any ideas?

Please create a support ticket, and we will try to reproduce your issue.
 
mhugo
Member Candidate
Member Candidate
Posts: 179
Joined: Mon Sep 19, 2005 11:48 am

Re: CRS318 and L3HW routing

Thu Apr 07, 2022 7:30 pm

Please create a support ticket, and we will try to reproduce your issue.
Just tested on 7.2 with same result so posted ticket SUP-79177.
 
VictorJohnsonandroni
just joined
Posts: 3
Joined: Sat Mar 26, 2022 2:33 pm

Re: CRS318 and L3HW routing

Wed Apr 13, 2022 7:25 am

So we have one of these(CRS328-24P-4S+RM l3hw) switches at a remote site. It is fed by an MLAG bond from a pair of cores for redundancy. BGP is standard in our network and it is only announcing a single network at the moment. Default route is received from the cores along with more specific internal routes.

With the received default route having L3 hardware offloading enabled (it is on by default and can't be changed), I get no packets traversing the L3 interface on the switch for connections destined to the internet. It's as if the route does not exist in the table. Then after some troubleshooting, I added a static default route with hardware offloading disabled as static routes have a lower distance than eBGP and it starts working immediately albeit at lower performance for those connections due to not having L3 hardware offloading.

Switch has been tested with 7.1.3, 7.1.5 and 7.2rc5

My questions are, has anyone else experienced this before? Is this an undocumented bug or is there some documentation that I may have missed?
 
User avatar
raimondsp
MikroTik Support
MikroTik Support
Posts: 267
Joined: Mon Apr 27, 2020 10:14 am

Re: CRS318 and L3HW routing

Wed Apr 13, 2022 7:44 am

So we have one of these(CRS328-24P-4S+RM l3hw) switches at a remote site. It is fed by an MLAG bond from a pair of cores for redundancy. BGP is standard in our network and it is only announcing a single network at the moment. Default route is received from the cores along with more specific internal routes.

With the received default route having L3 hardware offloading enabled (it is on by default and can't be changed), I get no packets traversing the L3 interface on the switch for connections destined to the internet. It's as if the route does not exist in the table. Then after some troubleshooting, I added a static default route with hardware offloading disabled as static routes have a lower distance than eBGP and it starts working immediately albeit at lower performance for those connections due to not having L3 hardware offloading.

Switch has been tested with 7.1.3, 7.1.5 and 7.2rc5

My questions are, has anyone else experienced this before? Is this an undocumented bug or is there some documentation that I may have missed?

Currently, MLAG is NOT fully compatible with L3HW. Implementation of the compatibility layer is on the roadmap but not in development yet. Meanwhile, you can use either MLAG or L3HW, but not both at the same time.
 
lkkm99
just joined
Posts: 5
Joined: Wed Oct 20, 2021 11:42 am

Re: CRS318 and L3HW routing

Sat May 21, 2022 8:12 pm

Currently, MLAG is NOT fully compatible with L3HW. Implementation of the compatibility layer is on the roadmap but not in development yet. Meanwhile, you can use either MLAG or L3HW, but not both at the same time.
@raimondsp: Do you have some more information about your roadmap here? I had checked the L3HW documentation a couple of months back and there was no note yet that MLAG and L3HW features cannot be used together. So I assumed it would work - just learned now that it actually doesn't. So is this something you will be able to fix and implement rather soon, so say within the next few months? Or it's not likely that MLAG and L3HW will work together anytime soon?
 
User avatar
raimondsp
MikroTik Support
MikroTik Support
Posts: 267
Joined: Mon Apr 27, 2020 10:14 am

Re: CRS318 and L3HW routing

Mon May 23, 2022 7:43 am

@raimondsp: Do you have some more information about your roadmap here? I had checked the L3HW documentation a couple of months back and there was no note yet that MLAG and L3HW features cannot be used together. So I assumed it would work - just learned now that it actually doesn't. So is this something you will be able to fix and implement rather soon, so say within the next few months? Or it's not likely that MLAG and L3HW will work together anytime soon?

The L3HW Feature Support Table has "N/A" next to MLAG, meaning that the feature is not available together with L3HW.

I wouldn't expect the L3HW+MLAG compatibility layer to be implemented in the next few months. It is not considered a high-priority feature. However, you can create a feature request thread here on the forums - if the topic gets enough attention, the feature might receive a priority boost and, therefore, get into the development sooner.
 
lkkm99
just joined
Posts: 5
Joined: Wed Oct 20, 2021 11:42 am

Re: CRS318 and L3HW routing

Wed May 25, 2022 1:50 pm

The L3HW Feature Support Table has "N/A" next to MLAG, meaning that the feature is not available together with L3HW.

Thanks. I've seen this note in the Feature Support Table but it has been added just on 20th April 2022. So before, it wasn't documented that MLAG and L3HW are not available together. And it's also unexpected because MLAG is a layer 2 feature and so the incompatibility with L3HW is not obvious...

Who is online

Users browsing this forum: No registered users and 12 guests