Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3

RouterOS General
1

Hello,

Im reaching to this forum for help, because I’m lacking knowledge needed to set up things correctly.

Little background about my network:

I was happy user of combo NETIS WF2780 DSL + MIKROTIK CRS210-8G-2S+IN (netis can be ignored, it wasn’t anything special, but “it worked”).

I’m using Windows 10 machine with Mellanox Connect 10GbE NIC, and have QNAP NAS TS-932PX with 10GbE NIC adapters as well.

Windows machine and QNAP were connected using SFP+ cables to the CRS210-8G02S+IN (along other devices through 1GbE ethernet ports), and CRS210 was connected to the NETIS router, which was connected to the ISP gateway - everything worked fine, routing worked out of the box correctly, as it worked after I’ve introduced CRS2010 to my network (I have little-to-none of networking knowledge, except for "oh yes this connector fits this port and that’s the IP address I need to input here) - I had 700MBps transfers to the QNAP nas raid storage, and that was really all I wanted, as i deal with large amount of media files in my work. I own MIKROTIK ROUTERBOARD RTB-CRS317-1G-16S+RM as well, which I used several times when I had to deal with several rendernodes crunching hundreds of gigabytes of data daily, but It’s not connected at the moment, as higher priority for me is to restore transfer speeds between my main machines.

Things changed when I’ve bought MikroTik hAP ac3 RBD53iG-5HacD2HnD PoE - Naively I’ve expected everything to work correctly if the IP matched like in my previous router, namely:

Mikrotik hAP AC3 will be a router and wifi access point for my mobile devices, also will give everything connected to Mikrotik CRS210 access to internet, while CRS210 will handle 10GbE loads between my workstation and nas.

Sadly, it didn’t happened - everything “works”, as in - i have internet on all devices, WIFI works, everything sees each other in network, but Im experiencing below 1GbE (around 30-40MBps)transfers from workstation to NAS - im pretty sure both devices work correctly, as if i connect them without any switch/router between them I get expected transfers, so it points me to network/routing/switching issue rather than NAS/workstation issue.

Worth mentioning, after I’ve introduces Mikrotik hAP ac3 to my network in place of netis, I had to turn my CRS210 into switchboard otherwise i couldn’t log in to the ac3 - having zero knowledge, I’ve followed some youtube tutorial that indeed turned CRS210 into switch, but since then I can’t log in into it with winbox, with error “cant connect” (please see attached image for how its seen in the network) https://i.imgur.com/YL2FJ40.jpg

I’ll be glad for any help about how to configure my network to bring bac the 10GbE transfer speeds between my main workstation and QNAP nas.

2

So many things can be wrongly configured I don’t even know from where to start.
And that CRS is running RouterOS 6.18 (from 2014??) seriously?
Show a sanitized config export from both of them.

3

As mentioned, everything worked before, so I didn’t updated it since out of the box experience was ok.
Since I’ve made this post, someone from other forum managed to help me log in to the CRS210 and update it to 7.2.3 - nothing changed in behavior though.
“Show a sanitized config export from both of them.” - how can I export config to paste it here?

4

Blindly upgrading that ancient switch to RouterOS v7 is among the worst things you could’ve done.

/export file=whatever
5 
/interface bridge
add fast-forward=no mtu=1500 name=bridge
/interface ethernet
set [ find default-name=ether1 ] speed=100Mbps
set [ find default-name=ether2 ] speed=100Mbps
set [ find default-name=ether3 ] speed=100Mbps
set [ find default-name=ether4 ] speed=100Mbps
set [ find default-name=ether5 ] speed=100Mbps
set [ find default-name=ether6 ] speed=100Mbps
set [ find default-name=ether7 ] speed=100Mbps
set [ find default-name=ether8 ] speed=100Mbps
set [ find default-name=sfp-sfpplus1 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-128-cbc
/port
set 0 name=serial0
/snmp community
set [ find default=yes ] addresses=0.0.0.0/0
/interface bridge port
add bridge=bridge hw=no interface=ether1
add bridge=bridge hw=no interface=ether2
add bridge=bridge hw=no interface=ether3
add bridge=bridge hw=no interface=ether4
add bridge=bridge hw=no interface=ether5
add bridge=bridge hw=no interface=ether6
add bridge=bridge hw=no interface=ether7
add bridge=bridge hw=no interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/ip ipsec policy
set 0 dst-address=0.0.0.0/0 src-address=0.0.0.0/0
/system clock
set time-zone-autodetect=no
6

I don’t know why it doesn’t have an IP addr set, but start with this:

/interface bridge port set hw=yes [find]
7

And this:

/interface bridge set 0 fast-forward=yes
8 
/interface bridge port set hw=yes [find]

gave me no output or change in /interface bridge port print

/interface bridge set 0 fast-forward=yes

gave me no output or change in /interface bridge port print,
however router seem to close connection to winbox, so I had to re-log in it.

No difference in transfer though.

9

Are all devices connected to this CRS? If not, how are they connected?
Please post another config export from the CRS to see it with my own eyes that the above commands did nothing.
Also provide an export from hAP ac3.

10 
/interface bridge
add mtu=1500 name=bridge
/interface ethernet
set [ find default-name=ether1 ] speed=100Mbps
set [ find default-name=ether2 ] speed=100Mbps
set [ find default-name=ether3 ] speed=100Mbps
set [ find default-name=ether4 ] speed=100Mbps
set [ find default-name=ether5 ] speed=100Mbps
set [ find default-name=ether6 ] speed=100Mbps
set [ find default-name=ether7 ] speed=100Mbps
set [ find default-name=ether8 ] speed=100Mbps
set [ find default-name=sfp-sfpplus1 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-128-cbc
/port
set 0 name=serial0
/snmp community
set [ find default=yes ] addresses=0.0.0.0/0
/interface bridge port
add bridge=bridge interface=ether1
add bridge=bridge interface=ether2
add bridge=bridge interface=ether3
add bridge=bridge interface=ether4
add bridge=bridge interface=ether5
add bridge=bridge interface=ether6
add bridge=bridge interface=ether7
add bridge=bridge interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/ip ipsec policy
set 0 dst-address=0.0.0.0/0 src-address=0.0.0.0/0
/system clock
set time-zone-autodetect=no

Both workstation and NAS are connected through SFP+ ports to CRS210, and CRS210 itself is connected using normal ethernet port to hAP ac3 router.
I’ll post hAP ac3 config later, sanitizing its content will take a while.

11

So you’ve lied, the commands worked.
Anywhoo. if those two devices are in the same subnet I can’t imagine how the hAP ac3 is affecting the transfer between them.

12

Never lied, just said i got nothing in terminal after typing that, and that neither of commands affected the low transfer speeds - so it didnt really worked for me.

Anywhoo. if those two devices are in the same subnet I can’t imagine how the hAP ac3 is affecting the transfer between them.

I dont know if thats the issue with hAP ac3, i think its more issue with configuration on CRS210, that somehow dont want to use full sfp+ speeds.

13

You can remove all the “noise” in your configuration pasting this on terminal:

{
/interface bridge
set bridge mtu=auto
/interface ethernet
set [ find default-name=ether1 ] speed=1Gbps
set [ find default-name=ether2 ] speed=1Gbps
set [ find default-name=ether3 ] speed=1Gbps
set [ find default-name=ether4 ] speed=1Gbps
set [ find default-name=ether5 ] speed=1Gbps
set [ find default-name=ether6 ] speed=1Gbps
set [ find default-name=ether7 ] speed=1Gbps
set [ find default-name=ether8 ] speed=1Gbps
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-256-cbc,aes-192-cbc,aes-128-cbc
/snmp community
set [ find default=yes ] addresses=::/0
/ip ipsec policy
set 0 dst-address=::/0 src-address=::/0
}
14 
/interface ethernet monitor [find] once
15

Result of running command:
https://i.imgur.com/oA6hvYg.jpg


You can remove all the “noise” in your configuration pasting this on terminal:[…]

Thank you, it made everything much more readable:

/interface bridge
add name=bridge
/interface ethernet
set [ find default-name=sfp-sfpplus1 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
    10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/port
set 0 name=serial0
/interface bridge port
add bridge=bridge interface=ether1
add bridge=bridge interface=ether2
add bridge=bridge interface=ether3
add bridge=bridge interface=ether4
add bridge=bridge interface=ether5
add bridge=bridge interface=ether6
add bridge=bridge interface=ether7
add bridge=bridge interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/system clock
set time-zone-autodetect=no
16

Both 10G? If you are sure:

{
/interface ethernet
set [ find default-name=sfp-sfpplus1 ] advertise=10000M-full speed=10Gbps
set [ find default-name=sfpplus2 ] advertise=10000M-full speed=10Gbps
}
17

Yes, both should be 10Gbps interfaces, as mentioned above, they worked fine giving me 700-800MBps speeds, now its much slower. If I disconnect everything from router and connect NAS with workstation directly using one cable, im getting speeds "from before".
After running above commands and downloading file from NAS, on single big file max what im getting is around 140MB/s:

18

Can you show a printscreen that captures all the interfaces traffic during that test? and also the cpu usage.
thanks

19

Not sure how to get cpu load in graph form, but it stay around 30-40% levels.
Thank you very much for your time btw.

20

The interface speed… is interface speed… you must not see bridge for speed…

You have sfp-sfpplus1@1Gbit on TX and sfpsfpplus2@1Gb on RX…
all work at 1Gb…

I think @Znevna had already guessed it with his question…