Community discussions

MikroTik App
 
RobstarUSA
newbie
Topic Author
Posts: 44
Joined: Sun Apr 15, 2018 5:42 am

CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Wed Jan 19, 2022 5:32 pm

Hello all,

I hope someone has an idea here. I've been running SwitchOS on & off, but finally decided to give RouterOS a shot.

Most of my equipment is plugged into a Brocade ICX 6610, including my fileserver (Truenas/CIFS) which is on a 10Gbit/s link there. When my Win10 desktop is connected at 1Gbit/s there, I consistently get 112MB/s which I think is fine/normal. I recently connected my desktop to my CRS317 with a 2.5Gbit/s SFP, and the CRS317 is connected via 10G trunk to the brocade. Now my file transfers are only 1MB/s from the same server! I think I am probably missing something but another set of eyes from y ou experts will help.

Brocade ICX Eth1/3/1 is connected to CRS317-Port 4. They are running MSTP between them and they agree the Brocade is the root bridge.

Here is my configuration on the CRS317:
[admin@MikroTik] > /export hide-sensitive
# jan/02/1970 11:48:45 by RouterOS 7.1.1
# software id = 3LIY-2NDR
#
# model = CRS317-1G-16S+
# serial number = XXXXXXXXXXXXXXX
/interface bridge
add admin-mac=CC:2D:E0:A3:3C:B3 auto-mac=no comment=defconf name=bridge \
    protocol-mode=mstp vlan-filtering=yes
/interface ethernet
set [ find default-name=sfp-sfpplus14 ] advertise=\
    1000M-full,10000M-full,2500M-full,5000M-full
/interface vlan
add interface=bridge name=Vlan101 vlan-id=101
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/port
set 0 name=serial0
/interface bridge msti
add bridge=bridge identifier=1 vlan-mapping=2-3962
/interface bridge port
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfp-sfpplus2
add bridge=bridge interface=sfp-sfpplus3
add bridge=bridge comment="bcore - 1/3/1" interface=sfp-sfpplus4
add bridge=bridge interface=sfp-sfpplus5
add bridge=bridge interface=sfp-sfpplus6
add bridge=bridge interface=sfp-sfpplus7
add bridge=bridge interface=sfp-sfpplus8
add bridge=bridge interface=sfp-sfpplus9
add bridge=bridge interface=sfp-sfpplus10
add bridge=bridge interface=sfp-sfpplus11
add bridge=bridge interface=sfp-sfpplus12
add bridge=bridge interface=sfp-sfpplus13
add bridge=bridge comment=MARIO frame-types=\
    admit-only-untagged-and-priority-tagged interface=sfp-sfpplus14 pvid=100
add bridge=bridge interface=sfp-sfpplus15
add bridge=bridge comment=VM4_GUEST interface=sfp-sfpplus16
add bridge=bridge interface=ether1
/interface bridge vlan
add bridge=bridge comment=LAN_MAIN tagged=sfp-sfpplus4 untagged=\
    ether1,sfp-sfpplus14 vlan-ids=100
add bridge=bridge comment=LAN_NET_MGMT tagged=bridge,ether1,sfp-sfpplus4 \
    vlan-ids=101
add bridge=bridge comment=DMZ-STATIC tagged=sfp-sfpplus4 vlan-ids=10
add bridge=bridge comment=DMZ_mail tagged=sfp-sfpplus4 vlan-ids=11
add bridge=bridge comment=DMZ_zim tagged=sfp-sfpplus4 vlan-ids=12
add bridge=bridge comment=DMZ_www tagged=sfp-sfpplus4 vlan-ids=13
add bridge=bridge comment=DMZ_pihole tagged=sfp-sfpplus4 vlan-ids=14
add bridge=bridge comment=DMZ_plex tagged=sfp-sfpplus4 vlan-ids=15
add bridge=bridge comment=Z3-LAN tagged=sfp-sfpplus4 vlan-ids=50
add bridge=bridge comment=STORAGE tagged=sfp-sfpplus4 vlan-ids=80
add bridge=bridge comment=DMZ-DYNAMIC tagged=sfp-sfpplus4 vlan-ids=90
add bridge=bridge comment=CAPSMAN tagged=sfp-sfpplus4 vlan-ids=102
add bridge=bridge comment=TRANSIT tagged=sfp-sfpplus4 vlan-ids=120
add bridge=bridge comment=LAN2_MAIN tagged=sfp-sfpplus4 vlan-ids=200
add bridge=bridge comment=MCAST_RP tagged=sfp-sfpplus4 vlan-ids=224
/ip address
add address=192.168.131.34/27 interface=Vlan101 network=192.168.131.32
/ip route
add disabled=no dst-address=0.0.0.0/0 gateway=192.168.131.33 routing-table=\
    main suppress-hw-offload=no
/system routerboard settings
set boot-os=router-os
/system swos
set address-acquisition-mode=static allow-from-ports=\
    p1,p2,p3,p4,p5,p6,p7,p8,p9,p10,p11,p12,p13,p14,p15,p16,p17 \
    allow-from-vlan=100 identity=core10 static-ip-address=192.168.75.52
What I've tried so far:

*Changing 2.5Gbit/s SFP (Tried 2)
*Turning off all power saving features on the nic.
*Changing network cable. (I used the same cable that gives me 112MB/s when my desktop is plugged into the brocade at 1Gbit/s, as well as another)
*An Internet test returns 250Mbit/s (which is the max of my internet speed)
*Trying a non 2.5Gbit nic, connected at 1Gbit and I see the same behavior.
*Tried both ipv4 & ipv6 connections (internal dns returns a ULA address, but I tried the ipv4 ip of the server & it shows the same behavior)


Edit: If I sftp to the same server I get 800Mbit/s with the 2.5Gbit/s nic. WHy would cifs/smb be so slow only on this switch but not on the brocade?
I'm thinking of moving the fileserver connectivity to the CRS317 as well to see if it's something with the trunk...maybe?
 
pe1chl
Forum Guru
Forum Guru
Posts: 10195
Joined: Mon Jun 08, 2015 12:09 pm

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Wed Jan 19, 2022 6:55 pm

When things are that slow you need to check all the involved network interfaces to see if they are set either to auto negotiate or to the same speed/duplex.
One side auto negotiate and the other fixed speed/duplex will cause this kind of problem.
 
RobstarUSA
newbie
Topic Author
Posts: 44
Joined: Sun Apr 15, 2018 5:42 am

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Wed Jan 19, 2022 7:12 pm

When things are that slow you need to check all the involved network interfaces to see if they are set either to auto negotiate or to the same speed/duplex.
One side auto negotiate and the other fixed speed/duplex will cause this kind of problem.
If that was the case, how do I get 800Mbvit/s via sftp? Likewise the switch with the sfp is saying "10G" (althought it's an mgig transceiver) and my windows desktop is saying 2.5Gbit

I've ordered an actual Mikrotik sfp+ transceiver that supports mgig to see if that will help.

Do you see anything obviously wrong in my config? That is what I'm most worried about since I don't have a lot of experience with routeros.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10195
Joined: Mon Jun 08, 2015 12:09 pm

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Wed Jan 19, 2022 8:11 pm

No it does not look so bad, and you are only switching so it should work without issue as long as the line protocols are OK.
Speed/duplex problems cause nasty issues that depend on timing and direction. SMB is much more chatty than sftp so it will suffer more.
But maybe it isn't that... it is just a guess.
 
RobstarUSA
newbie
Topic Author
Posts: 44
Joined: Sun Apr 15, 2018 5:42 am

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Wed Jan 19, 2022 8:40 pm

No it does not look so bad, and you are only switching so it should work without issue as long as the line protocols are OK.
Speed/duplex problems cause nasty issues that depend on timing and direction. SMB is much more chatty than sftp so it will suffer more.
But maybe it isn't that... it is just a guess.
Thanks. I agree with you I think it's some Layer1 issue. I'm going to replace the sfp with mikrotik official part & see if that helps.
 
RobstarUSA
newbie
Topic Author
Posts: 44
Joined: Sun Apr 15, 2018 5:42 am

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Fri Jan 21, 2022 11:35 pm

I rebooted to switchos & seem to be seeing the same issue there.

My Mikrotik SFP+ RJ10 SFP arrived today & the same file copy is now 230-240MB/s (MegaBYTES) which is what I would expect.

Either the SFP has gone bad or maybe it's just not compatible? I'm sure I used this before succesfully but it was with an older switchos/routeros version & I don't remember what it was.

Interestingly, the WebUI in switchos now correctly reports 2.5Gbit/s vs 10Gbit/s on the other modules.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10195
Joined: Mon Jun 08, 2015 12:09 pm

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Sat Jan 22, 2022 11:27 am

I have no experience with 2.5Gbit/s SFP but with some older 1Gbit I have sometimes seen that "auto negotiate" does not work and they have to be explicitly set to the correct speed an duplex.
However, as mentioned above, that always has to be done on both sides. When one side is outside control and is set to "auto negotiate", it isn't an option to set manual speed/duplex unless setting "half duplex".
But apparently with your new SFP it works correctly! Fortunately they are not expensive as they used to be... (and work better as well)
 
RobstarUSA
newbie
Topic Author
Posts: 44
Joined: Sun Apr 15, 2018 5:42 am

Re: CRS317 Setup Routeros - 1MB/s cifs between 10Gbit/ server & 2.5Gbit/s client.

Tue Jan 25, 2022 12:52 am

I also rebooted to RouterOS. The issue is fixed here as well. I'm going to stick with RouterOS 7.1.1 for the time being. I will need to order another SFP for another machine as well.

Who is online

Users browsing this forum: CJWW, orionren and 46 guests