Community discussions

MikroTik App
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Thu Nov 25, 2021 11:26 am

I am not too sure if this is hardware issue or software but I suspect software first.

The issue is, on my newly bought RB5009 the SFP+ port does not seem to work with anything SFP I have. It appears that whenever something is connected, the port status on RB5009 side is shown as active all the time trying to Tx, but fails to negotiate speed and receives no Rx; but on the other side the connection will be shown as connected for a very short period of time (could be almost immediately to about a second) and then shown as disconnected.

I've tried all SFP devices I have, including:
1) A pair of SFP (1G speed) RJ45 adapters of unknown brand
2) A bunch of more than 5 different DAC I gathered from friends
3) Two pairs of optical adapters of brand 10Gtek and HiFiber

All these are confirmed to be working totally fine on my RB4011iGS+RM and more than one Netgear Switches with SFP+ port.

The RB5009 comes with firmware version 7.0.5, but also tried to upgrade to 7.1rc6 (and later 7.1rc7 and 7.1 Testing) and issue is the exact same.

I've also tried to manually set various port speed on both sides, nothing helped.

Please let me know if there's any more information I can provide to help this. At this moment, the issue is blocking my usage of RB5009.


UPDATE:
At this moment, I am almost sure this is an issue on Netgear MS510TXUP. I've able to make other switches to work with RB5009 without issue after a few mindless tries including cleaning the whole router board and DAC with electronic cleaner, a few configuration changes, and a few times of various resets.

UPDATE 2022-03-24:
I have confirmed the same issue is here with Zyxel XS1930-12HP too.

UPDATE 2022-04-19
Thanks to @xfoxtbat we have a plausible root cause:
viewtopic.php?p=927657#p926511
It seems that the SFP+ port on RB5009 supports EEE which is not supported by the switches I found to have this issue.
Last edited by ccl13 on Tue Apr 19, 2022 8:37 pm, edited 6 times in total.
 
elbob2002
Member Candidate
Member Candidate
Posts: 252
Joined: Tue May 15, 2018 8:15 pm
Location: Ireland

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 11:40 am

Turn off Auto Negotiation and set the speed to 1G

I've had to do this on a CRS328 running 6.4x and on an RB5009 running 7.1RC6
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 1:59 pm

Turn off Auto Negotiation and set the speed to 1G

I've had to do this on a CRS328 running 6.4x and on an RB5009 running 7.1RC6
Like mentioned in original post, did this, still the same issue.
 
felixka
Frequent Visitor
Frequent Visitor
Posts: 58
Joined: Mon Oct 19, 2020 4:12 am
Location: Canada

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 4:31 pm

For what it's worth, I'm running an Optcore OSP10G-8503DCR on my RB5009 with 7.1rc6 and it works just fine with the default settings.
 
elbob2002
Member Candidate
Member Candidate
Posts: 252
Joined: Tue May 15, 2018 8:15 pm
Location: Ireland

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 7:06 pm

Like mentioned in original post, did this, still the same issue.
There was/is an issue with some DACs not working on some devices. This might be your issue.

My RB5009 and CRS328 are connecting using Cisco SFPs with fibre and both manually set to 10Gbps full duplex and autonegotiation disabled.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 8:16 pm

Like mentioned in original post, did this, still the same issue.
There was/is an issue with some DACs not working on some devices. This might be your issue.

My RB5009 and CRS328 are connecting using Cisco SFPs with fibre and both manually set to 10Gbps full duplex and autonegotiation disabled.
I understand it might be a compatibility issue, but all the options listed are working totally fine with RB4011. Just not on RB5009. It feels to me the compatibility is much worse on RB5009 compared to RB4011 if that's the case.
I actually haven't tried to manually set both side to 10Gbps (tried all sorts of lower speed though). I will give it a try.
 
msatter
Forum Guru
Forum Guru
Posts: 2897
Joined: Tue Feb 18, 2014 12:56 am
Location: Netherlands / Nīderlande

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Thu Nov 25, 2021 8:47 pm

With going to ROS7 you will lose some fixes that where already implemented in ROS6. The 4011 can't reach a MTU of 1500 over PPPoE under 7 while that was fixed in 6.
Those fixes will be certainly applied also to 7 to but will take a while.
 
AlphaBAO
just joined
Posts: 2
Joined: Sat Nov 27, 2021 6:50 am

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Sat Nov 27, 2021 6:54 am

I have same issue, don’t have a stable solution. Just reboot the RB5009 have chance to make it work
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Mon Nov 29, 2021 11:38 pm

I have same issue, don’t have a stable solution. Just reboot the RB5009 have chance to make it work
Thanks for the information. At this moment, I tried to reboot about 10 times but no luck yet. Could you tell me what exactly did you do to make it work? Just so I don't miss some details which could be critical.
 
rplant
Member Candidate
Member Candidate
Posts: 280
Joined: Fri Sep 29, 2017 11:42 am

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Wed Dec 01, 2021 5:14 am

I have a 5009, and it's pretty fine with a Dac, a 1G SFP, and a dual speed 10G/1G SFP.
(Mostly fs.com bits, generic, cisco and hp profiles used)

Sometimes need to fiddle with the auto-negotiation on/off, 1G/10G selection, that's about it.
Have suspicion that auto-negotiate might work better recently (maybe??).

Other thoughts

SFP Interface enabled?
Plugged in properly, and latch closed.?
Definitely says no link?
Perhaps your 5009 is broken, get your supplier to test it/swap it maybe.

Sorry, nothing more.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Wed Dec 01, 2021 7:57 am

I have a 5009, and it's pretty fine with a Dac, a 1G SFP, and a dual speed 10G/1G SFP.
(Mostly fs.com bits, generic, cisco and hp profiles used)

Sometimes need to fiddle with the auto-negotiation on/off, 1G/10G selection, that's about it.
Have suspicion that auto-negotiate might work better recently (maybe??).

Other thoughts

SFP Interface enabled?
Plugged in properly, and latch closed.?
Definitely says no link?
Perhaps your 5009 is broken, get your supplier to test it/swap it maybe.

Sorry, nothing more.
Thank you for your information!
I've confirmed everything you mentioned. I don't have fs.com products but I've tried all I can find and that should be a good variety.
I can be certain that SFP interface are enabled. I've tried to factory reset both sides. Plug works fine - unless RB5009's port is totally different from RB4011 that it seats differently. Yes definitely says no link on the other side, and on RB5009 it says connected, also says speed negotiation failed.
I will try get a replacement then.
 
Ady262
just joined
Posts: 4
Joined: Sat Dec 18, 2021 2:10 am

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Sat Dec 18, 2021 2:20 am

I also have a similar problem with my RB5009UG+S+IN and AOC-STGN-I2S card. I have tried many configurations and so far no solution. I cannot negotiate the 10G port automatically or manually the port only gets up for a few seconds. I tried active and passive patchcords and the result is the same.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Sun Dec 26, 2021 10:57 am

Hi All,

As a general update, I'm now on version 7.1.1, the issue is still there.

Also, I've witnessed something similar but different on RB4011:
After a few reboots, there's once that on both RB4011 and Netgear MS510TXUP the link appears to be up but both side is receiving 100% error packets. I've rebooted both side once but the issue was still there, and then I rebooted a few more times and the issue is gone.

I suspect there's a compatibility issue between RouterOS 7 and Netgear MS510TXUP.
 
bigzoo
just joined
Posts: 1
Joined: Mon Jan 17, 2022 4:50 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Mon Jan 17, 2022 5:01 pm

Hi,
Have you ever tried the combination that leave MS510 as default and manually set RB5009 to 10Gbps full duplex and autonegotiation disabled?
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with version 7.0.5 or 7.1rc6

Wed Jan 19, 2022 8:24 pm

Hi,
Have you ever tried the combination that leave MS510 as default and manually set RB5009 to 10Gbps full duplex and autonegotiation disabled?
Yes. I've tried to put both as default, then disabling features / use manual settings instead for everything I can think of. None helped.

At this time, I basically exhausted all possible configuration combinations available to me.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with all current version of firmware up to 7.1.1

Fri Mar 25, 2022 8:47 am

Not sure if this is anybody's concern still. A bit of new development.
I've got a new switch, Zyxel XS1930-12HP. And this one showed basically the same issue as the MS510TXUP. It just does the cut off a few more cycles instead of just once.

I can be sure that the issue is with RB5009UG, not the other side now.
 
pw123
just joined
Posts: 6
Joined: Tue Apr 12, 2022 1:11 am

Re: RB5009UG+S+IN SFP+ port not working with all current version of firmware up to 7.1.1

Tue Apr 12, 2022 1:37 am

Not sure if this is anybody's concern still. A bit of new development.
I've got a new switch, Zyxel XS1930-12HP. And this one showed basically the same issue as the MS510TXUP. It just does the cut off a few more cycles instead of just once.

I can be sure that the issue is with RB5009UG, not the other side now.
I have the same issue for rb5009 and xs1930-12hp. My rb5009 runs v7.2. Basically the sfp+ port on xs1930-12hp side just goes up and down all the time. I tried 10gb DAC and 10gb fiber cable. Neither works. Both work with mellanox connectx-3 nic.

Btw, I am wondering if adding a CRS305 between rb5009 and xs1930-12hp would help. But I cannot get one at the moment.
Last edited by pw123 on Tue Apr 12, 2022 4:47 am, edited 2 times in total.
 
xfoxtbat
just joined
Posts: 3
Joined: Fri Jan 21, 2022 5:32 am

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Thu Apr 14, 2022 8:27 am

hi.all

I also had the same situation happen netgear MX510TXM
The response from the manufacturer was that the problem occurred when the MS510TXM continued to send packets to the MitroTik device, but the MitroTik device stopped sending data to the MS510TXM. The results of this test confirmed that it was caused by the MitroTik's 10G SFP+ optical port supporting the EEE (Energy-Efficient Ethernet) feature, while the MS510TXM's 10G SFP+ optical port does not support EEE (the MS510TXM's 10G electrical port does support EEE)



Can rb5009 turn off EEE for testing spf+ available
Last edited by xfoxtbat on Thu Apr 14, 2022 8:28 am, edited 1 time in total.
 
pw123
just joined
Posts: 6
Joined: Tue Apr 12, 2022 1:11 am

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Sat Apr 16, 2022 4:23 pm

OK. I ended up with using a SFP+ RJ45 on rb5009 and connecting a ethernet cable to xs1930's RJ45. It is no ideal but works.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Tue Apr 19, 2022 8:34 pm

OK. I ended up with using a SFP+ RJ45 on rb5009 and connecting a ethernet cable to xs1930's RJ45. It is no ideal but works.
I tried the same and found that not all SFP+ RJ45 adapter works; and while some of them work, they are never stable that they disconnects quite randomly every a few hours.

hi.all

I also had the same situation happen netgear MX510TXM
The response from the manufacturer was that the problem occurred when the MS510TXM continued to send packets to the MitroTik device, but the MitroTik device stopped sending data to the MS510TXM. The results of this test confirmed that it was caused by the MitroTik's 10G SFP+ optical port supporting the EEE (Energy-Efficient Ethernet) feature, while the MS510TXM's 10G SFP+ optical port does not support EEE (the MS510TXM's 10G electrical port does support EEE)



Can rb5009 turn off EEE for testing spf+ available
This is great information! I haven't got Netgear to help me this far. But yeah it sounds like a plausible cause and if Mikrotik could provide the option then we can confirm it. Thanks for sharing this information!
 
pw123
just joined
Posts: 6
Joined: Tue Apr 12, 2022 1:11 am

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:15 am

OK. I ended up with using a SFP+ RJ45 on rb5009 and connecting a ethernet cable to xs1930's RJ45. It is no ideal but works.
I tried the same and found that not all SFP+ RJ45 adapter works; and while some of them work, they are never stable that they disconnects quite randomly every a few hours.
I am using the one from 10Gtek (https://www.amazon.com/dp/B01KFBFL16). It has been stable for two days and counting.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:18 am


I tried the same and found that not all SFP+ RJ45 adapter works; and while some of them work, they are never stable that they disconnects quite randomly every a few hours.
I am using the one from 10Gtek (https://www.amazon.com/dp/B01KFBFL16). It has been stable for two days and counting.
I tried this one. You can look at port statistics, it drops a few packet every a few tens of minutes to a few hours. In most cases user does not feel this though.
 
pw123
just joined
Posts: 6
Joined: Tue Apr 12, 2022 1:11 am

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:24 am


I am using the one from 10Gtek (https://www.amazon.com/dp/B01KFBFL16). It has been stable for two days and counting.
I tried this one. You can look at port statistics, it drops a few packet every a few tens of minutes to a few hours. In most cases user does not feel this though.
You mean Tx/Rx Drops from the rb5009 sfp+ port stats? Mine are both 0s. On xs1930 side, port status does not have Tx/Rx Drops, but Errors, Pauses are all 0s too.

btw, I am using a 0.5m cat6a UTP cable. not sure if it is related.
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:27 am



I tried this one. You can look at port statistics, it drops a few packet every a few tens of minutes to a few hours. In most cases user does not feel this though.
You mean Tx/Rx Drops from the rb5009 sfp+ port stats? Mine are both 0s. On xs1930 side, port status does not have Tx/Rx Drops, but Errors, Pauses are all 0s too.

btw, I am using a 0.5m cat6a UTP cable. not sure if it is related.
Probably only me, but yes errors on RB5009 while drops and errors on MS510TXUP. Using “Cat7" 1m cable so hopefully that's not the reason.
 
DaSnipe
just joined
Posts: 11
Joined: Mon Jan 17, 2022 5:00 am
Location: Montreal, QC, Canada
Contact:

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:35 am

Just to update here in case it's needed but using a FS.com DAC and a Brocade ICX6450-48P switch I'm getting a nice 10gbps link with my RB5009, no dropped packets on ROS 7.2 . If there's anything you need me to help test let me know
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Wed Apr 20, 2022 3:38 am

Just to update here in case it's needed but using a FS.com DAC and a Brocade ICX6450-48P switch I'm getting a nice 10gbps link with my RB5009, no dropped packets on ROS 7.2 . If there's anything you need me to help test let me know
Thanks for the info. I do have switches working fine with RB5009 but all the smaller ones with RTL9313 are not working, and they fit in some smaller spaces that nothing else fits. So I don't have a lot of work around anyways.
 
xfoxtbat
just joined
Posts: 3
Joined: Fri Jan 21, 2022 5:32 am

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Thu Apr 21, 2022 8:27 am

hi
7.3beta34 has been fixed
You can try
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Thu Apr 21, 2022 9:04 am

hi
7.3beta34 has been fixed
You can try
Thanks for the update! I will grab a RB5009 and give it a try.
 
kennethrc
just joined
Posts: 14
Joined: Sun Aug 08, 2021 1:23 am
Location: California, US

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Sat May 07, 2022 3:38 am

FWIW (and not sure I'm talking about the same thing you guys are), I bought one of these back in January(?) and it works connected to my 2.5Gbps Moto MB6811 cable modem with no flaps or issues: https://www.amazon.com/gp/product/B08FXBFZP8 (it says "Please note that our 10GBase-T SFP+ to RJ45 Module does not support 2.5Gbps and 5Gbps!" but I haven't had any issues, other than it always says "10G" and "not available" for Autonegotiation).

BTW, I have to use an SFP+ module instead of my 2.5Gbps port on my '5009 'cause I have speed issues if I use that port directly (see here: https://www.reddit.com/r/mikrotik/comme ... on_rb5009/). Any idea when/if this will be fixed (or at least a root cause)?
 
ccl13
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 52
Joined: Sun Dec 24, 2017 8:20 pm

Re: RB5009UG+S+IN SFP+ port not working with some switches on firmware up to 7.1.5

Sat May 07, 2022 6:49 am

FWIW (and not sure I'm talking about the same thing you guys are), I bought one of these back in January(?) and it works connected to my 2.5Gbps Moto MB6811 cable modem with no flaps or issues: https://www.amazon.com/gp/product/B08FXBFZP8 (it says "Please note that our 10GBase-T SFP+ to RJ45 Module does not support 2.5Gbps and 5Gbps!" but I haven't had any issues, other than it always says "10G" and "not available" for Autonegotiation).

BTW, I have to use an SFP+ module instead of my 2.5Gbps port on my '5009 'cause I have speed issues if I use that port directly (see here: https://www.reddit.com/r/mikrotik/comme ... on_rb5009/). Any idea when/if this will be fixed (or at least a root cause)?
Yeah we were talking about a totally different issue.

BTW the FLYFiber module - I saw this two and I do know that servethehome.com has a benchmark claiming 5Gbps and 2.5Gbps is supported. Their product page must be wrong.
And your specific issue - I don't have the same hardware to confirm, but I think it looks like something is running at Half Duplex and likely that's RB5009.

Who is online

Users browsing this forum: No registered users and 13 guests