Please help :| RB5009 with 2.5G Advertise allowed, dramatic speed decrease

Hello,

First and foremost, I do not have the network expertise that most contributors on this forum have. I am Senior Programmer and I can understand a lot but when it comes to Networking, I am not educated. That being said, I am willing to troubleshoot and chase the fix to this issue. That issue being…

When I advertise 2.5G baseT on Ether 1, my download speed is reduced dramatically - Low 400s-500s Mbps.
When I remove 2.5G baseT from being advertised, my speeds approach 1 Gbps - 900-950 Mbps.

My internet plan is through Xfinity Comcast which is 1.2 Gbps Download, 40 Mbps Upload.

My set up is as follows that uses brand new Cat 6 ethernet cables:

  • Cable Modem: Netgear NightHawk CM3000 (Max 2 Gbps on Xfinity network)
  • Router: RB5009
  • Ethernet Switch: Trendnet TEG-S5091 : 9 port Unmanaged 2.5G Switch with 10G SFP_Port (2 in this scenario)
  • PC which reports both link speed for transmit and receive is 2500/2500 Mbps

I am running the latest RouterOS at 7.15.1 with no customizations except 2 DHCP static leases.

Things that I have tried (With little understanding)

  • Toggled both TX/RX Flow Control to Auto, On which caused no difference that I could observe.
  • Turned off Auto Negotiation locked to 2.5G base T which made all devices lose internet. (I re-enabled Auto Negotiation.)
  • I disabled/removed all these options from being Advertised:
  • 10M baseT half
    • 10M baseT full
    • 100M baseT half
    • 100M baseT full
  • I allowed 1G baseT full only and the speeds were 900+ Mbps
  • I allowed 2.5G baseT only and the internet speeds were dramatically slower. Speeds were around 495 Mbps. I don’t have a 2.5G baseT full. I have the following options for 2.5G:
  • 2.5G baseT
    • 2.5G baseX
  • I replaced the ethernet cable with another 3 ft cable of the same brand, type, etc. The following was observed:
  • I saw a slight speed increase with 2.5G baseT , around 600 Mbps.
    • I saw the same speeds as before with 1G baseT full , around 930 Mbps.

Again, I’m using Ookla Speedtest for my speed measurements. I don’t know how to do a speed test using RouterOS.

The CM3000’s ethernet port is 2.5G/1G so I don’t understand what’s wrong if the RB5009 is configured to use Ether 1 as 2.5G.

I am not sure where to go from here.

Thank you in advance for any assistance that I’m provided.

Cheers!

Please search the forum for similar topics before starting a new one…

There are tons of similar posts/threads, but most of them are inconclusive or refer to older RoS versions.
This one may be relevant:
http://forum.mikrotik.com/t/rb5009-2-5gbe-problems/169157/21
http://forum.mikrotik.com/t/rb5009-2-5gbe-problems/169157/1
since flow control had no effect, HW offload setting/unsetting might do the trick.
For all I know 7.15.1 might behave differently, personally I believe that running latest is sometimes not the best thing to do as there are often regression bugs (no idea if this applies to this specific case).

Thank you everyone for your responses. I am not sure how to enable HW Offload for Ether 1.

Currently, I am using Ether 1 as a WAN port, which is the port my CM3000 is connected to.

I noticed for the status for Ether 1, the Link Advertising Partner is listing the following speeds:

  • 100M baseT half
  • 100M baseT full
  • 1G baseT half
  • 1G baseT full

I placed a call to my Internet provider to reprovision my cable modem which they did. No change.

I connected my CM3000 directly to my laptop and speeds were 1444 Gbps with an Upload of 200+ Mbps.
Connecting everything back how it was, with 2.5G being advertised I am achieving 400-500 Mbps however my upload is 200+ Mbps.
With 2.5G removed from being advertised, I am achieving 920-40 Mbps.

I attempted to look at this post to try to replicate what was done: http://forum.mikrotik.com/t/hw-offload-on-lan-ports-not-working/163343/1

I added a second bridge named bridge-wan with the same MAC Addr as the first bridge.
I then went to Bridge: Ports: and added a new one specifying the interface as WAN and bridge as bridge-wan with Hardware Offload set to off.
Traffic on Port Ether1 seemed to have stopped.
So I removed everything I did.
I just don’t have the technical experience to figure this out.

Can anyone lend a hand?

Well, thanks to a wonderful user on Reddit, I have been informed that I was doing something that the RB5009 is not capable of. Which was… trying to feed > 1G speeds to a 2.5G Ethernet switch connected to the RB5009 ports (Ether 2 - Ether :sunglasses:

If I did not take this journey, asking for help, I would have never have realized this.

So now I will be making use of the SFP+ port.

Thanks to all who responded and offered their help.

Cheers!

It should be capable of doing that, but as you can read in the other topics on the forum there is something wrong in either the software or the hardware, and in practice the 2.5G mode on the RB5009 does not work.

I don’t see how. The ports on the RB5009 EXCEPT Ether 1 are 1 Gbps only. I had a Multi-gigabit Ethernet Switch connected to Ethernet port 2 on the RB5009. Which means that switch can only receive a Max of 1 Gbps.

This is same for me on 5G network, when set to 1Gbs = speed test about 650Mbit (my max 5G speed), when set to 2,5Gbit = speed test about 300Mbit
Absolutely nothing helped. There is something very wrong here.

The SFP+ port on the RB5009 is 10Gbps so you can connect your switch there, via the appropriate connection.
(DAC, fiber SFP, or when you live in a cold climate RJ45 SFP)

You could try attaching a queue onto the LAN ethernet port you are using and see what that does. (ether2…)

Make a new queue type using cake, probably near default.

Create a new queue, (Queue tree) with your new queue type, attach with parent as ether2, and set with a max limit of 1G. Assuming you are not marking packets, set the packet-mark the queue wants to no-mark.

Test, perhaps tweak as required.

You should perhaps change the bucket size on the queue to 0.01

If it works ok, do same for the other ethernet ports. (ether1 with 2.5G max-limit)