Community discussions

MikroTik App
 
User avatar
Maggiore81
Trainer
Trainer
Topic Author
Posts: 564
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Idea for 1U Core Router with 4xSFP+

Thu Oct 29, 2020 6:55 pm

Hello
what are your suggestion for:
1U Low power server
single cpu with high frequency (for BGP speed).
4x SFP+
at least 2xGbE

Is suitable Ros x86 long-term for a replacment for CCR1036+10Gb switch for VLANs?
Currently we use 1036 with switch with a total of 4x10Gb links into io.

I am looking for CCR1072, but I was wondering if x86 is suitable/stable enough for a big core router.
 
User avatar
inteq
Member
Member
Posts: 409
Joined: Wed Feb 25, 2015 8:15 pm
Location: Romania

Re: Idea for 1U Core Router with 4xSFP+

Sat Nov 07, 2020 5:41 pm

Supermicro has some nice 1U with 4X SFP+, 2x 10Gb ethernet and 2x 1Gb ethernet
See https://www.supermicro.com/en/products/ ... /rackmount
 
User avatar
Maggiore81
Trainer
Trainer
Topic Author
Posts: 564
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 6:39 am

Thank you. Anyone have experience with this hardware?
 
User avatar
inteq
Member
Member
Posts: 409
Joined: Wed Feb 25, 2015 8:15 pm
Location: Romania

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 7:46 am

Using https://www.supermicro.com/en/products/ ... -FN8TP.cfm under ESXi
No BGP tho and this model only has 2X SFP+, but the option to add a PCIe via a 90 degree angle riser (included)
 
User avatar
Maggiore81
Trainer
Trainer
Topic Author
Posts: 564
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 8:54 am

Hello.
So you are using esxi, then CHR above?
I was thinking about running a pure x86 ROS release on it.
 
User avatar
inteq
Member
Member
Posts: 409
Joined: Wed Feb 25, 2015 8:15 pm
Location: Romania

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 9:02 am

For my use cases, bare metal RoS would be a waste. I admit I did not even try without virtualization.
ESXi throughput with 4 cores allocated:
bt.png
You do not have the required permissions to view the files attached to this post.
 
User avatar
mkx
Forum Guru
Forum Guru
Posts: 11587
Joined: Thu Mar 03, 2016 10:23 pm

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 12:34 pm

I was thinking about running a pure x86 ROS release on it.

ROS x86 v6 is quite limited with regard of hardware support. Additionally it's tricky to get it in 64-bit mode (in case you cared about benefits of 64-bits). It seems that with v7 things will improve largely but it likely won't be production-ready in near future. So running a CHR will be still best bet for some future.
 
mada3k
Long time Member
Long time Member
Posts: 694
Joined: Mon Jul 13, 2015 10:53 am
Location: Sweden

Re: Idea for 1U Core Router with 4xSFP+

Sun Nov 08, 2020 2:25 pm

ROS v6 x86 is more focused on low-end/embedded x86 hardware. There are generally no high-performance drivers.
 
User avatar
Maggiore81
Trainer
Trainer
Topic Author
Posts: 564
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Idea for 1U Core Router with 4xSFP+

Tue Oct 26, 2021 6:36 pm

I resurrect this old thread since I am facing the issue that on CCR we have a 500Mbps limit of single tcp connection.
I would like to have a 1U Server with 2xSFP+ ports, just for doing NAT.

Wich could be the best bet for ESXi + CHR ?
 
wpeople
Member
Member
Posts: 380
Joined: Sat May 26, 2007 6:36 pm

Re: Idea for 1U Core Router with 4xSFP+

Sat Oct 30, 2021 12:19 pm

In my experience using SFP+ NICs, it's way more effective give PCI NIC with PCI Passthru to the VM, than bridging.
with ProxMox using bridging thruput was limited somewhere around 5gbps (per NIC) with high CPU usage. With PCI passthru
i can load the full 10G on the interface.

Bandwidth test to localhost, using HP DL360Gen8, single CPU, E5-2680 (v2?)
Screenshot 2021-10-30 11.07.14.png
955gbps in one direction and 464/494 gbps in both directions.
if interested, i would do the same test with a dual socket board.

I have no idea if CHR can run without hypervisor, but it seems, it's using the same driver set as x86,
so via Hypervisor, you can directly pass the NICs to RouterOS. You can pick x86 or CHR - x86 version has no thruput limitation
like CHR P10 and cheaper than CHR P-Unlimited.

Sadly i don't know any 40gig NIC whats natively supported by RouterOS
You do not have the required permissions to view the files attached to this post.

Who is online

Users browsing this forum: Google [Bot], GoogleOther [Bot] and 18 guests