Community discussions

 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

New High Performance Routers ! ?

Sun Oct 06, 2019 10:17 pm

Even CCR 1072 is not enough for us. Many low performance cores are not the way to go and they are easily saturated.
Are there any plans for new high performance routers from mikrotik ?
[r23@noc] /system resource cpu> pr 
 # CPU                                                                                                                   LOAD         IRQ        DISK
 0 cpu0                                                                                                                   28%         28%          0%
 1 cpu1                                                                                                                   44%         43%          0%
 2 cpu2                                                                                                                   22%         22%          0%
 3 cpu3                                                                                                                   27%         27%          0%
 4 cpu4                                                                                                                   24%         24%          0%
 5 cpu5                                                                                                                   61%         59%          0%
 6 cpu6                                                                                                                   59%         59%          0%
 7 cpu7                                                                                                                   34%         34%          0%
 8 cpu8                                                                                                                   29%         29%          0%
 9 cpu9                                                                                                                   42%         42%          0%
10 cpu10                                                                                                                  50%         50%          0%
11 cpu11                                                                                                                   8%          8%          0%
12 cpu12                                                                                                                  44%         44%          0%
13 cpu13                                                                                                                  46%         46%          0%
14 cpu14                                                                                                                  59%         59%          0%
15 cpu15                                                                                                                  43%         43%          0%
16 cpu16                                                                                                                  40%         40%          0%
17 cpu17                                                                                                                  54%         54%          0%
18 cpu18                                                                                                                  50%         50%          0%
19 cpu19                                                                                                                  18%         15%          0%
20 cpu20                                                                                                                  68%         67%          0%
21 cpu21                                                                                                                  38%         38%          0%
22 cpu22                                                                                                                  62%         62%          0%
23 cpu23                                                                                                                  42%         42%          0%
24 cpu24                                                                                                                  35%         35%          0%
25 cpu25                                                                                                                  40%         40%          0%
26 cpu26                                                                                                                  51%         51%          0%
27 cpu27                                                                                                                  36%         36%          0%
28 cpu28                                                                                                                  69%         69%          0%
29 cpu29                                                                                                                  61%         61%          0%
30 cpu30                                                                                                                  62%         62%          0%
31 cpu31                                                                                                                  22%         22%          0%
32 cpu32                                                                                                                   8%          8%          0%
33 cpu33                                                                                                                  11%         11%          0%
34 cpu34                                                                                                                  44%         44%          0%
35 cpu35                                                                                                                  20%         20%          0%
36 cpu36                                                                                                                  14%         14%          0%
37 cpu37                                                                                                                  68%         68%          0%
38 cpu38                                                                                                                  43%         43%          0%
39 cpu39                                                                                                                  44%         44%          0%
40 cpu40                                                                                                                  61%         61%          0%
41 cpu41                                                                                                                  32%         13%          0%
42 cpu42                                                                                                                  36%         36%          0%
43 cpu43                                                                                                                  39%         39%          0%
 
User avatar
xvo
Member
Member
Posts: 420
Joined: Sat Mar 03, 2018 1:12 am
Location: Moscow, Russia

Re: New High Performance Routers ! ?

Sun Oct 06, 2019 11:24 pm

There were some gentle hints some time ago that something is on the way, but no specifics, no timeline.
 
User avatar
krafg
Member
Member
Posts: 311
Joined: Sun Jun 28, 2015 7:36 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 4:43 am

You say that is not enough for you, but you are not using 100% of the CPU. How much traffic are you passing in total?
Image
 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 9:32 am

We are passing 9Gbit/s on the uplink. So it makes 18Gbit/s RX/TX traffic as total inside the router all interfaces combined.
Router only does NAT and nothing else. We had to use the "raw" filter to decrease the CPU utilisation. Without "raw" some cores were stuck at %100.
We are not sure what is the next step after ccr1072.
CHR is not stable at all for such traffic. Even it is not stable enough to run only "the dude" on it. Keeps locking up and needs reboot every week.

There is definitely a need for a high performance platform from mikrotik.
 
User avatar
krafg
Member
Member
Posts: 311
Joined: Sun Jun 28, 2015 7:36 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 1:32 pm

18 Gbit/s, when in the web page says that it can pass until 80 Gbit/s. There is something weird. Can you post your export with hide-sensitive option?

Regards.
Image
 
savage
Forum Guru
Forum Guru
Posts: 1206
Joined: Mon Oct 18, 2004 12:07 am
Location: Cape Town, South Africa
Contact:

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 1:41 pm

18 Gbit/s, when in the web page says that it can pass until 80 Gbit/s. There is something weird. Can you post your export with hide-sensitive option?

Regards.
MT's estimates, are extremely optimistic. The tests are done virtually with a blank router, doing absolutely nothing at all - it doesn't represent real world scenarios at all. Feel free to read up a bit on how MT actually conducts the tests, and what specifically, are tested.

9Gbps on a CCR, is quite impressive actually. I've also maxed out these devices in the 7 to 9 Gbps region.
Regards,
Chris
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 2:18 pm

Those tests are "standardized tests", like the gas mileage tests on cars.
A test standard is required to be able to compare between different routers or cars, but the results do not represent at all what your actual daily performance will be.

Indeed, that is unfortunate. But it would probably be difficult to define more realistic tests and still do it in an implementation-agnostic way.
You would not want a test definition that by nature works much better on manufacturer X's implementation than on your own, while in actual usage there would be no such difference.

I also sometimes think "gas mileage for cars test should be defined as the amount of gas required to drive on normal roads between two defined points divided by the distance" but in reality that would likely also cause some issues. Same with router performance tests.
 
User avatar
normis
MikroTik Support
MikroTik Support
Posts: 24206
Joined: Fri May 28, 2004 11:04 am
Location: Riga, Latvia

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 2:24 pm

Those tests are described here below the produt, in the Test tab:
https://mikrotik.com/product/CCR1072-1G ... estresults
No answer to your question? How to write posts
 
mkx
Forum Guru
Forum Guru
Posts: 2948
Joined: Thu Mar 03, 2016 10:23 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 3:50 pm

Those tests are described here below the produt, in the Test tab:
https://mikrotik.com/product/CCR1072-1G ... estresults

I think that the point of the whole thread is not about the tests, it's about potential new high-end routers. And I think we'd all love to get some clarifications from Mikrotik about that.
BR,
Metod
 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

Re: New High Performance Routers ! ?

Mon Oct 07, 2019 11:46 pm

@Normis
As I have stated before, we and I am sure most other ISPs as well are maxing out the current CCR products.
Are there any plans for new and more powerful architectures/products ?
 
Michaelcrapse
just joined
Posts: 19
Joined: Wed Oct 25, 2017 9:57 pm

Re: New High Performance Routers ! ?

Tue Oct 08, 2019 10:17 pm

CHR is indeed the only way forward for the forseeable future.
However, you should be able to get 20(40) or so gbps out of your CCR1072, Number 1: how many nat connections do you have. Number 2: don't use masquerade anywhere. You're using fast track, correct?
There are many small things that you can change that will drastically improve the performance of your router. That being said, this seems to be an edge router, are you overloading your router with tasks? Is it also acting as a core router, etc?
 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

Re: New High Performance Routers ! ?

Thu Oct 10, 2019 1:13 pm

We are already getting 18gbit with RAW table populated for our public IPs not participating in conn.track table. Also with fast-track rules.
There is not much to do in terms of configuration.
CCR1072 CPU consumption is %50 with 18gbit/s total throuput + firewall + NAT plus some cores hitting %80.

CHR is super unstable product (at least on vmware). We use it only for "the dude" monitoring and 3 ppptp servers for managment. Total throuput is not even 10mbit/s
And Even in that case, it locks up. Needs reboot every week. It looses its winbox port and ssh accesibility. We reboot it from the vm console to make it work.
we cant put CHR in production at all.

What is left ? Should we go for other brands or mikrotik has a timeframe or any plan for the successor of the CCR products ?
 
User avatar
krafg
Member
Member
Posts: 311
Joined: Sun Jun 28, 2015 7:36 pm

Re: New High Performance Routers ! ?

Thu Oct 10, 2019 1:18 pm

What ROS is running your CCR?

Regards.
Image
 
mikruser
Member
Member
Posts: 380
Joined: Wed Jan 16, 2013 6:28 pm

Re: New High Performance Routers ! ?

Sat Oct 12, 2019 8:58 pm

I am very surprised that Mikrotik does not use hardware NAT'ing.
do not ask me why it is necessary.
 
User avatar
doneware
Trainer
Trainer
Posts: 520
Joined: Mon Oct 08, 2012 8:39 pm
Location: Hungary

Re: New High Performance Routers ! ?

Mon Oct 14, 2019 2:00 pm

We use it only for "the dude" monitoring and 3 ppptp servers for managment.
i know it will not improve the performance, but you should really move away from pptp, esp if it is used for sensitive stuff, like management.
#TR0359
 
User avatar
doneware
Trainer
Trainer
Posts: 520
Joined: Mon Oct 08, 2012 8:39 pm
Location: Hungary

Re: New High Performance Routers ! ?

Mon Oct 14, 2019 4:19 pm

I am very surprised that Mikrotik does not use hardware NAT'ing.
A10, one of the real high performance CGN manufacturers doesn't necessarily use hw NAT either. we have some boxes from them, they handle several 10s of gbps with sw only nat on dual xeon CPUs (their hw appliance). believe or not, NAT - unlike encryption - is not really a CPU intensive process - i mean not more intensive than regular packet forwarding.
in general, the session setup will be always going along the slow path, and once the session is set up, data can flow either through a fastpath-like accelerated sw path (like DDTB/DDNB) or using a dedicated CPU instruction set (hw accelerated nat) which then consumes less resources compared to kernel mode sw path. in exchange you'll limited by the hw-bound nat table size, thus the number of concurrent sessions - but those limits aren't necessarily reached in many cases.

in either way, you should consider that hw-accelerated-nat - if it is available as CPU instruction, like with MT7621 (yes, mmips as in hexr3) - only shows its power when dealing with longer flows with lots of data. with short flows you will not see the big a wow effect. with hw accelerated nat you'll have packet header rewrites done by a single (or few) instruction, sometimes even in cut-through-mode, where the rewrite happens as soon the packet header is received (and the rest of the packet is still in transit). to my best knowledge, RouterOS is using store-and-forward logic only.
on the contrary you'll lose certain high level functions and most likely "nat helpers" - depending on how the code is actually written for specific types of streams (when to switch over to accelerated path).
#TR0359
 
User avatar
IPANetEngineer
Trainer
Trainer
Posts: 1053
Joined: Fri Aug 10, 2012 6:46 am
Location: Jackson, MS, USA
Contact:

Re: New High Performance Routers ! ?

Mon Oct 14, 2019 7:47 pm


CHR is super unstable product (at least on vmware). We use it only for "the dude" monitoring and 3 ppptp servers for managment. Total throuput is not even 10mbit/s
And Even in that case, it locks up. Needs reboot every week. It looses its winbox port and ssh accesibility. We reboot it from the vm console to make it work.
we cant put CHR in production at all.

I have clients with very stable CHR builds that are doing more than 10 Gbps in production ISP and Data Center networks. If you can only get 10 Mbps, something is wrong in your build.

Even in the testing I did for CHR MUM presentations where ESXi wasn't the best, it still did 5 Gigs of traffic.

https://mum.mikrotik.com/presentations/ ... 562405.pdf
Global - MikroTik Support & Consulting - English | Francais | Español | Portuguese +1 855-645-7684
https://iparchitechs.com/services/mikro ... l-support/ mikrotiksupport@iparchitechs.com
 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 12:03 am

We dont use CHR for real world customer traffic. we use it only for our managment traffic which is 10mbits. it freezes and lockes up. maybe dude is making it locking up. I have no idea but it is not stable.

Nevertheless, I really hoped for a CCR successor. I see that it wont be happening at all in the near future.
 
joegoldman
Member
Member
Posts: 492
Joined: Mon May 27, 2013 2:05 am

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 12:37 am

I see that it wont be happening at all in the near future.
I'd hazard a guess at something by mid-2020, we have QSFP switches now I'm expecting a companion router - and not tile, less cores, more power per core, based on Router OS 7.0 (perhaps even a high powered ARM device given the 7.0beta has been exclusively released on ARM for now)

It wont be too far away.
 
ste
Forum Guru
Forum Guru
Posts: 1805
Joined: Sun Feb 13, 2005 11:21 pm

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 8:32 am

There is a X86 Package. So you could go with plain PC hardware. For sure a core i7 will outperform CCR.
 
mkx
Forum Guru
Forum Guru
Posts: 2948
Joined: Thu Mar 03, 2016 10:23 pm

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 8:53 am

... based on Router OS 7.0 (perhaps even a high powered ARM device given the 7.0beta has been exclusively released on ARM for now)

There is a X86 Package. So you could go with plain PC hardware. For sure a core i7 will outperform CCR.

Right now ROS V7 beta is available for ARM architecture and as CHR. I wouldn't hold my breathe waiting for native x86 (or x64) package, I can understand MT devs that supporting all the different NIC hardware directly (and storage technologies as well) is huge PITA and leaving that to some VM layer is a very productive approach for them (yeah, sure, it comes with performance degradation but what's worse, 5% lower performance or non-working setup?) ...
BR,
Metod
 
savage
Forum Guru
Forum Guru
Posts: 1206
Joined: Mon Oct 18, 2004 12:07 am
Location: Cape Town, South Africa
Contact:

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 9:39 am

Can also confirm, I've done some serious traffic under serious loads on a CHR (ESX).

The problem is however, it's not always feasible to put down a x86 host for virtualization. When it's possible though, it's a no-brainer.
Regards,
Chris
 
mikruser
Member
Member
Posts: 380
Joined: Wed Jan 16, 2013 6:28 pm

Re: New High Performance Routers ! ?

Tue Oct 15, 2019 1:18 pm

doneware
NAT - is not really a CPU intensive process

but in real life author writes something else:

doush
Router only does NAT and nothing else.
CCR1072 CPU consumption is %50 with 18gbit/s total throuput + firewall + NAT plus some cores hitting %80.


doneware
using a dedicated CPU instruction set (hw accelerated nat)
It's not hardware nat.
Hardware NAT implemented completely in hardware, work on wire speed, and do not use CPU.
do not ask me why it is necessary.
 
User avatar
doneware
Trainer
Trainer
Posts: 520
Joined: Mon Oct 08, 2012 8:39 pm
Location: Hungary

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 12:07 pm

It's not hardware nat.
Hardware NAT implemented completely in hardware, work on wire speed, and do not use CPU.
following your logic, CCRs don't have encryption in HW either, right?
btw, can you please point out any _non_cpu_hardware_element_ in the CCR series routers?

network operations "done in hw" are in many cases just header rewrites using some pre-programmed cache. i.e. no traditional lookup is done using generic CPU operations and header element rewrites using again generic CPU operations, but based on cached entries the ASIC logic or dedicated NP/CPU SIMD instruction copies elements from a simplified lookup, like: src/dst MAC, outgoing interface descriptor and in case of NAT src/dst ip and ports. this is still far more efficient than issuing separate generic CPU instructions (like loading an entry from/to stack, copying from/to memory address, comparison, etc) and essentially the actual instruction logic is stored in the CPU/NP microcode.

a potential realisation of this can be done in modern switching chips (in a processor complex/SoC) - if their microcode supports it - which essentially do the same with mac addresses. still the FIB needs to be programmed in a way that the 'hw accelerated' components expect it.
you can keep referring to things as 'done in hardware' if it is done by the microcode of the CPU and as 'done in software' when the CPU is running kernel or user land code to achieve a certain functionality.
#TR0359
 
ste
Forum Guru
Forum Guru
Posts: 1805
Joined: Sun Feb 13, 2005 11:21 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 12:31 pm

It's not hardware nat.
Hardware NAT implemented completely in hardware, work on wire speed, and do not use CPU.
following your logic, CCRs don't have encryption in HW either, right?
btw, can you please point out any _non_cpu_hardware_element_ in the CCR series routers?

network operations "done in hw" are in many cases just header rewrites using some pre-programmed cache. i.e. no traditional lookup is done using generic CPU operations and header element rewrites using again generic CPU operations, but based on cached entries the ASIC logic or dedicated NP/CPU SIMD instruction copies elements from a simplified lookup, like: src/dst MAC, outgoing interface descriptor and in case of NAT src/dst ip and ports. this is still far more efficient than issuing separate generic CPU instructions (like loading an entry from/to stack, copying from/to memory address, comparison, etc) and essentially the actual instruction logic is stored in the CPU/NP microcode.

a potential realisation of this can be done in modern switching chips (in a processor complex/SoC) - if their microcode supports it - which essentially do the same with mac addresses. still the FIB needs to be programmed in a way that the 'hw accelerated' components expect it.
you can keep referring to things as 'done in hardware' if it is done by the microcode of the CPU and as 'done in software' when the CPU is running kernel or user land code to achieve a certain functionality.
+1

CPU ist HW, too :-) If there are enough CPUs which are fast enough there is no need for specific ASICs.
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 12:36 pm

The attractive property of MikroTik routers (and switches), its low price, is made possible by the use of standard SoC chips which have only a basic processor and some optimization of encryption.
Everything runs in software, made possible by the Linux system which has a very advanced networking stack, and some MikroTik proprietary patches to enable some things that standard Linux can not do.

Other manufacturers make special ASICs with associative memory and special microcode to do things faster. This is more expensive, both because of chip design/manufacture in lower quantities but also because of more expensive microcode development.
Of course the result is not comparable. Commonly available "L3 switches" can do wirespeed IP routing and make the CRS products look pale.
Routers can do multi-gigabit routing and filtering and still aren't overloaded.

But to know why MikroTik does not do it that way, you only have to look at the price. When you want and can affort such a router, go buy it from Cisco, Juniper etc.
They serve a different market segment.
 
ste
Forum Guru
Forum Guru
Posts: 1805
Joined: Sun Feb 13, 2005 11:21 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 12:52 pm

The attractive property of MikroTik routers (and switches), its low price, is made possible by the use of standard SoC chips which have only a basic processor and some optimization of encryption.
Everything runs in software, made possible by the Linux system which has a very advanced networking stack, and some MikroTik proprietary patches to enable some things that standard Linux can not do.

Other manufacturers make special ASICs with associative memory and special microcode to do things faster. This is more expensive, both because of chip design/manufacture in lower quantities but also because of more expensive microcode development.
Of course the result is not comparable. Commonly available "L3 switches" can do wirespeed IP routing and make the CRS products look pale.
Routers can do multi-gigabit routing and filtering and still aren't overloaded.

But to know why MikroTik does not do it that way, you only have to look at the price. When you want and can affort such a router, go buy it from Cisco, Juniper etc.
They serve a different market segment.
"standard SoC chips" is not what I think with Tilera based routers. This is specialized routing HW. So this are not top notch routers but perform at a very high level. You have to buy quite big cisco boxes to do the same. Of course this is no switch. So combine a CCR with a CRS and you get a very high level of performance. We combine CRS317 with CCR1036-8G-2S+. Switching is done by the switch and routing with the router.

With CRS326-24S+2Q+RM there is a Switch with 40G Port. I guess next RoutingHW will have 40G too. So there will be new faster combinations.
 
User avatar
doneware
Trainer
Trainer
Posts: 520
Joined: Mon Oct 08, 2012 8:39 pm
Location: Hungary

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 1:24 pm

With CRS326-24S+2Q+RM there is a Switch with 40G Port. I guess next RoutingHW will have 40G too. So there will be new faster combinations.
i on the other hand would cherish solutions with NBase-T (like the sole crs with nXG ports) so it supports 2.5GbE and 5GbE on a single port rather than using LAG.
and if it is for the big guns, i hope 25/50GE gear will come out soon. or god forgive QSFP28+ based 100GE devices - with breakout to 4x25G :-) port density is a bitch and you might not want to run you ports anyway at top speed but just to overcome the previous step w/o LAG, like 25G for 10-12G traffic. the price difference is not as frightening and until it's in DC scale, the only difference is really the transceiver and the port.

40GE is cool, but it is considered by some as legacy and not because of the less throughput, but more about not flowing with the 25/50/100G thing. for me, seeing 4x10G and 40G on mikrotik gear is amazing as it really comes at an affordable price tag. i've never thought we get here this quick.

still a long way until the above stuff becomes truly mainstream...
#TR0359
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 1:52 pm

"standard SoC chips" is not what I think with Tilera based routers. This is specialized routing HW. So this are not top notch routers but perform at a very high level. You have to buy quite big cisco boxes to do the same. Of course this is no switch. So combine a CCR with a CRS and you get a very high level of performance. We combine CRS317 with CCR1036-8G-2S+. Switching is done by the switch and routing with the router.
Well, Tilera Tile is just a multicore CPU that could be used in applications like massively parallel systems for scientific calculations.
And in the MikroTIk way of doing things, it is useful as a CPU in a software-based router.

But when you buy L3 switches from the known manufacturers in the field (Cisco, HP/Procurve/Aruba etc) you get CRS-like functions at much higher performance because the routing is done by the switch ASIC that operates at wirespeed, not by the CPU (which is only used for management).
However, those L3 switches have less overall functionality than a CRS. E.g. no tunneling, IPsec, etc.
The more advanced models DO have things like RIP/OSPF/BGP routing but of course performed by the management CPU so not for internet BGP.
And they have "enterprise" switching functionality for many years now, which MikroTik is very slowly adding feature by feature. (DHCP/ARP tracking, 802.1x, MAC authentication, LLDP, etc).

Again, they usually are more expensive. Sometimes a little more, sometimes a lot more. But for each task you need to select the matching device. MikroTik routers are fine for many purposes, but when it appears you are pushing the limits it may be time to look at others.
 
User avatar
Cha0s
Forum Veteran
Forum Veteran
Posts: 901
Joined: Tue Oct 11, 2005 4:53 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 2:51 pm

MikroTik routers are fine for many purposes, but when it appears you are pushing the limits it may be time to look at others.
Sadly, this is very true.

I would love to see higher end models using ASICs (with the appropriate price tag) to be able to use MikroTik hardware for enterprise solutions.
CCRs are nice, but are nowhere near enterprise level.
 
mbovenka
just joined
Posts: 3
Joined: Mon Oct 14, 2019 10:14 am

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 4:05 pm

40GE is cool, but it is considered by some as legacy and not because of the less throughput, but more about not flowing with the 25/50/100G thing. for me, seeing 4x10G and 40G on mikrotik gear is amazing as it really comes at an affordable price tag. i've never thought we get here this quick.
This. A switch with 24x10G & 2x40G ports for $499,=? I see it and *still* don't believe it.
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 4:22 pm

It is nice as long as you do not need it to route (or route at most management network or other aux network), and as long as you do not need features like Private VLAN or VXLAN or other similar techniques that you often need where you would want to use such a switch for a little more than plain VLAN switching...
 
mbovenka
just joined
Posts: 3
Joined: Mon Oct 14, 2019 10:14 am

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 5:09 pm

It is nice as long as you do not need it to route (or route at most management network or other aux network), and as long as you do not need features like Private VLAN or VXLAN or other similar techniques that you often need where you would want to use such a switch for a little more than plain VLAN switching...

They do private VLAN of a sort. VXLAN? Well, then you can go and buy, say, a Cisco 3850-24XS (same 24xSFP+ & 2xQSFP) which...oops...costs more per port than the entire CRS326-24S+2Q+ does. Does it do a lot more? Sure. But you pay for it too.
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 5:34 pm

That is what I mean. People say "switching has never been so cheap" but they forgot to mention they compare apples with oranges.
Sure it is cheap when you need only plain VLAN switching (I would not even know how to to Private VLAN on them) but where in your infrastructure do you require a multi-10gigabit switch that only needs to do plain switching? This of course depends on your network, but I think in many cases you would want such a switch e.g. in a datacenter with many VM hosts, and then such a switch is not very useful.
 
User avatar
doneware
Trainer
Trainer
Posts: 520
Joined: Mon Oct 08, 2012 8:39 pm
Location: Hungary

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 7:12 pm

Sure it is cheap when you need only plain VLAN switching.
modern switch chips used by Mikrotik, like the Marvell Prestera series can do much more in hw assisted manner:
https://www.marvell.com/switching/asset ... 336_pb.pdf

just take 802.1BR port extender: pair this with a router and you have a ton of ports. or VRF support in 'hw', or ipv4/ipv6 forwarding in 'hw'. they even support nvGRE tunnelling.
this is all there, but must be supported by the sw ecosystem. this part is extremely hard. routeros is just like Cisco IOS was back in the early 2000s: absolutely versatile. you can to anything on top of the other. just like it was with the 7200 series routers.

once you go down the 'hw' assisted road, it is full of pitfalls. it can be blazing fast, but with a crapload of limitations, that are very specific to the hw. usually people think that cisco/juniper has no problems, but that is far from true. they lost tremendous amount of flexibility during this 10-15 years. in many cases there's just _one_ way to do a thing. this is scary to me. or some L3 functionality - normally totally unrelated to link layer - is available on ethernet, on dot1q VLAN, but not on QinQ or .1ad. or you can't have labels over GRE tunnels. or some random stuff you can easily do with routeros - because that part is done in sw.

modern network operating systems just program the hw components and try to keep some sort of balance between limitations and the hw capabilities. sometimes they manage to do something new using a neat trick, misusing some present functionality - but that is very very rare.

we sacrificed flexibility on the altars of speed :-)
#TR0359
 
pe1chl
Forum Guru
Forum Guru
Posts: 5829
Joined: Mon Jun 08, 2015 12:09 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 8:35 pm

modern switch chips used by Mikrotik, like the Marvell Prestera series can do much more in hw assisted manner
But that does not bring you much when it is not supported by the software, as you already wrote.
Maybe it can do VLAN filtering on a bridge without falling back to software, but will that still work when you use horizon etc?
Even when you want to run a simple ISP, you will need lots of those functions unless you use PPPoE all the way to a central router.
 
doush
Long time Member
Long time Member
Topic Author
Posts: 622
Joined: Thu Jun 04, 2009 3:11 pm

Re: New High Performance Routers ! ?

Fri Oct 18, 2019 11:01 pm

I think if there is one thing to be offloaded to specific hw, it has to be Connection Tracking. I dont know if it is possible but it is the most resource consuming thing in RouterOS.
Apart from that, I think Mikrotik should ditch this Tilera stuff and come up with new hardware based on x86-64 or ARM (Maybe Neoverse ?).
We need higher clocked CPUs. And a lot of it.
 
r00t
Member Candidate
Member Candidate
Posts: 201
Joined: Tue Nov 28, 2017 2:14 am

Re: New High Performance Routers ! ?

Sat Oct 19, 2019 3:11 am

Releasing fully featured x64 ROS would be a good start. Not CHR, but native OS, with all recent drivers linux kernel supports. Who cares if it might be big (1GB?), this version would not be for some embedded boards with limited flash or ram. Just use full potential of current hardware, because right now you can either run CHR with overhead of hypervisor or to try to find rare hardware that will work with x86 ROS.
Hoping now that ROS 7 will be available sooner than later, there will be a x64 build that supports all recent hardware. Compared to custom embedded boards, putting together x86 based high performance router is far easier and would be a good next step for Mikrotik.

Who is online

Users browsing this forum: No registered users and 4 guests