MikroTik

mbovenka

Just tried it with my E3372h-320 (connected to a CCR1036-8G-2S+ running 7.1b1). Both unplugging it and a power reset work for me; the stick comes back afterwards.

mbovenka

Cable is strretched already. :) Same like on the picture. So i Need two different SFPs....type like you said? One is reciever and one transmitter and is it full duplex? :) Because there is stretched only one fibre cable and we need full-duplex communication :) What you have is simplex (single stran...

mbovenka

Only the SFP+ ports support 2.5G, and only when you use a multi-rate SFP+ in them, like the S+RJ10.

mbovenka

Investigation of 98DX3236 switch ship's L3 capabilities is on the roadmap. Please do not misread: it is investigation not development.

Interesting nonetheless. I await with bated breath ;-)

mbovenka

Nonetheless, you are right that CRS317 or CRS309 is a better choice (than CRS312/326) for hardware-accelerated stateful firewall, but for a different reason: CRS317 and CRS309 have twice larger hardware memory . CRS317/CRS309 can offload up to 4.5K connections to the hardware (4K in case of NAT) wh...

mbovenka

That would be not good enough - it would have 40g links, which... let me quote from the newletter:

No it wouldn't. 'XS' is 25G SFP+, 'XQ' is 100G QSFP+

mbovenka

There is a CCR2016-1G-12XS-2XQ coming, if we may believe the innards of the ROS7 binaries. That's all I'm aware of.

mbovenka

Or arguably CRS317 if you count it as mediocre router. Which is quite dated performance level. Unless you can work within the limitations of L3 hardware offload , in which case ROS7 will work wonders for it. Edit: By the way, the L3 offloading wiki page mentions a switch I haven't seen anywhere els...

mbovenka

Thank you for the links. Any suggestions for SFP copper and a couple of NIC's so I can catch up my PC's? *Edit: and if possible, can be acquired on Amazon? For copper I'd just get MikroTik's own S+RJ10s. They are cheap (well, as cheap as 10GBASE-T gets, that is...) and are guaranteed to work. They ...

mbovenka

What equipment recommends? CRS326-24G-2S+RM , or RB4011IGS+RM? You do significant routing & firewalling. CRSes are switches, not routers. This is changing with the advent of L3 offload in ROS7 for some CRS3 series switches, but a) the CRS326 isn't among those, and b) L3 offload is as yet very basic...

mbovenka

New Mikrotik CRS328-24P-4S owner and I am looking for optical recommendations for the SFP+ ports and cable. I would like to run at least one of them in fiber. The run will be long'ish, about 60-70ft. Welcome in the wonderful world of MikroTik :-) For a 60" fiber run, I'd use 10GBASE-SR optics and O...

mbovenka

My R610 would get up near 400/400

So do both my hAP ac & RB4011, with a 866Mbps PHY rate (OnePlus 5T as client).

mbovenka

It's half-broken supported in the new beta version 7.

What's 'half-broken' about it?

mbovenka

On a PC does it show up as a storage USB drive with software in? If it does, you need to reflash it to 'Stick' mode which I found impossible.

Upgrading to ROS7 beta might also help. It works for a E3372h-320 in HiLink mode anyway, which behaves the same under ROS6.

mbovenka

How does the hAP AC compare to the hAP AC2 ? Better WiFi, slower CPU. So if you want it as an AP/basic wired switch, the AC is the better choice, if you want to use it as a router with integrated (somewhat less capable) WiFi and switch the AC2 is better. In your case, the hAP ac is probably the one...

mbovenka

I 4 1 do NOT believe that It will do routing at wire-speed ... why I do not believe that .... because for L3 wire-speed requires an ASIC and non of the hardware specs I see have that L3 ASIC in the gear. Yes there will be an improvement in performance but nowhere near wire-speed. What do you think ...

mbovenka

Can I get an update on how this worked out for you? I am looking for performance data on using the CRS328 in RouterOS mode to do both routing and switching for a small business network. https://mikrotik.com/product/crs328_24p_4s_rm#fndtn-testresults The '512 byte & 25 IP filter rules' results are a...

mbovenka

Interesting as I have mostly default configuration out of the box. Only changed IP for LAN interfaces and done. Did you do anything to enable HW Offload on yours?

No, nothing. I use mine as a plain wired switch & AP, so all interfaces in a single bridge, STP disabled. That's pretty much it.

mbovenka

mkx I disagree with your statement. I have an RB4011 with no VLANs (all ports on the bridge interface only) that I support for a client that doesn't get HW Offload even with no VLANs: So I don't expect wired speeds between LAN ports inside of the RB4011. That's why I use them as Edge router only wi...

mbovenka

looks awesome, if only I could understand what was being said :-)

Switching on closed captions helps 😁

mbovenka

The hAP AC works well too, if you want a few wired Gbit ports to go with the wireless.

mbovenka

Is it possible to flash to the standard firmware on the device wiping it completely without being able to actually get into the web interface of the device?

You could try a netinstall.

mbovenka

OK, I stand corrected, if that's your experience. But just saying 'no, it only has 4 cores' isn't very helpful...

mbovenka

Yes, and those 4 cores are a *LOT* more powerful than the ones in the CCR1009. The CCR2004 has close to 3 times the forwarding performance of the 1009.

That may not entirely map into a 3 times lowering of the CPU load of the OP, but the CCR2004 will no doubt be a step up.

mbovenka

If it still appears in Winbox, you could try connecting through the MAC address. If not, a netinstall with an older ROS version might indeed fix it.

mbovenka

How about CRS309-1G-8S+IN? Or you need is 10GBase-T ?

He needs (more than) 12 ports total.

mbovenka

the chip in the image seems to be blown out from my Groove. any idea what chip it is? and what should i replace it with? It's a DC/DC stepdown converter: http://radiokomponent.com.ua/pdf/is/LSP5502.pdf Costs next to nothing: https://www.amazon.com/IndustrialMaker-10pcs-LSP5502-LSP5502SAC-Authentic/...

mbovenka

The USB port of my CCR1036-8G-2S+ now works again

mbovenka

NAT Hardware Offloading ! Great news. When is this coming to the actual router products like CCR series or new router products ? Not going to happen. They don't have the hardware for it, up to and including the CCR2004. Maybe, just maybe, the CCR2016 will be an ARM64/PresteraDX combo, but I wouldn'...

mbovenka

!) added FastTrack and NAT hardware offloading support for CRS317-1G-16S+RM;

Holy...<beep>. When is this coming to other CRS3xx switches? The CRS305 in particular? Please pretty please?

mbovenka

To be able to realistically saturate 100Gbps line, router would have to be able to route at at least 250Gbps according to official test results ... and this number should stand where there's 4538Mbps for CCR2004. Not sure if CCR2016 will be that much faster than existing CCR2004. Unless they pull a...

mbovenka

And I (sadly?) share views by @BartoszP ... that 100Gbps is nowadays too expensive for MT range. And I don't mean the possibility of adding a 100Gbps interface, I'm talking about capability of routing at that speed. The as yet hypothetical CCR2016 could, if we look at what the current CCR2004 can d...

mbovenka

Of course not. We were talking about 100G internet connections. At least, that's what we started out with.

mbovenka

There is, besides a few other CCR2004s, a CR2016-1G-12XS-2XQ (12x25G, 2x100G) in the offing, as discussed here (thread called 'just leaving this here'). At least references to it are hidden in the RouterOS 7beta binaries. Given the price of the current CCR2004, I wouldn't be surprised if it turned o...

mbovenka

https://www.rogers.com/business/product ... rnet/fibre

So a new breed of Routers etc may be upon us very soon

Bring on that CCR2016-1G-12XS-2XQ, MikroTik

mbovenka

802.1BR is NOT MC-LAG and has a different use case. It is for bridge extension, port expanders and the like. You could possibly use it for stacking... I didn't say it was the same. I said that it probably would bring it with it, and I stand by that. It makes it possible to have LAGs with members co...

mbovenka

The IEEE 802.1BR support added to 6.48beta12 will eventually give us that, and more: *) crs3xx - added initial Bridge Port Extender support (CLI only); *) crs3xx - added initial Controlling Bridge support for CRS317, CRS309, CRS312, CRS326-24S+2Q+ and CRS354 devices (CLI only); A full IEEE 802.1BR i...

mbovenka

But then it seems MT doesn't consider VLANs to be SoHo feature as the built-in switch chip is just fine as long as one doesn't use VLANs. True, it seems that way. But I beg to differ, and probably a lot of SOHO networkers along with me. The 4011 is an awesome little box for the price (I even bought...

mbovenka

However, I can see understand why the RB4011 has such a dumb switch-chip. Is not supposed to be used as a switch, only as a port-expander. But then the device is somewhat unsuitable for SoHo-usage. Exactly. It would be better at what it is if it had a somewhat more capable switch chip, one capable ...

mbovenka

You're using CRS317 as router and CRS317 as router sucks ... throughput maxes at around 400Mbps. If you'd user CRS317 as a switch, then it would be able wirespeed transfers. So think about the reason why you use CRS317 in routing mode and how you can avoid doing that. Upgrading the CRS317 to ROS 7b...

mbovenka

I agree that something is missing between the RB4011 and CCR2004. The RB4011 is a bit more tilted against Home-usage. CCR2004 is a datacenter device. I've been thinking about the MT routing & switching lineup in general. IMHO, it's due for a cleanup. What I would do, were I MikroTik: 1) Ditch the R...

mbovenka

i dont need WiFi or many RJ45. What i need is a powerfull router with min. 2x SFP+ let the router be a router and nothing more Agreed. There is room between the RB4011iGS+RM and the CCR2004-1G-12S+2XS for a router with a small number of 10G interfaces. Something like a CCR version of the CRS305.

mbovenka

"no way" "route" Please be much much more specific, you present the subject like routing would be some magical high overhead process. I suggest you look at the link cited in the message before yours. It doesn't get more specific than that and it shows that yes, routing is 'some magical high overhea...

mbovenka

I'm little bit affraid about using non-stable, beta release. It's my home router but it is like production environment and it's heavilly used specially these days. That's a choice you'll have to make for yourself. The 4G stick will work, and my CCR1036-8G-2S+ has been running 7.0b8 for 27 days now ...

mbovenka

They advise me to upgrade to beta (7) version of OS . I have the same stick, and it does the same. With 6.x it flips between two USB IDs, that of a 4G stick and that of a mass storage device, and the link is up when it behaves as a 4G modem. Upgrading to ROS 7beta8 worked for me connected to a hAP ...

mbovenka

I was thinking iperf3 is single-thread (single stream) and so for multi-thread one has to use iperf v2. The last time I had tested iperf3 the server part could not accept multiple connections. So I switched back to iperf v2. AFAIK iperf3 will let you run multiple TCP streams in parallel, with the -...

mbovenka

Normis, am I way off base here, or should I send you to jail??? ;-) LOL :-). Yes, you're off base. It's not the physical interfaces, but the number of data streams like TCP sessions that matters. Across the Internet, you don't need to have 10G to run into this; that's why things like BitTorrent and...

mbovenka

What kind of BS answer is that? The test results from MT clearly show the OP should easily reach 10Gigs (12-26K very doable) one way. Even IPSEC shows at 4K That's not a BS answer, @anav. Those test results are with many streams in parallel (look at RFC2544). It's quite possible that a single strea...

mbovenka

The CCR2004 probably comes close enough in practice, assuming your firewall is simple: https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-testresults Connecting everything with 10G on a CRS305 will still limit you to the routing performance of the RB4011, and it won't do full 10G, as you can see ...

mbovenka

Yes, if you have a C S S326 it will handle VLANs, but it will not route between them; it's an L2 switch only. A C R S326 will (when running RouterOS), but it's not powerful enough to route 10G. Not by a long shot. The RB4011 comes closer , if you make a 10G router-on-a-stick out of it. But in essenc...

mbovenka

I don't really understand what you mean. If only the router knows about the VLANs, how is the switch going to handle them? And yes, SwOS will do VLANs as well. I would put the NAS and your workstation in the same VLAN, because otherwise yes, you'll be bottlenecked by the external router, or the rout...

mbovenka

I upgraded my NAS with a 5G USB based ethernet NIC. When connected to the CRS305, SwOS reports the link as 10G, while the NAS reports its link as 5G. Shouldn't the CRS305 be reporting 5G? Also, I am only getting about 500Mbits of throughput. If I connect the NAS to a 1Gbit switch, I get the full 90...

mbovenka

Never thought of using phone like that except when travelling, but nice job!! The LTE interface RouterOS creates isn't really one, you can't talk directly to the 4G network through it. It behaves more like an P2P Ethernet interface with a NAT router & DHCP server on the other end (much like the 'Re...

mbovenka

https://blog.ligos.net/2018-03-01/Mikro ... lover.html

Good writeup. That's pretty much how I did it, except that I used an Android phone in USB tethering mode, which gives you an LTE interface automatically (it acts like a 4G stick in that regard).

mbovenka

In general I can agree with that (I am just now in the process of migrating some internal systems at $dayjob from SuSE 10.0 to something current) but you should also consider that waiting too long to upgrade can also make it more painful to finally do so.

True (I'm looking at you, NX-OS

).

mbovenka

True, but the problem is that the routing in CRS and many other devices is not fast enough for that. We "regularly" see disappointed CRS users here who kind of expected it. We can point them to CCR and they usually will have no problem (certainly not with CCR2004) but then they start to expect othe...

mbovenka

Probably they consider the processor on this chip very powerful. I have managed many L3 routing switches from the wellknown manufacturers in that field, and most of them have a much slower control plane processor than this (or else they have written their firmware in interpreted BASIC...). Those ma...

mbovenka

I think those devices like the 98dx8216 are positioned as L3 switching devices with the processor only intended for use as management/monitoring processor. (to run a configuration UI and provide services like SNMP) Yes, they are. The CPU in the SOC is meant purely as a control plane: CLI/web interf...

mbovenka

Of course we would not have had this discussion when it was released as a CCR2004-1G-4S+2XS but then probably prople would ask for "more ports" :D Probably :D. The real solution to this of course is to build something with ARM64 as control plane processor and PresteraDX as data plane forwarder (mer...

mbovenka

Interesting the cage I bought for my 260 works fine in the CCR1009, but the RJ45 from ubiquiti does not. They look exactly the same physically with a different sticker. Why would the ethernet page show boxes for VENDOR, if the bloody thing doesnt accept other vendor products LOL. Because they do? I...

mbovenka

I believe the hardware acceleration you're referring to on the CRS is for VLANs.

No, the CRS317 has L3 offloading (hardware-assisted routing) as of ROS7.0b6.

mbovenka

I'm a network engineer at $dayjob, and my motto is simple: don't upgrade unless you *must*. And 'must' means one of two things: 1) there turns up a colossal security hole in the software you're running (and it must be in functionality you actually use) or 2) newer software has functionality you abso...

mbovenka

Why? The big boys are no different. They build their own hardware, and virtual stuff to run under your hypervisor of choice. And for much the same reason MikroTik decides to depreciate x86 and focus on CHR.

mbovenka

Anyone else having problems with the CCR1036-8G-2S+ USB port under 7.0b8? I upgraded my CCR from 6.46.1 to get my Huawei 3372h-320 working (tested on a hAP ac). But on my CCR, the stick isn't recognized. In fact, nothing is; nothing shows up in USB resources, whatever I connect to it (USB memory sti...

mbovenka

you have a lte1 flapping interface. Please check when lte1 is down if usb device is still detected in system \ resource \ usb ? You use HiLink mode with dhcp-client at lte1 then what show you his GUI when you connect to him ? Means, uptime and session uptime or maybe you have some custom firmware ?...

mbovenka

Thanks for you feedback. I'm just a bit irritated about this note on the homepage: Note: The RB4011 does not support Passive DAC modules. What does this exactly mean? I just want to be sure I'm not stuck with a non working SFP port ;-) That it doesn't support the S+DA0001 , S+DA0003 and other passi...

mbovenka

I had a look at RB3011 and 4011. Both of them seems to have problems with SFP modules or are in general not very stable. I also don't really get the different SFP models and how they are working. Can somebody point me to a capable replacement for my router? I'd still say the RB4011. I use a generic...

mbovenka

You don't. NTP serves UTC; it's up to the clients to make local time out of it.

mbovenka

Yeah, in that case, why not.

mbovenka

Hello.
So I tried to use version 7.0beta8 and everything is OK !!! The web interface with settings and sending of SMS is even functional. Fast download test - 70 Mbit / s. So for me - solved

That's good news! Time to upgrade my CCR to 7.0 then...

mbovenka

since 2.5 and 5 GBit ethernet makes sense regarding to hardware costs, I wonder if I can use a MikroTik CRS309-1G-8S+IN with an MikroTik S+RJ10 SFP+ Module in 2.5 GBit Mode. I don't have the hardware here, but in the switch, when I disable autoneg i can only chose between 100, 1000 and 10000 MBit b...

mbovenka

But isn't HW Offloading already present at least on all CRS3xx devices? My CRS326 and CRS305 do have it already (both use the Marvell 98dx3236 SoC): For L2 switching, yes. What the CRS317 can now do is L3 offloading: hardware-assisted routing. It makes the CRS317 twice as fast at IP routing (within...

mbovenka

I see that L3 hardware offloading is supported only on the CRS317. I'm wondering, is this simply because that's the chosen test-bed for this in ros7? I'm looking at some other devices (Netpower 16P big time) that also have the 98DX series chip in them. Hoping all DX based devices see the hardware o...

mbovenka

Not really. NMEA output is approximately every second, but exact timing is not defined ...

You're absolutely right. It's been too long since I played with NTP and GPS timing receivers

mbovenka

What is a more accurate method of setting the clock, GPS or SNTP? From a quick google, I realise this isn't a Stratum 1 device. So would it even matter? Also how often does the clock poll the GPS? Is it possible to see this in RouterOS? I expect GPS to win, even without PPS support. NMEA output get...

mbovenka

and what firmware & webui version you use at e3372 ?

WebUI:

Software version 10.0.3.1(H192SP1C983)
Web UI version WEBUI 10.0.3.1(W13SP2C7110)

Firmware: 22.001.34.01.03

mbovenka

What RouterBOARD are you using?

Same behavior on a hAP AC and a CCR1036-8G-2S+. The hAP is at 6.46.4 and the CCR at 6.46.1.

mbovenka

I have the same stick, and it does the same thing. When you look at the USB resources, it's flipping between USB storage device and LTE modem. I think it's trying to offer its builtin 'driver CD' flash to the Mikrotik, like it does to Windows machines (where it works fine) on first connect, and the ...

mbovenka

But of course this is all in beta, I don't think I would buy a CRS317 right now with the objective to run internet-facing BGP and L3 offloading on it...

True. That 'no firewall' isn't too hot an idea either in that case.

mbovenka

However, you can ask the ISP to send less routes to you, e.g. only default route or only aggregated routes at /8 or /16 level, and save a lot of BGP processing.

The OP said that he had 2 BGP peers with defaults only. Even the CRS317 CPU should be able to handle that, I'd think.

mbovenka

i have Mikrotik CRS317-1G-16S+ and i want to use it as backbone switch for: - 2 two VLANs (untagged) - only for switch split - total throughput about 4 Gbit/s + more in the future - for about 2 000 active users (behind the switch) Is it good idea ? Should work just fine, assuming you don't need any...

mbovenka

The L3 hardware offload will take many months (or years - we are talking about v7 after all) before you can consider it stable. And even then, it will still be a... switch . Well, that it'll take a while to to get stable is a given :D. But in what sense is an L3 switch not a router? That difference...

mbovenka

Forget CRS. CRS are switches. NOT routers. Only because they have wildly underpowered CPUs compared to their IO. Anything that can run RouterOS has the same basic functionality. And RouterOS 7 beta7 gave us "added Layer3 hardware offloading support for CRS317-1G-16S+RM". That made the CRS317 (but, ...

mbovenka

Next question, how much routing performance do you need? A CRS354 will probably do 2 BGP sessions with just defaults just fine; that doesn't take much. But it's no great shakes as a router; it'll do 300Mbps on a good day. Even something like a hEX will do better! If it's a few SFP+ ports you need an...

mbovenka

It is also the most practical way to increase transmit power beyond the legal limit while operating in the regulatory-domain mode.
That is probably why it is now gone.

Why? It's easy to reject settings that would result in an illegal ERP.

mbovenka

Yeah, if it weren't for the cost and pain of tearing up walls and ceilings, the fiber modules+cabling would have been cheaper than the copper modules+reusing existing cabling. Yes, that's a problem. I had the luxury of being able to get rid of the UTP cable and use OM3 fiber instead, but you can't ...

mbovenka

Cat 6 isn't for more than 1Gbps, you need Cat 6A shielded cable for more speed. No, 10GBASE-T is supposed to do 10G over CAT6 to a maximum of 55 meters. CAT6A is needed only to reach 100m. My experience with the S+RJ10r2 is roughly the same as the OP's; I had a 20m run of good CAT6 that I couldn't ...

mbovenka

Wireshark on the destination PCs shows that Ping request arrives (with correct source and destination addresses). But it generates no response! So the problem is not in the router, it is in the PC! Yup. My guess is: Windows PC with firewall enabled. The Windows builtin firewall blocks ping by defau...

mbovenka

I'd get an HeX straight away and leave that 2011iL as switch and don't look back.

This. Or a hAP ac². Only a little more and will do 400Mbps standing on its head.

mbovenka

I'm seeking a solution for CRS switch devices with RouterOS in Bridge Mode (I think the procedure could be the same on router devices). Well, if it had been a router interface, you could have set up a netwatch for the interface IP address. But I agree, a generic script trigger on interface state ch...

mbovenka

Well, I can see where he is coming from. MGig is getting more common on new motherboards, so it's not unreasonable to want utilize it. But switch silicon that only does mGig without also doing 10G is rare as hen's teeth, if it exists at all, so switch vendors don't build switches that do. It's 10G (...

mbovenka

Then no, there is nothing in the MT lineup that will fit. They have nothing that will only do mGig but not 10G. Whether there is anything planned, your guess is as good as mine

And I don't know of anyone who does, at least not for less than the CRS312.

mbovenka

The CRS312-4C+8XG-RM looks like what you need. Or any of the others with enough SFP+ ports and the number of S+RJ10 modules needed.

mbovenka

Can somebody just confirm that I can make a vpn with hap ac2? And that it is that more powerful than a hex s?

Yes you can (it runs RouterOS after all) and yes, it is. You can check the test results for both devices at the MikroTik site.

mbovenka

I can second this. I have a S+RJ10 R1 and can't see how hot it is. I have it in an CRS317 where it works fine. During the repair of the CRS317 I moved it into a CRS328 together with 3 DACs. It got quite unreliable there, I assume due to lack of coolling. So I am not surprised that it has problems i...

mbovenka

I think I will go with the CRS354 and RB4011. I am also planning a mutiroom audio system using some Raspberry PIs which will use up about 15 ethernet ports. And I think the CRS354 will give me some spare ports. Currently only the APs are using PoE and they cuome with a PoE injector. For PoE cams I ...

mbovenka

10GBASE-T transceivers all run hot; they use a lot of power, far more than optical ones. I have an Aquantia-based 5Gbps USB adapter, and it gets hot to the touch when in use. And it's a pretty solid block of metal; I don't want to know how hot the transceiver itself gets. My S+RJ10s run from 65C to ...

mbovenka

Are these chips from 'Annapurna labs' going to have a Long Term Support? or Another 'TILE' Incident with No New Features / Development in Future. They are an Amazon company, and Amazon uses their stuff (de Graviton & Graviton2) in AWS. I think we're pretty safe. Not to mention everybody and their d...

mbovenka

One question for the experts though, will this router also interface @2.5 and 5 gigabit?

If you put an S+RJ10 in it, I see no reason why not. My CCR1036 did (when I used copper 10G).

mbovenka

If you need more throughput, you'll have to wait for the CCR2016 version. Assuming the throughput scales linearly, you'd have 140Gbit routing capacity @ 1518 Bytes - close enough to wirespeed. Personally, I see it as an upgrade for my current CCR1016-12S-1S+ Yep, it does pretty much kill off the CC...

mbovenka

Yes, you will. But (and that may be a big but): the CCR2004 is not a switch. It has a maximum of about 35Gbps of throughput, either routed or bridged, and that speed drops rather quickly when you ask more of it than just routing or bridging max size packets. If you want line speed throughput between...

mbovenka

Join the club. I'm not getting the idea behind this box either. It's woefully underpowered for the IO it has.

mbovenka

Copper SFP(+) modules exist. So you don't *need* a switch per se. And 1G SFPs work in SFP+ cages, if 10G is overkill.

mbovenka

No. The port extender is just that and does no local switching (as the 'bridging' numbers indicate).

mbovenka

4011s too (they don't support passive DACs)

mbovenka

Yes, they will. You can look at the SFP compatibility list to be sure.

mbovenka

Depends on what type your SFP+ is. Copper ones are often multi-rate and will do 1G. Optics not so much. Putting an SFP in your switch is probably the easiest.

mbovenka

can I use this transceiver in the switch CRS326-24S+2Q+RM ?

https://www.fs.com/products/84374.html

It's to do a long distance cross-connect.

No. That's a 100G transceiver, the CRS326 is 40G. Use this one:

https://www.fs.com/de-en/products/36172.html

mbovenka

If I remember correctly, these tests measure the speed of the payload traffic, not the speed at ethernet layer. That would explain the difference: due to the header overhead it hits the (theoretical) 35Gbps ceiling. That's not what the test results indicate; 1518 bytes is a full 1500-byte MTU Ether...

mbovenka

Could it be a mix? The only part of the packet that uses CPU power is the header, the payload is just using memory bandwidth. Maybe with the 1518 byte packets its memory is bandwidth starved, and the CPU isn't maxed out. When it get smaller packets we use more CPU - as the payload gets smaller - th...

mbovenka

The CCR2004-1G-12S+2XS looks promising. I would like to see some speed test results of GRE and EoIP over IPSec. With the current generation of CCRs (TILE) the results of using plain ipsec and tunnel over ipsec differ by a mile. Well, looks like the CCR1016-12S-1S+ is pretty much dead now. But the t...

mbovenka

no 40G port support? In the text i read about it but in technical overiew i only see 25G ? Nope, no 40G. The new CCRs hinted at in the new software (and now with the first one in datasheet) are 10/25/100G: ccr2004-1g-12s+2xs 4 Core, 1x 1G, 12x 10G SFP+, 2x 25G SFP28 ccr2016-1g-12xs-2xq 16 Core, 1x ...

mbovenka

Very cool! I'm looking forward to the 16 core version for replacing some CCR1072 BGP routers, but those numbers for the 4 core one are pretty promising. The only head scratcher is the RAM... "RouterOS v6 1792MB ECC / RouterOS v7 4GB ECC", so for some reason we can't get the full 4GB of RouterOS 6? ...

mbovenka

You can not have the Same IP in a static Lease even for a different MAC address... Just make a better network planning.. Although I agree it's a bit of a hack, from a protocol point of view there is no reason why you couldn't have two (or more, for that matter) static leases for the same IP address...

mbovenka

I have set static DHCP for some computers, but they sometimes arerconnected through ethernet and other times through wifi. As the mac are different in either case, static lease only work for one interface. It is possible to use the same static lease for both interfaces? Depends on how forgiving the...

mbovenka

According to the PresteraDX 3236 product brief (https://www.marvell.com/content/dam/mar ... 014-03.pdf) it's a dual core.

mbovenka

By 'fake' I meant the price. The link you gave shows a price of $20, yes, but $63 shipping. I didn't look any further than that.

mbovenka

There is that, although Fiber Store (and others) will customize their stuff to report just about anything you want. It's not really a problem anymore. And those Finisars...yeah, they look cheap at first glance. But that's fake. Have you seen the utterly ridiculous shipping costs? These things aren't...

mbovenka

Active DACs, yes.

But they are more expensive than two SR SFP+ modules and a multimode fiber patch cord of the needed length, so why use them (unless you already have them for some reason)?

mbovenka

I mean the latter. Separate 10GBASE-SR SFP+es and an OM3 or OM4 fiber patch. The optics are a lot cheaper than copper SFP+es, and the cabling is about equal. It's the cheapest option for anything beyond passive DAC range.

mbovenka

For 10 meter distance, I would go with multimode fiber and 10GBASE-SR optics. Much cheaper than either an active DAC or 10GBASE-T (I don't know of any 10m passive DACs)

mbovenka

The Fiber Store: https://www.fs.com/de-en/c/ruggedized-fiber-cables-1080

mbovenka

No, not really. Mine is 47C at 23C input air temperature. Your input temperature is 37C (which is rather high), so my CPU would be at 61 degrees at that air temperature, assuming the rise is linear. It probably isn't, so 69 degrees doesn't surprise me. If it's stable, I wouldn't worry.

mbovenka

So can i expect 5g throughout at switch mode with just vlan config

Yes, assuming you don't do the inter-VLAN routing on it. Traffic that stays within a VLAN will be switched at wirespeed.

mbovenka

Your answer is wrong !
AOC cables do not have detacheable transmission medium involved as well...

Which is why they're in general called 'direct attach cables' as well. Not strictly correct perhaps, but it's what I have encountered in practice.

mbovenka

For higher ISP connectivity ie 1Gig fibre, it falls short, but otherwise pretty decent at that price point. Actually, it should do 1Gbps or close to it. I have used its brother from another mother (a Ubiquity EdgeRouter X-SFP, which is a hEX S hardware-wise) and it filled my 1G internet link withou...

mbovenka

Yes, but your load balancing algorithm doesn't look deeper than L3, so one IP address == one link. https://wiki.mikrotik.com/wiki/Manual:Layer2_misconfiguration#LAG_interfaces_and_load_balancing You need at least L3+L4 or even balance-rr instead of 802ad (although your TCP sessions will not like the...

mbovenka

I added 2 Bonding Interfaces and add them to my bridge. (Mode 802.3ad, layer 2 and 3).

My problem is, that I am getting the same speed as before (1 Gbit connection).

Hint: Your MacBook Pro only has a single MAC & IP address.

mbovenka

CRS326-24G-2S+RM

For the CRS326: https://mikrotik.com/product/CRS326-24G-2SplusRM
And https://www.marvell.com/content/dam/mar ... 014-03.pdf

Can't find the info for the CSS.

mbovenka

Although the compatibility matrix claims it should work, I am doubtful that any SFP+ module (which a DAC essentially is) will work in an SFP cage such as that of your RB2011.

mbovenka

yes work with proxmox,lisesni p1 ,but high cpu on ethernet,
maybe because limit cpu j1900

Probably. The J1900 isn't exactly a speed demon.

mbovenka

There are no intermediate hops, unfortunately.

Then why is the TTL interesting at all?

mbovenka

If the driver is not in ROS, your only option it to contact support and try to persuade them enough so it's added... good luck with that. There is also small possibility beta version of ROS 7 may have the driver, you can try installing it to USB key (so you don't mess up your existing SSD) and test...

mbovenka

Yes, them running crazy hot seems to be normal. Mine go to 85C. As far as the MTU it concerned, you might want to search te forum. IIRC the same question was asked recently and the answer was that in SwitchOS jumbo frames are enabled by default.

mbovenka

Like the CCR2004 & CCR2016 discussed here: viewtopic.php?f=3&t=158149&p=777444&hil ... re#p777444 ?

mbovenka

Yes, that's true, but I misled you, sorry. I missed that you have a CCR1036-12G-2S. The S+RJ10 is a 10G SFP+ module and will not work in your SFP ports. So no, there is no way to make any of your ports run at 2.5G, sorry. You'll need to upgrade to something with a 10G SFP+ port ('S+' in MT parlance)...

mbovenka

The S+RJ10 will autonegotiate to any speed it supports in the CCR1036. I ran mine at 5G for a while before I could run fiber.

mbovenka

The S+AO0005 will work. Or two 10GBASE-SR optics and an OM3 or OM4 patchcord, which is the most flexible option.

mbovenka

No. The RB4011 doesn't support passive DACs.

mbovenka

So you can buy a 10GbE switch for $150, but for 2.5GbE you have to spend at least $500.

No. The S+RJ10 supports 2.5G & 5G. Doing it in my CRS309 right now.

mbovenka

I just used the Marvell Prestera's as an example, because I know the ASIC's are capable of it, and that Mikrotik are familiar with them due to their use in CRS3xx series. They could use almost any of the modern L3+ switch ASIC's. The Marvell Octeon TX2 and possibly NXP ARM based SOC's are really th...

mbovenka

Possibly Mikrotik have combined Annapurna Labs ARM core's with Marvell Prestera Switch ASIC's, where the AL chip does the initial packet pass (slow path) then the fast-path is handled by the Marvell ASIC. This would allow them to scale port counts independently of the ARM core and would also allow ...

mbovenka

https://wiki.mikrotik.com/wiki/Manual:Reset

mbovenka

It is not lunacy when a 40G card costs about 300 euro. Professionals also work at home. Vortex, there is a difference between 'there is a market for 40G for home' and 'a router with 25G ports is quite minimal for SOHO'. I agree with the first, small as I think that market to be. The second does not...

mbovenka

The port configuration is actually quite minimal for SOHO. Some people would actually look for Q+. We've been here before: I want what you are smoking. Really. We're getting to the point that 10G is useful and affordable for prosumers and enthousiasts. Calling a router with 25G ports 'quite minimal...

mbovenka

Some clues here? https://wiki.mikrotik.com/wiki/Manual:Product_Naming#CloudCoreRouter_naming_details OK, now that makes a lot more sense. a CCR2004-1G-12S+2XS has 12 SFP+ ports and 2 25G SFP+ ports, and the CCR2016-1G-12XS-2XQ has...<blink>... 12x25G & 2x100G ? :shock: I want to see prices for that...

mbovenka

what 60ayD could mean?
Terragraph?

Yeah, might be 802.11ay.

mbovenka

My point was: - G means GBASE-T so X would just mean 10 - XQ should actually be QC if XC replaces C+ - There's nothing that says 40 in XS I agree that 'XS' as 40GBASE-T doesn't make much sense, but the specs that shop gave for them do indicate that 'XS' means '40 Gigabit ethernet' of some sort, and...

mbovenka

Intresting. The ccr2016 variant, AL73400 possibly? Yeah, might well be an AL73400, even if the network specs seem a bit low for that (https://en.wikipedia.org/wiki/Annapurna_Labs). It's 16-core, and MT has experience with the Alpine platform in de RB4011. @normis, 'fess up. What are the lot of you ...

mbovenka

Ah! Didn't think of google cache. Interesting prices too; 10K NT$ is only US $334,=. Somehow I don't think they'll be *that* cheap

mbovenka

I don't understand XS, XC, and XQ. According to the links @Paternot found (but are gone now), XS would be '40 Gigabit' and XQ '40 Gigabit combo'. With '40 Gigabit' being (I assume) 40GBASE-T (because of the 'combo' bit, and we already have 'Q+' for QSFP+ 40G). To my great surprise 40GBASE-T actuall...

mbovenka

Are you running them succesful as in no TX/RX pauses with "Flow Control" enabled or disabled?

I use FS.COM generics as well, with flow control disabled, and see no pause frames.

mbovenka

I was thinking of buying S+AO0005 but the distance between the router and the switch in my rack is 3U at max 50 cm cable run, so I don't need a 5m cable. Are there shorter ways of connecting the two devices whilst not going over S+AO0005 price? Two 10GBASE-SR generic optics and a short fiber patch ...

mbovenka

It is good to know that this last resort workaround exists and it looks like fun, but: - It is too complicated for a regular home user - It is an opportunity to make mistakes - The hardware setup is suboptimal So, a proper multigigabit routing solution for the home is still needed and I will wait f...

mbovenka

Thanks @mbovenka. Since this technically solves my problem, would using a CCR1009 have a faster inter-VLAN and to-Internet routing since you mentioned 4011 will have 7.5Gbps? Or am I misunderstanding this and it would be the same in CCR1009? Also, why would one choose a CCR1009 over the RB4011? Is ...

mbovenka

You cannot have one connection routing at more than 1Gbps that way, which is the point of the thread. Actually, yes, you can. Make the 10G port in the RB4011/CCR1009 a router-on-a-stick, and you get close to 10G out of a 4011 between the CRS 10G ports (OK, when slinging full-size packets and doing ...

mbovenka

@LSan83, so the router will not affect the traffic of the switch of 10G (and/or above) traffic? If that’s the case, then I would definitely opt to get the CCR1009 instead of going overkill to CCR1036. Can you (or anyone) please help confirm this? No, it won't. Looking at what you need, you might ev...

mbovenka

Looks like your flash is mounted read-only for some reason. Maybe it's failing. You could try a netinstall; if that doesn't fix it, you're probably out of luck.

mbovenka

I read you already have good LAN-switches, so the Hex S can also be used if you do not need the ports on the RB2011.
More then powerful enough as you have "low internet" speed.

The hEX S is actually faster than the RB2011.

mbovenka

I would expect them to be, MikroTik boxes aren't fussy about their optics. I use generic 10GBASE-SR SFP+ modules from the FiberStore (https://www.fs.com/de-en/products/11552.html) and they work fine.

mbovenka

I am not interested in better CRS switching, but better routing. Which takes more expensive silicon. MT don't need te develop it themselves, there is merchant silicon like Broadcom Qumran-UX available, which would make a dandy 'CRS426' full L3 switch, but that stuff isn't cheap. At least not compar...

mbovenka

I was afraid you would say that

You're right, it's not entirely the same, but it's as close as it gets in RouterOS, it seems.

But perhaps someone else has an idea.

mbovenka

It's called 'port security' in RouterOS: https://wiki.mikrotik.com/wiki/Manual:C ... t_Security

mbovenka

Not all CRS3xx hardware has VXLAN support in the ASIC. CRS309 and CRS317 do. CRS326 and CRS354 do not. Interesting. So the 98DX82xx ASICs do VXLAN, but the 98DX32xx & 98DX83xx don't? I can't find that anywhere, and on the main PresteraDX page Marvell seems to claim VXLAN support for the entire Pres...

mbovenka

all are talking about 10G and more. But hey be realistic i am living in germany and i am happy to get 50/25 VDSL. 10G for a home is fine but could the provider give that full 10G to you if there are more users on the last mile? I would prefere a good and stable 1G connection for all even on the rur...

mbovenka

10G would be a budget router. A proper home NAS should be 40G now. What have you been smoking? Sorry, but 10G routing isn't 'budget' in any shape or form. Routers capable of filling a 10G pipe with more than 1 SFP+ interface still cost a thousand bucks; the CCR1036-8G-2S+ is still the cheapest you ...

mbovenka

The Marvell PresteraDX chips in the CRS3xx series switches can do VXLAN in hardware, so offload is technically possible. It's up to MT to actually implement it in RouterOS.

mbovenka

Residential 10Gbps is ridiculous.

Oh, I agree. Won't stop me from getting it as soon as they start offering it, though

I'm haven't been picked for the trial, alas.

mbovenka

"error - contact MikroTik support and send a supout file (3)"

I suggest you do what the error message tells you to do. Contact MT support.

mbovenka

10G FTTH? It's coming (my ISP has started a trial), and I could have used something like a beefed-up RB4011 with 2 SFP+ cages. I have a CCR1036 now, but it is both expensive and large (if you don't have a 19" rack to mount it in).

mbovenka

Try something larger. Your bandwidth-delay product should let you reach 1Gbps, and for 3ms RTT that takes a TCP window size of at least 367KB.

mbovenka

How did you test with iperf3? With 3ms RTT, 350Mbps is about par for the course with a single TCP stream with a 128KB window.

mbovenka

That's not a problem. The box will only draw as much as it needs, even if the PSU can deliver more. Do check de polarity of the plug at the router end, though; that must match.

mbovenka

FS company were very helpful in finding the solution for this problem. The problem was with "AUTO-negotiation". Turning off the auto-negotiation function for the devices at both ends and forcing only 1G rate solved the issue. Thanks a ton for every one who helped me in this issue. special thanks to...

mbovenka

I have just installed RB4011 and it seems the wireless connection is not at it's best speed. My ISP allows to use the net with the speed of 600/50 Mbps. On a cable I am reaching that 550 - 600 Mbps. Sadly, on 5 GHz I cannot reach more than 200 - 250 Mbps. Anybody could help with using proper settin...

mbovenka

Thanks for the quick response! He just saying i can see your mikrotik router connected, but router is not requesting for a DHCP. can i manually send a DHCP request (to get an ip from ISP) from the router? i would be very glad if you have some time to check my router configurations!! Can you please ...

mbovenka

So My ISP confirmed that the module should have TX 1310 nm, RX 1490 nm and RX 1550 nm is for TV Signal. But i also tested with this module (https://www.fs.com/de-en/products/39135.html) which has RX 1550 and still i have "no-link".. i am using this(https://www.mikrotik-shop.de/Netzwerk/LWL-Verkabel...

mbovenka

I don't think it matters. You just have to take into consideration that the two switch chips only have a 2.5Gbps uplink to the CPU, so that if you have to rely on the CPU to do the work, the switch chips are 2:1 oversubscribed, where they are wire speed with hardware offload active for traffic that ...

mbovenka

I don't think you can have VLANs and hardware offloading at the same time on a 4011. The RTL8367 switch chips in there have no hardware support for VLAN filtering. I'd just configure the VLANs, live with the fact the CPU has to do the work, and see whether it's fast enough. I don't think using the f...

mbovenka

The CRS312 will do LACP. That's what 802.3ad bonding mode is.

mbovenka

And please finally retire the Tile architecture. It's a dead horse. There are much better architectures out there noawadays. Although I agree Tile is a dead end, that's more because Tilera went away and the current owner of the IP (Mellanox) isn't really interested in developing it further. The bas...

mbovenka

oh man oh man you are absolutely right about he module. Yes its fritzbox 5490 and it has TX 1310 nm, RX 1480 bis 1580 nm, so the module you suggested is the right one. The ISP guy still don't wanna accept that the module(current one) he suggested was wrong, now i will order this. With all the infor...

mbovenka

Now i replaced ccr1072 router with Fritzbox router, with fritzbox i could connect to the internet. below is the details provided by ISP. 131574111 - 22.01.2020 14:59:05 - 10.212.14.60 - 000005 - 013 - E0996D2E947 - DHCPACK 187.3x.2x6.23x 131574111 - 22.01.2020 14:59:05 - 10.212.14.60 - 000005 - 013...

mbovenka

Our ISp suggested the SFP module which i currently use, he says that my router is not requesting their DHCP sever for an IP address. They are confused and told me they cannot help. I want to figure out where is the fault.. you guys have been amazing in helping me find the solution. Thank you That y...

mbovenka

Are wavelengths correct? Your module transmits at 1310nm and receives at 1490nm ... More usual wavelength combo is 1310/1550nm. Actually 1000BASE-BX10 uses 1310/1490nm officially. But receivers are pretty wideband; I would expect 1490 & 1550nm to interoperate. My ISP does as well, they spec the opt...

mbovenka

Looks a bit weird. You have signal from the other end, it seems (rx-loss no & rx power -12) but no link. What does your ISP say?

mbovenka

What does '/interface ethernet monitor sfp1' show? If your SFP is recognized at all, it should print a lot of info about it.

mbovenka

Telephony is on their router, so I couldn't take over. Should I ask for bridge mode? And IP / network and gateway? I'm not sure bridge mode is a possibility if you also have telephony. You can still replace their router with your own if they will let you and if they will tell you how to configure i...

mbovenka

That is what it seems to me too. What should I tell them (not sure about terminology)? I just want to take over the public IP where they are the gateway and provide access to the internet. You want them to put their CPE router in bridge mode. No idea whether your ISP supports that; not all do. Anot...

mbovenka

I have a TP-Link 1000BASE-BX10-U SFP in my CCR1036-8G-2S+. Works just fine.

mbovenka

There is no zero id in standart.

Not an actual VLAN 0, no. But a dot1q frame header with 0 as the VLAN ID is perfectly valid; it just means a priority-tagged frame without a VLAN ID.

mbovenka

Oi. That's not according to standard. RFC925 ('Multi-LAN Address Resolution', which describes what is, in effect, proxy ARP, even if it isn't called that) says: 'When an ARP query is broadcast by any host the BOX reads it (as do all the hosts on that LAN). In addition to checking whether it is the h...

mbovenka

The disadvantage of proxy-arp is mainly that it causes all ARP requests to reply with the router address, and so internal (to your LAN) traffic can end up being "routed" and this can load your router or reduce the performance of that traffic (e.g. when you have a fileserver and workstations exchang...

mbovenka

In RouterOS you can turn on reverse path filtering:
/ip settings set rp-filter=yes

Shouldn't that be '/ip settings set rp-filter=strict', Normis? Or are they synonyms?

mbovenka

Yes, you should definitely test a poweroff. Boot RouterOS, set the MTU, set it to boot SwOS, and powercycle it. Does it still work?: You're golden. If not (and, to be honest, I'm betting it won't

), well, it was worth a shot.

mbovenka

Just a wild idea: assuming for a moment that SwOS leaves the MTU as it finds it, you could boot into RouterOS, change the MTU, and boot back into SwOS.

mbovenka

mbovenka Please keep us updated on what you find. You can also generate a supout.rif file before attempting to fix an issue and send it to us. Seems to have been a false alarm; it suddenly started working, and the logging didn't show any attempts at all before that. Maybe an ISP issue... I'll keep ...

mbovenka

The upgrade of my CRS305-1G-4S+IN and RB4011iGS+5HacQ2HnD-IN went fine. Updating my CCR1036-8G-2S+ seems to have broken the L2TP/IPSec server; the router is back, but I can no longer connect to it with the Android VPN client; it just times out. Will look at it when I'm home this evening...

mbovenka

According to those results, this switch never operates (switches) at the full 10bge speed? (9536mbps) ? If i wanted to use the switch with vlan routing, then i still need RouterOS correct? or can i just use the SwOS? It can switch at wire speed or close to it (see the 'Switching' results). It just ...

mbovenka

If you have your network connected to ether1, that's not part of your bridge. Ether add it to the bridge (like Alain suggests) or connect your network to one of the other Ethernet ports. I have a RB4011iGS+5HacQ2HnD-IN setup that way, with all ports added to the bridge (ether1-9, wlan1 & -2 and sfp-...

Search found 212 matches