Community discussions

 
10robinho
just joined
Topic Author
Posts: 11
Joined: Thu Jan 23, 2014 4:40 pm

CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 2:49 pm

Hello all,

We have a setup with CRS326Q-24S+2Q+ as our core switch.
We booted SwOS to it.

When pinged in LAN it has 23% packed loss and average ping 10ms (from 1 ms to 2022ms).

Every few minutes (random time span) it completely stops forwarding packets for 2-5 seconds.

I have no idea how to debug it. Someone have ideas where to start?
Last edited by 10robinho on Fri Nov 01, 2019 3:12 pm, edited 1 time in total.
 
Zacharias
Forum Veteran
Forum Veteran
Posts: 732
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: CRS326Q-24S+2Q+ packed drops

Fri Nov 01, 2019 2:51 pm

Maybe CPU is high when you loose those pings ?
 
10robinho
just joined
Topic Author
Posts: 11
Joined: Thu Jan 23, 2014 4:40 pm

Re: CRS326Q-24S+2Q+ packed drops

Fri Nov 01, 2019 3:11 pm

Maybe CPU is high when you loose those pings ?
Switch becomes unresponsive in that period of time so it's not possible to check it.
 
dmitris
Frequent Visitor
Frequent Visitor
Posts: 71
Joined: Mon Oct 09, 2017 1:08 pm

Re: CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 3:13 pm

Please make pictures of your configuration and post here.
 
10robinho
just joined
Topic Author
Posts: 11
Joined: Thu Jan 23, 2014 4:40 pm

Re: CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 8:43 pm

Well, it's just default SwOS configuration...

We have few more interesting discoveries. Here is our setup and explanation.

We connected 10 CSS326-24G-2S+ with sfp+ to core CRS326Q-24S+2Q+ switch.
All of them are on default SwOS.
On each CSS326-24G-2S+ we connected 10 to 20 PCs with 1G copper.

We run ping test on those computers from main router and get interesting results.

2 switches from 10 have ping timeouts for 2-5 seconds each few minutes.
This happens on those two switches in the same time, while other 8 switches don't have ping timeout.

We suspected that it was a problem with SFP+ modules and cables but nothing changed after we replaced those.
Next suspicious thing was that those two CSS326-24G-2S+ failed, so we replaced one of them to test.
After we replaced them we realized that the same problem happens again, on the new CSS326-24G-2S+ switch.

Next step - we replaced problematic CSS326-24G-2S+ with CSS326-24G-2S+ that was working fine and we get the same issue on those new ones.
This means that the group of PCs is causing this network issue, no matter on which switch they are connected.

We will try to identify which PCs are causing problems.
I suspect it's something low level like duplicate MAC or something similar.

Do you guys have any ideas?
 
dmitris
Frequent Visitor
Frequent Visitor
Posts: 71
Joined: Mon Oct 09, 2017 1:08 pm

Re: CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 10:52 pm

Are these PC-s have only single connection to the switches?
 
10robinho
just joined
Topic Author
Posts: 11
Joined: Thu Jan 23, 2014 4:40 pm

Re: CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 11:19 pm

Are these PC-s have only single connection to the switches?
Yes, simple built-in gigabit NIC on consumer MBO.

If it's significant, there is one server in network that we connected directly to core switch with double qsfp+ and teamed it's NIC on Windows server side (not on Mikrotik side).
 
dmitris
Frequent Visitor
Frequent Visitor
Posts: 71
Joined: Mon Oct 09, 2017 1:08 pm

Re: CRS326Q-24S+2Q+ packet drops

Fri Nov 01, 2019 11:36 pm

Maybe you have broadcast storm in your environment...configure lacp on sw side too or configure Broadcast Storm Control, by default it's 100% set it to 5%.
https://wiki.mikrotik.com/wiki/SwOS/CSS326#LAG

Maybe RSTP playing with you rough game, as you said all switches are with def conf. You should configure RSTP properly or disable it. Core switch should be root bridge
https://wiki.mikrotik.com/wiki/SwOS/CSS326#RSTP
https://wiki.mikrotik.com/wiki/Manual:S ... e_Protocol


Also look in switch menu at error tab, are there something interesting?
 
thommyf
just joined
Posts: 1
Joined: Wed Nov 06, 2019 4:03 pm

Re: CRS326Q-24S+2Q+ packet drops

Wed Nov 06, 2019 5:06 pm

Hi,

maybe we have the same errors.
We first tested a 10Gbit setup with a CRS305 - the 4 Port SFP+ Mikrotik Switch.
We use this SFP+ DAC Cables: https://www.fs.com/de/products/74621.html
This worked fantastic.

We then bought 4x CRS326-24S+2Q+RM.
We wanted to upgrade our Hyper-V Cluster and Storage to 10Gbit.

We had a lot of problems - server freezes (until network connection was terminated) , ping timeouts, error connections iscsi volumes etc.
Then we stopped the upgrade and kept at 1Gbit Speed.

We noticed through the statistics tab of our Emulex network cards, that we have from 300 to 6000 CRS Errors within 10 Seconds
of iperf3 tests - depending on the port and the cable we used.
We have these errors with Emulex 10Gbit OCE11102 network cards also with HP NC523SFP network cards.

If we connect two servers directly with the same DAC cable we have no errors.
If we use 2m cisco compatible cables we also have no errors.
If we use 5m Fujitsu compatible cables we also have no errors.
If we use FS-10Gbit GBics , Dell 10Gbit Gbics, Intel 10Gbit GBics we have no errors.

So there is a incompatibility between the mikrotik switch and these cables.
As the cables make no problems when directly connection servers with them here seems to be a problem with the mikrotik
switch.

- CRS305 -FS.com Generic DAC cable - no errors
- CRS326 -FS.com Generic DAC cable - CRC errors (errors occur with all 4 Mikrotik Switches we have)

Image
Image
Image
Image

Who is online

Users browsing this forum: No registered users and 1 guest