Community discussions

MikroTik App
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Nov 15, 2018 6:47 pm

Hi

I am running 17 CRS328-24P-4S+ connected to 2 CRS317-1G-16S+ using this SFP S+32LC10D. The 328 boxes are running RouterOS 6.43.2 and the CRS317 boxes are running 6.43.4. I am experiencing that all the ports on the CRS317 are going up and down with anything between minutes to hours apart. It is almost no traffic on the network. I am totally in the dark here, do any of you have any idea what this could be?

Example from log:
17:02:12 interface,info sfp-sfpplus2 link down
17:04:07 interface,info sfp-sfpplus2 link up (speed 10G, full duplex)
17:09:04 interface,info sfp-sfpplus8 link down
17:09:05 interface,info sfp-sfpplus8 link up (speed 10G, full duplex)
17:18:00 interface,info sfp-sfpplus3 link down
17:18:01 interface,info sfp-sfpplus3 link up (speed 10G, full duplex)
17:24:13 interface,info sfp-sfpplus4 link down
17:24:15 interface,info sfp-sfpplus4 link up (speed 10G, full duplex)
17:25:04 interface,info sfp-sfpplus16 link down
17:25:05 interface,info sfp-sfpplus16 link up (speed 10G, full duplex)
17:34:00 interface,info sfp-sfpplus4 link down
17:34:01 interface,info sfp-sfpplus4 link up (speed 10G, full duplex)

Interface stats from one of the CRS328:
/interface ethernet print stats from=sfp-sfpplus2
name: sfp-sfpplus2
driver-rx-byte: 4 096 343 318
driver-rx-packet: 44 864 695
driver-tx-byte: 1 460 265 180
driver-tx-packet: 9 040 331
rx-bytes: 4 277 853 088
rx-too-short: 0
rx-too-long: 0
rx-unicast: 9 695 367
rx-broadcast: 31 908 257
rx-pause: 0
rx-multicast: 3 273 516
rx-error-events: 239
rx-fcs-error: 0
rx-fragment: 0
rx-overflow: 0
rx-jabber: 0
tx-bytes: 1 498 564 543
tx-unicast: 9 049 910
tx-broadcast: 231
tx-pause: 0
tx-multicast: 4 463
tx-underrun: 0
tx-collision: 0
tx-late-collision: 0
tx-rx-64: 31 287 843
tx-rx-65-127: 4 828 178
tx-rx-128-255: 17 182 394
tx-rx-256-511: 179 280
tx-rx-512-1023: 436 533
tx-rx-1024-1518: 17 622
tx-queue0-packet: 9 037 205
tx-queue1-packet: 0
tx-queue2-packet: 0
tx-queue3-packet: 0
tx-queue4-packet: 0
tx-queue5-packet: 0
tx-queue6-packet: 0
tx-queue7-packet: 0
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 04, 2018 9:19 pm

Try 6.43.7 and make sure routerboot is also updated.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 04, 2018 10:38 pm

Sure, i dont see anything about the 317s in the changelog, but i'll try. Will give a new status in about 24h, will see if anything has changed.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Dec 05, 2018 9:30 am

Try 6.43.7 and make sure routerboot is also updated.
Sad to say, but this made no difference.
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Dec 05, 2018 4:30 pm

I am also seeing some link downs on CRS328 switches but the firmware update made them significantly less for me.
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Dec 10, 2018 10:01 pm

Did you find a fix yet?
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 9:47 am

Unfortunately not. I sendt them the support files at 22. Nov and did a follow up on 4. Des. Still no reply. Would be great if MT would have a look at this.
 
mducharme
Trainer
Trainer
Posts: 1777
Joined: Tue Jul 19, 2016 6:45 pm
Location: Vancouver, BC, Canada

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 10:59 am

From the MikroTik site it looks to me like the S+32LC10D is specifically meant to have the S+23LC10D module on the other end. Are you using the same module on both ends?
 
Elliot
Frequent Visitor
Frequent Visitor
Posts: 61
Joined: Tue May 30, 2017 3:04 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 11:21 am

I have the SAME EXACT problem. Mikrotik needs to fix this. No problem with 1Gbps SFP but with OWM SFP+ it's hell. I think this could be combination of software and hardware problem with SFP+ modules.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 11:54 am

I have the SAME EXACT problem. Mikrotik needs to fix this. No problem with 1Gbps SFP but with OWM SFP+ it's hell. I think this could be combination of software and hardware problem with SFP+ modules.
I agree with you assumtion that this is an edge case between the SFP units and the switch. But strangely it only occurs on one of our two CRS317 in the installation.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 11:55 am

From the MikroTik site it looks to me like the S+32LC10D is specifically meant to have the S+23LC10D module on the other end. Are you using the same module on both ends?
I am using the paired SFP+ from Mikrotik S+2332LC10D. So yes.
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 11, 2018 6:51 pm

What's the fix Mikrotik?
 
cowgirl
just joined
Posts: 5
Joined: Tue Dec 18, 2018 12:10 am
Location: South-West-Germany
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 22, 2018 6:42 pm

Push - she problem on CRS328 here.... waiting for a fix
 
sff
just joined
Posts: 17
Joined: Fri Aug 13, 2010 5:15 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 22, 2018 6:49 pm

We had this same problem appear on one of our 317s. I am not 100% sure when it started, but it was observed on 6.43.4. The upgrade to 6.43.7 fixed it, but ONLY after I did a full factory reset and reloaded the configuration by hand (it wasn't complex).

We also observed it for a brief time on several of the 328s. Switching from using SFP+1 to SFP+2 for the uplink fixed it.
 
wotoni
just joined
Posts: 16
Joined: Sat Aug 04, 2012 12:13 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Dec 28, 2018 6:37 pm

We are experiencing the same thing. Running 6.42.7 with DAC Cable from CRS317 to CRS328-4C-20S-4S+RM.

I had to go to a SFP 1G on both units for the flapping to stop. I had tried SFP+ DAC and SFP+ single mode fiber with the same issue.

We have 8 CRS212 plugged into the CRS317 via DAC Cable with no issue. Only the 328 SFP+ ports appear to have the issue.
 
AVA
just joined
Posts: 22
Joined: Mon Jun 18, 2018 6:19 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 06, 2019 11:21 am

Exactly the same problem here. Links between CRS317 and CRS328-4C-20S-4S+ are flapping. I have 3 pairs of 317 <-> 328 and all have the same problem. I tried different SFP/DAC. The latest firmware (6.43.8) does not help. No problem with 1GbE links....... :(
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 06, 2019 1:05 pm

I sendt MT a service dump in november - still no answer. Could i bother you guys that are experiencing the same problem with sending MT an email urging them to have a look at the issue - or at least give some feedback. I am experiencing total radio silence.
 
User avatar
jprietove
Trainer
Trainer
Posts: 212
Joined: Fri Jun 03, 2016 3:00 pm
Location: Cádiz, Spain
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 06, 2019 2:52 pm

Are any of you using port ether1 or just sfp-plus ports? If you are, remember that "The new Cloud Router Switch 317-1G-16S+RM is a rack-mountable manageable switch with Layer3 features, it has 16 SFP+ ports for high performance 10GbE connectivity and a 1GbE copper port for management. "
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 06, 2019 3:04 pm

Are any of you using port ether1 or just sfp-plus ports? If you are, remember that "The new Cloud Router Switch 317-1G-16S+RM is a rack-mountable manageable switch with Layer3 features, it has 16 SFP+ ports for high performance 10GbE connectivity and a 1GbE copper port for management. "
I can only speak for myself - and i am only using the SFP+ ports.
 
AVA
just joined
Posts: 22
Joined: Mon Jun 18, 2018 6:19 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 06, 2019 4:35 pm

I think the problem is the CRS328. We use the CRS317 as Core with downlinks to different CA devices, some with 1GbE and some with 10GbE. The only affected links are those between CRS317 and CRS328 with 10GbE.
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Feb 07, 2019 4:29 pm

exact same issue here, same symptoms, same workaround (force 1G link), it would be great if Mikrotik took this issue seriously...
 
Redmor
Member Candidate
Member Candidate
Posts: 256
Joined: Wed May 31, 2017 7:40 pm
Location: Italy

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Feb 07, 2019 8:20 pm

I ever had bad experiences with CRSs port flapping and I don't use them anymore, both ethernets and SFPs.
Sometimes on CCRs ports go totally down, disabling and enabling them solves the problem.
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Feb 08, 2019 9:57 am

Sometimes on CCRs ports go totally down, disabling and enabling them solves the problem.
In production context ? :)
 
AVA
just joined
Posts: 22
Joined: Mon Jun 18, 2018 6:19 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Feb 18, 2019 5:08 pm

I've wrote to Mikrotik Support ~2 weeks ago and also our Distributor said he would contact Mikrotik but till now no reaction. :cry:
 
AVA
just joined
Posts: 22
Joined: Mon Jun 18, 2018 6:19 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Feb 25, 2019 11:50 am

Hi,

I got an answer from support. They could reproduce the flapping issue and are working on a solution.
 
RFG
just joined
Posts: 8
Joined: Wed Dec 13, 2017 4:28 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Mar 01, 2019 8:01 pm

Same problem over here with CRS328-4C-20S-4S+RM on Sfp+ ports. I'm connected to a Dell X1052 with S+DA0003.
Let's wait for the correction.
 
K0IBM
just joined
Posts: 7
Joined: Mon Apr 11, 2016 8:11 pm
Location: Denver, Colorado, USA
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Mar 05, 2019 5:48 am

I will add my agreement to this thread. I have a CRS317-1G-16S+ with 4 CRS328-24P-4S+ and 3 CSS326-24G-2S+RM All are using the Maxxwave MW-SX+MM-US Modules. I have the same port flaping on all the CRS328 ports and the CRS317 reboots on a regular basis. The links to the CSS326's seem to be stable. I too am interested in this fix.

Steve Cearley
Steve@cearley.us
Wellshire Presbyterian Church.
 
inatec
just joined
Posts: 14
Joined: Wed May 02, 2018 3:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Mar 05, 2019 12:56 pm

hi,

same for us. We fighting with the same problem on our CRS317-1G-16S+ (viewtopic.php?f=2&t=146044). We thougth, it might be a configuration issue. I replaced cable, SFP+ modules (Allnet / Ubiquitiy) but nothing helped. Now I replaced the both ports (core-03 and core-04) with the 10G copper SFP ports and its seems now stable.
We replaced in the first time also one switched, which helped (core-lan-01). But now we have the same issue between core-lan-03 and core-lan-04.
 
Stick1970
just joined
Posts: 3
Joined: Thu Mar 07, 2019 6:20 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Mar 07, 2019 6:26 pm

i mean the same problem
port flapping on CRS328-24P-4S+ and CRS317-1G-16S+
software version 6.44
I tried different SFP modules.
Are there any solutions to this problem?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Mar 08, 2019 8:21 am

Me too..
317 - Ccr 10Gb mk Dac ok
317 - 326 10Gb mk S+85DLC03D ok
317 - 328 10Gb mk Dac flapping
The strange thing is that for over one month all worked fine, after that, without any change, the flapping began.
Forcing the Dac to 1Gbps stop the flapping immediatly, now we are monitoring it, but we need 10Gb connections.
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Mar 08, 2019 8:34 am

hello folks,

we have multiple CRS317-1G-16S+ and CRS328-24P+4S+ with the same problem.
All running RouterOS and firmware 6.44.
They all connected togehter with Mikrotik DAC S+DA0001.
After switching to RouterOS and firmware to 6.45beta6 (Testing) don't solve the flapping port problem.

Last try....
Finally we switched on the CRS317-1G-16S+ to SwitchOS 2.9.

So the CRS328-24P+4S+ with RouterOS works with the CRS317-1G-16S+ with SwitchOS for 24h without problems...


So i think it's a problem on the CRS317-1G-16S+ with RouterOS.

regards
 
inatec
just joined
Posts: 14
Joined: Wed May 02, 2018 3:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Mar 08, 2019 9:06 am

hi,
Me too..
317 - Ccr 10Gb mk Dac ok
317 - 326 10Gb mk S+85DLC03D ok
317 - 328 10Gb mk Dac flapping
The strange thing is that for over one month all worked fine, after that, without any change, the flapping began.
Forcing the Dac to 1Gbps stop the flapping immediatly, now we are monitoring it, but we need 10Gb connections.
since, not all ports flapping, just one or two, I assume that there is a hardware failure. But we have to wait, until MikroTik have something so say.
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Mar 08, 2019 10:33 pm

hmm, same problem

CRS317-1G-16S+ vs CRS326-24G-2S+ - DAC

today CRS317 stop traffic and in same time CRS326 stop working port connecting to CRS317.
MKv6.44
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Mar 11, 2019 10:08 am

hello folks,

update:

After we switched on the CRS317-1G-16S+ to SwitchOS 2.9
5 days without port flapping. :)

regards
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Mar 11, 2019 10:13 am

hello folks,

update:

After we switched on the CRS317-1G-16S+ to SwitchOS 2.9
5 days without port flapping. :)

regards
This is good news and indicative of software issues. Raising the probability of a fix. I have however met nothing but radio silence from MT lately, have any of you guys gotten any info from them?
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Mar 25, 2019 8:17 pm

What's the stats of the fix?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Mar 28, 2019 8:43 am

After we switched on the CRS317-1G-16S+ to SwitchOS 2.9
5 days without port flapping. :)
Hi roggles, still stable with SwitchOs?
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Mar 28, 2019 11:01 am

yes, since there are no log entries
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Mar 28, 2019 11:26 am

CRS317 replaced with UBNT EdgeSwitch 16XG. Problem solved. I will not wait for the device to stop 1Gbit traffic.

I won't wait for it to ever be fixed. Similar to flapping on RB3011 and the like.



MIkrotik -1000.
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Apr 03, 2019 10:51 am

Have the same problem with UF-SM-10G & CRS317-1G-16S+ with 6.42.12.
Any RoOS version with fix?
 
Guntis
MikroTik Support
MikroTik Support
Posts: 153
Joined: Fri Jul 20, 2018 1:40 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Apr 03, 2019 11:35 am

Have the same problem with UF-SM-10G & CRS317-1G-16S+ with 6.42.12.
Any RoOS version with fix?
Could you please send us email, about your setup and problem, to support@mikrotik.com?
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Apr 03, 2019 11:43 am

Have the same problem with UF-SM-10G & CRS317-1G-16S+ with 6.42.12.
Any RoOS version with fix?
Could you please send us email, about your setup and problem, to support@mikrotik.com?
Hi! How Is the fix coming along?
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Apr 03, 2019 12:45 pm

Could you please send us email, about your setup and problem, to support@mikrotik.com?
Ticket#2019040322003846
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Apr 03, 2019 12:57 pm

Could you please send us email, about your setup and problem, to support@mikrotik.com?
Ticket#2019040322003846
Where do i get additional information about tickets? I see no links in the emails i have gotten.
 
asadsayyad123
just joined
Posts: 4
Joined: Tue Feb 14, 2017 12:38 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Apr 09, 2019 5:29 pm

Severe port flapping on 10G links, works with auto-negotiation turned off and set to 1g.

CRS317-1G-16S+ <<>> CCR1009-8G-1S-1S+, Flapping at 10G, Works stable at 1G

CRS317-1G-16S+ <<>> CRS328-4C-20S-4S+, Flapping at 10G, Works stable at 1G

CRS317-1G-16S+ <<>> CRS212-1G-10S-1S+, Works Stable at 10G.

CRS328-4C-20S-4S+<<>> CRS328-4C-20S-4S+, Works Stable at 10G.




So, it all boils down to ROS BUG in CRS317.
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Apr 14, 2019 6:09 pm

Does anyone have port flapping problem with 10G link between CRS317-1G-16S+ <<>> CRS317-1G-16S+ ?
In our case it starts to happen after about a week after reboot and it happens on 2 of 3 ports. We tried to interchange modules used on stable link - but on other link it also flaps.

We have flapping on 1 & 5 ports, but no flapping on 9 port. Coincidence?

In SwitchOS you dont have log entries and the link is stable also? May be in SwOS it just does not log the short term failures?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Apr 14, 2019 6:21 pm

Mikrotik support tell us that the problem is well known and that they don't have ETA for the resolution.
Their official workarround is to downgrade links to 1Gb or use switchos on 317
I hope that someone take care about this terrible bug!!

Alessandro
 
neutronlaser
Member
Member
Posts: 445
Joined: Thu Jan 18, 2018 5:18 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Apr 14, 2019 7:26 pm

file bug
 
asadsayyad123
just joined
Posts: 4
Joined: Tue Feb 14, 2017 12:38 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Apr 15, 2019 6:18 am

Hello,

SwitchOS is one big pile of shit with no real featues, as it was intended for the general audience.

When i add SFP media converters or non-mikrotik or unmanaged switches on the other end it does not pick the link up.

But ROS does, hence we cannot use SWOS at all (As a last resort even if it a very crap OS .).
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Apr 15, 2019 9:13 am

Hello,

SwitchOS is one big pile of shit with no real featues, as it was intended for the general audience.

When i add SFP media converters or non-mikrotik or unmanaged switches on the other end it does not pick the link up.

But ROS does, hence we cannot use SWOS at all (As a last resort even if it a very crap OS .).
You are absolutely right about SwOS, but what can do with many introduced MiktoTik devices with only SwOS ?
It's not normal to produce a lot of hardware with no software capable to handle it...
I still believe, that MiktoTik will get attention on this and will produce real working OS.
btw I keep all my with SwOS 2.7
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Apr 22, 2019 1:42 pm

BTW, how do u guys can confirm that there no port flapping under SwOS? I didnt find any log section in SwOS web interface...
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Apr 22, 2019 2:12 pm

You have to check it on 328 side, looking for disconnections or rstp recalculation
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Apr 30, 2019 11:30 am

So seems like the problem is with CRS317-1G-16S+
We have one CRS317-1G-16S+ in center and three CRS317-1G-16S+ at remote ends, after 6 days from reboot we got port flapping - but not on all ports, we tried to change SFP+ modules, cables but no sense. After we changed from RoOS to SwOS on central CRS317-1G-16S+ log files of the remote CRS317-1G-16S+ (that are still running RoOS) are showing no port flapping after more than 8 days!
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Apr 30, 2019 7:30 pm

I have issues on the CRS328 connecting to a Siklu.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu May 02, 2019 8:14 pm

I can confirm that the problem appear also with 2 CRS317 connected trought mk DAC.
PLEASE MIKROTIK, GIVE US SUPPORT!!!!!!!!!
 
Zito
just joined
Posts: 14
Joined: Tue Feb 19, 2013 11:41 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 15, 2019 3:51 pm

I confirm the problem with the CRS328 and CRS317 connection.
The problem is partially solved by the change of the CRS317 system to SwOS. But still Rx FCS Errors occur on the 10G interfaces.
[Ticket#2019051422003403]
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 15, 2019 4:06 pm

Mikrotik, this issue has almost 6 months !!

It seems that Mikrotik acknowledges the problem, my reseller confirmed this point, you should be able to prioritize this issue as it affects core features : we're unable to deliver 10G connectivity !!
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri May 17, 2019 5:47 pm

The problem is partially solved by the change of the CRS317 system to SwOS. But still Rx FCS Errors occur on the 10G interfaces.
We can confirm the same, but not on all interfaces, those that were stable on RoOS have only 2 Errors.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri May 17, 2019 6:03 pm

Mikrotik support, please WAKE UP!!
Customers are angry and whants different brand hardware!
 
Zito
just joined
Posts: 14
Joined: Tue Feb 19, 2013 11:41 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 22, 2019 11:02 am

*) crs3xx - improved switch-chip resource allocation on CRS326, CRS328, CRS305;
..but still problem not fixed.
1.PNG
2.PNG
You do not have the required permissions to view the files attached to this post.
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri May 24, 2019 8:02 pm

Can anybody try to add attenuators on problematic links? Would it change anything?
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat May 25, 2019 6:53 pm

Can anybody try to add attenuators on problematic links? Would it change anything?
That seems unlikely as I have the same link flapping on my DAC links btween the CRS328 and CRS317 on 10G links. Something seems to be wrong (software or hardware??), but Mikrotik does not seem to be interested...
 
maxpower
newbie
Posts: 26
Joined: Fri Dec 05, 2014 4:45 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun May 26, 2019 7:43 pm

Does the DAC link have Rx FCS Errors also?
 
Zito
just joined
Posts: 14
Joined: Tue Feb 19, 2013 11:41 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon May 27, 2019 11:42 am

Does the DAC link have Rx FCS Errors also?
Yes
This is the setup on my desk. It does nothing, only connections between switches.
3.PNG
You do not have the required permissions to view the files attached to this post.
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon May 27, 2019 6:05 pm

We are having this issue as well between two CRS317-1G-16S+ in our datacenter. We wrote an E-Mail to MikroTik Support on the 18th of May.

There has not been any reaction since*.

EDIT: *except for the automated reply message.
 
gentrice
just joined
Posts: 1
Joined: Tue May 28, 2019 3:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue May 28, 2019 4:16 pm

Our client has 200+ units installed in different locations, now even in 1G is not stable.
We have been pushed for months, mikrotik nothing to say.
Very bad service, client try to use Ubq to replace all CRS328.
I am thinking about it too, maybe we should close the distribution with Mikrotik.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 29, 2019 8:10 am

Very bad service, client try to use Ubq to replace all CRS328.
Hi gentrice, we are angry too, but the problem we are talking here is on crs317.. what kind of problem do you have on crs328?
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 29, 2019 12:33 pm

There has not been any reaction since*.
We received an answer that MikroTik is aware of this issue and is working on a solution.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 29, 2019 12:39 pm

Have anyone gotten any time estimates on when flapgate is beeing fixed?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed May 29, 2019 2:05 pm

new reply by mk support:
We are working on this problem, it could take up to a couple of weeks, to find a proper solution and test it.
we hope it...
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 05, 2019 11:21 am

Hi gentrice, we are angry too, but the problem we are talking here is on crs317.. what kind of problem do you have on crs328?
We were able to reproduce this issue on CRS328-24P-4S+ connected via SFP+ DAC to a CRS317-1G-16S+. We tested the following scenarios:

.) change SFP+ port on CRS328 -> port keeps flapping
.) change SFP+ port on CRS317 -> port keeps flapping
.) take a freshly delivered CRS317 connect it to the CRS328 -> port keeps flapping
.) take different DAC -> port keeps flapping

Turning off Auto Negotiation and pinning it on 10Gbps (tick the radiobutton under Interfaces->Ethernet) on both CRS results in a stable 1Gbps link.

The setup firmwares and Package Versions:

CRS328-24P-4S+: 6.43.12 (stable), Firmware: 6.42.5 (Factory)
CRS317-1G-16S+: 6.44.3 (stable), Firmware: 6.44.3, Factory Firmware: 6.42.11

We added this information to the ticket we have opened.

EDIT: We updated the CRS328-24P-4S+ to 6.44.3 (Firmware & Packages) -> port keeps flapping
Last edited by nicoh on Thu Jun 06, 2019 10:44 am, edited 1 time in total.
 
SX1
just joined
Posts: 3
Joined: Thu Dec 22, 2016 5:21 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 05, 2019 4:36 pm

In our scenario we needed to connect CCR1036-8G-2S+ (ROS 6.44.1) to CRS328-4C-20S-4S+ (SwitchOS 2.9) using Mikrotik SFP+ DAC 1m. We got 10G FDX connection, but it was always unstable. We had the following troubles:
  • 10G link flapping, sometimes, when it wants)
  • After a few hours of good working tagged traffic between CCR1036-8G-2S+ and CRS328-4C-20S-4S+ begun to drop. Connections begun to close one by one, until we reboot CRS. Than it works good again, but for a few hours only. After that we seen packet loss again.
  • If we tried to change any SFP+ settings like auto negotiation or set manual 1G speed, link goes down after applying and not became up. Link became up only if we reboot CRS or physically replug SFP+ DAC. And many other port settings in SwitchOS has the same bug - not working without reboot. DHCP client starts to work only after reboot too.
I think that's enough. Now we definitely completely refuse to work with mikrotik switch. It has too many unsolvable problems.
Bcause if we tell our customers that they need to wait a few weeks/months/years without Internet connection, until Mikrotik fix it, they will simply connect to another provider, and our business will go bankrupt.
 
keefe007
Member Candidate
Member Candidate
Posts: 125
Joined: Sun Jun 25, 2006 3:01 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jun 10, 2019 3:12 am

What's the status on this Mikrotik?
 
K0IBM
just joined
Posts: 7
Joined: Mon Apr 11, 2016 8:11 pm
Location: Denver, Colorado, USA
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jun 10, 2019 4:42 am

Any progress on this Mikrotik? It has been 6 months with no fix. Could we have an update and a plan to a fix?
 
hapi
Member Candidate
Member Candidate
Posts: 232
Joined: Fri Mar 11, 2011 11:21 am
Location: Czech Republic

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jun 10, 2019 9:49 am

do not use DAC.
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jun 11, 2019 11:58 am

do not use DAC.
this issue also happens with mikrotik SFP+ and fibers
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jun 11, 2019 2:34 pm

I can confirm that
there is the same problem on :
CSS326-24G-2S+ with SwOS 2.9
Any SFP+ device connected to port EXCEPT connection to CRS317-1G-16S+ with SwOS 2.7 (with any SFP+ optic module and DAC working as required)


there in not problem at all on:
CRS317-1G-16S+ with SwOS 2.7 (we are unable to upgrade to 2.8 or 2.9 because switch stops to work after 10-15 mins, but you can find this on forum as well)
many switches with many different modules and vendors SFP+s, DACs, S+RJ10
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jun 11, 2019 11:55 pm

Today we started to request the replacement of flapping CRS328, where we were able to systematically reproduce it, at our distributor.
 
User avatar
ilkogd
newbie
Posts: 38
Joined: Wed Sep 05, 2018 3:48 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 12, 2019 10:20 am

Hello. I need to buy two 24 port switches and I have to choose between CRS326 and second hand Cisco 2960G, the price is the same. If I take CRS326 it will be used with RouterOS for access switch. From what I read in forum, SwOS is not ready for "in production" setups and this is the reason to choose CRS326 instead of CSS326.

My question is - if I use only 100Mbps and 1000Mbps (random mix of ports, PCs, VoIP phones etc.) connections and not 10G connections, the problem with port flapping will be present or not?
 
User avatar
GuJack20
Trainer
Trainer
Posts: 345
Joined: Sat Jun 12, 2004 9:44 pm
Location: Tirana
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 12, 2019 10:31 am

Hello. I need to buy two 24 port switches and I have to choose between CRS326 and second hand Cisco 2960G, the price is the same. If I take CRS326 it will be used with RouterOS for access switch. From what I read in forum, SwOS is not ready for "in production" setups and this is the reason to choose CRS326 instead of CSS326.

My question is - if I use only 100Mbps and 1000Mbps (random mix of ports, PCs, VoIP phones etc.) connections and not 10G connections, the problem with port flapping will be present or not?
According to all posters here, the problem presents itself only in connection with CRS317 and 10G SFP+. So it will not happen to your setup.
 
User avatar
ilkogd
newbie
Posts: 38
Joined: Wed Sep 05, 2018 3:48 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 12, 2019 11:02 am

According to all posters here, the problem presents itself only in connection with CRS317 and 10G SFP+. So it will not happen to your setup.
I think the same GuJack20. Do you have CRS326 in production? If you have, what is your opinion for the switch? Somebody else do you have CRS326 in production running RouterOS?
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 12, 2019 11:59 am

I think the same GuJack20. Do you have CRS326 in production? If you have, what is your opinion for the switch? Somebody else do you have CRS326 in production running RouterOS?
Hi,
please open or write in a thread/section where your question is addressed. This thread is about a severe port flapping issue on CRS328 and CRS317 as the title reflects.
Thanks,
nh

EDIT: corrected a typo of product names.
 
User avatar
ilkogd
newbie
Posts: 38
Joined: Wed Sep 05, 2018 3:48 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 12, 2019 12:56 pm

Hi,
please open or write in a thread/section where your question is addressed. This thread is about a severe port flapping issue on CRS328 and CRS317 as the title reflects.
Thanks,
nh

EDIT: corrected a typo of product names.
I'm sorry if this is mistake. I posted here because CRS328 is the same as CRS326 but with PoE. If moderators want they can delete my posts.
 
Dekado
just joined
Posts: 2
Joined: Mon Jul 04, 2016 7:24 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jun 17, 2019 1:44 am

CRS328 to HP DL380 10gbit direct connection, port flapping exists.
so this it not mikrotik-to-core or mikrotik-to-mikrotik connection issue, something wrong in hardware design, I guess.
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jun 26, 2019 2:50 pm

Same problem appeared suddenly after months of uptime. Two links between CRS326 and CRS317 (two of both devices) - one works perfectly and other link is flooding logs and causing packet loss. All troubleshooting attempts lead to conclusion, that CRS317 is the source of the problem - when we cross-connected the uplinks (leading to CRS326s), then port flapping stayed on same CRS317. Changing patches and GBIC's did nothing at all. Changing the uplink to other unused port on CRS317 did not help either. Links to other devices were fine on that same switch.

Upgrades or downgrades from 6.43.16 (same version on all devices) had no effect either.

One other detail could not be unnoticed - link downs had made their way up to tomorrow already :)

Screenshot (602).png
You do not have the required permissions to view the files attached to this post.
Last edited by nmt1900 on Tue Jul 02, 2019 12:40 pm, edited 2 times in total.
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jun 28, 2019 6:42 pm

Now we did one test with the problematic link - we converted it to 10GbE with CAT7 and pair of RJ-10 modules. For more than hour of heavy load there was absolutely no link downs or any packet loss - so this is not likely related to topology issues etc. When we connected ports with fiber as before, all problems were back.

P. S. RJ-10 modules behaved differently on different hardware - everything was OK on CRS317, but module on CRS326 got quickly very hot (almost 90°C)...
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 02, 2019 10:50 am

Good Morning,

has anyone check this behaivour with the new version 6.45.1?

Regards
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 02, 2019 12:38 pm

It is bad, when things get broken, but it is not better, when they suddenly get "cured" by itself.

My problem just suddenly disappeared by itself. Link has been up from friday afternoon and all packet loss has also disappeared. Nobody has done anything to this link or the devices, nobody has even been in the server room, but port flapping just ended and now everything is fine for fourth day in the row. I have not been able to find any outside factors that could have caused this change...

It is possible to understand, why this kind of bugs can be hard to chase down - these kind of problems can take a very long time to reproduce...
 
rmaDK
just joined
Posts: 5
Joined: Wed Jan 30, 2019 3:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 04, 2019 9:51 am

On the latest version 6.45.1, the problem is still exist.
The bundle ( CRS328-24P-4S+ and CRS317-1G-16S+ ) constantly (~ 5-7 minutes) flapping occurs

Mikrotik, you can finally pay attention to the problem !!!
Several tickets were created in the support, and not one received an answer on this issue.

Many people suffer from this problem for many months.
And there is still no official response.

If necessary, I can provide access to the equipment.
But start doing something already!
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 04, 2019 4:48 pm

I have the same combination: CRS328-24P-4S+ and CRS317-1G-16S+. Yesterday I installed 6.45.1. Since that time the number of port flaps increased dramatically (from once every few days to 70 during the last 24 hours!)
The CRS328 reports:
Rx Error Events 2335

The CRS317 reports:
Rx FCS Error 2389
Rx Error Events 2650

What is happening here? Was something changed in 6.45.1 that affects this?
 
michaels
just joined
Posts: 12
Joined: Fri May 17, 2019 8:02 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jul 05, 2019 1:01 pm

First, I love MikroTik products and RouterOS.

It was a big mistake to buy the combination (1x CRS317-1G-16S+ and 2x CRS328-4C-20S-4S+).
The expectation was that it should work fine, because it goes from the same manufacturer to the same manufacturer :)


10G to 10G Fiber SFP+ Tests with RouterOS 6.45.1

from CRS317-1G-16S+ to CRS328-4C-20S-4S+ flapping all day, about every 5min flapping
from CRS317-1G-16S+ to CCR1072-1G-8S+, works fine - no flapping
from CRS317-1G-16S+ to C4500X-32, works fine - no flapping

from CRS328-4C-20S-4S+ to CRS328-4C-20S-4S+, works fine - no flapping
from CRS328-4C-20S-4S+ to CCR1072-1G-8S+, works fine - no flapping
from CRS328-4C-20S-4S+ to C4500X-32, works fine -no flapping

Has anyone already found a solution that works with RouterOS.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jul 05, 2019 9:09 pm

It is funny to see that in your case it is the combination CRS317-1G-16S+ to CRS328-4C-20S-4S+ that is flapping too. I have some links from the CRS317 to server that work great. The same applies to other links on the CRS328. One would guess that Mikrotik would be able to track the problem easily as it occurs between these specific Mikrotik products?
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 08, 2019 10:28 pm

It's might not be always like that. My problem lasted for weeks, then it suddenly disappeared and now emerged again after 10 days. Now it has been flapping again for a second day in the row. This kind of problems can take a lot of time if there's no ways to "accelerate" the process...
 
becs
MikroTik Support
MikroTik Support
Posts: 499
Joined: Thu Jul 07, 2011 8:26 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 09, 2019 2:11 pm

Our investigation has revealed that there might be a SFP+ compatibility issue with specific CRS317-1G-16S+ units when connected to other CRS3xx devices resulting in random link downs. Please, contact MikroTik support if you experience similar issue, we will verify it and arrange a repair if necessary.
 
drbunsen
newbie
Posts: 40
Joined: Fri Apr 29, 2016 7:24 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 09, 2019 3:40 pm

Could you be more precise? Is there a way to identify the cause and what would be done during repair?
Think about the folks which are running these switches now without flapping ports, but might run into problems as soon as CRS3xx are installed.
We would like to know about the issue before the installation if possible.
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 09, 2019 4:01 pm

Hello,

i can't belive that anyone else have a working connection between the CRS317-1G-16S+ and the CRS3xx devices.
We have three CRS317-1G-16S+ and over 10 CRS328-24P-4S+RM and no combination works without flapping.
All of them are updated to 6.45.1. ( firmware also! ) and we used original Mikrotik DAC Cables.

For Mikrotik it would be so easy to test and confirm this behaviour. Especially because it runs better with Switch OS!
I hoped for so long that Mikrotik fix this, i won't send this devices back, but slowly i have no more option.

Many people contact already the support and became no help since months...

so your (becs) answer is no help at all
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 09, 2019 4:10 pm

Our investigation has revealed that there might be a SFP+ compatibility issue with specific CRS317-1G-16S+ units when connected to other CRS3xx devices resulting in random link downs. Please, contact MikroTik support if you experience similar issue, we will verify it and arrange a repair if necessary.
Is there something hardware specific related to that - in a way that some devices might not be affected at all? I have one 317 with problem while other has been without problems...
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 09, 2019 7:15 pm

Hahaha
Not well done MikroTik - hardware related problem?
And why when you switch to SwOS there is no such problem, only CRS3017 with RouterOS?
Same hardware - different behavior = simply software bug!
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 10, 2019 11:28 pm

Our investigation has revealed that there might be a SFP+ compatibility issue with specific CRS317-1G-16S+ units when connected to other CRS3xx devices resulting in random link downs. Please, contact MikroTik support if you experience similar issue, we will verify it and arrange a repair if necessary.
The worst problems with port flapping (more that 70 per day) after the upgrade to 6.45.1 have been resolved after another reboot of the CRS317, but I still see port flaps (1 per day??). I guess that the issues I noticed where my UNMS monitoring the network often reports nodes not responding and returning after 1 -3 minutes and frequent drops of the internet radio streams are related too (no proof of that though).
I reported my case to support (Ticket#2019071022007154). Let's see what comes out of this
 
michaels
just joined
Posts: 12
Joined: Fri May 17, 2019 8:02 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 11, 2019 10:00 am

CRS317 and CRS328 would be a great hardware combination and ideal for FTTX deployments.
I hope that the error can be corrected with a software update.

Both devices work great (in my case), if they are not connected to each other.
 
rmaDK
just joined
Posts: 5
Joined: Wed Jan 30, 2019 3:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 16, 2019 9:16 am

Yesterday connected the new one CRS317-1G-16S+
On it, not one flap happened.
On old one also connected to same CRS328-24P-4S+ for this time 88 times.

And also noticed a strange thing.
Interface status, last link up / down shows a strange time.
The system time is correct, and in the status is wrong/strange time.
You do not have the required permissions to view the files attached to this post.
 
michaels
just joined
Posts: 12
Joined: Fri May 17, 2019 8:02 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 16, 2019 1:02 pm

Yesterday connected the new one CRS317-1G-16S+
On it, not one flap happened.
So it could really be a hardware problem :(
And also noticed a strange thing.
Interface status, last link up / down shows a strange time.
time is not right for me either. strange bug...
 
angriukas
Member Candidate
Member Candidate
Posts: 103
Joined: Fri Nov 22, 2013 9:20 am
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 16, 2019 2:23 pm

I think
CRS326-24G-2S+RM
and
CRS125-24G-1S
contains same problem.
SFP+ port in 1G mode - no problems.
SFP+ port in 10G mode - problematic case even with Mikrotik DAC's.

Update:
problems raised when connecting two identical CRS326-24G-2S+RM devices with 10G DAC cable on SFP+ port.
Not all of devices was affected in my case. Totally installed 4 devices, two of them are problematic (from more early batch).
Last edited by angriukas on Tue Jul 16, 2019 8:13 pm, edited 1 time in total.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 16, 2019 5:23 pm

Our investigation has revealed that there might be a SFP+ compatibility issue with specific CRS317-1G-16S+ units when connected to other CRS3xx devices resulting in random link downs. Please, contact MikroTik support if you experience similar issue, we will verify it and arrange a repair if necessary.
@BECS: is there a way to identify if a CRS is affected? Does the serial numer tell if the device is affected?
 
pacman88
newbie
Posts: 31
Joined: Mon Aug 22, 2016 7:08 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 29, 2019 2:34 pm

Is there any update on this?

can we buy mt hardware again or does this issue still persist?

BR
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 29, 2019 2:42 pm

as MK support said: "if possible, please, consider using CRS309-1G-8S+ as replacement in similar applications to decrease probability of encountering this issue."

:shock: :shock: :shock: :shock: :shock: :shock: :shock:
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 29, 2019 4:42 pm

as MK support said: "if possible, please, consider using CRS309-1G-8S+ as replacement in similar applications to decrease probability of encountering this issue."

:shock: :shock: :shock: :shock: :shock: :shock: :shock:
If this is the case - it is simply not good enough. I have 30 of these devices in an installation, and -all- of them are experiencing this issue. It has almost been a year since i reported this to mikrotik support, and all i have got - despite several attempts at getting updated answers - is "we have recreated the issue".
 
Elliot
Frequent Visitor
Frequent Visitor
Posts: 61
Joined: Tue May 30, 2017 3:04 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 29, 2019 9:07 pm

To all posters here,
i'm afraid that this is a combination of HW and SW problem when there's a SFP+ connection between CRS 317 and CRS 328 and simply put, don't expect that anything's gonna change anytime soon.

We've replaced CRS 328 with much more expensive Cisco devices and it works like a charm.

So my advice would be:
If you can replace one of the devices, DO IT!
If your network won't fully utilize 10G just go 1G and figure replacement later.
If you can't or don't want to replace a lot devices for an non-Mikrotik equivalent sell CRS 317 and buy CRS 309 instead.
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 29, 2019 11:56 pm

I have to say that it seems that there are either

a) just a few CRS317 affected
or/and
b) most buyers not aware of this issue
or/and
c) the amount of CRS317 <- 10G SFP+ -> CRS328 combinations are low

It seems that MikroTik accepts the risk to repair/replace a few CRS317 and continues selling a device which does not provide 10G connections to CRS328. I would go with a) or b) when comparing the stock levels over time of online shops to the amount of posts and active people in this thread.

Telling customers not to buy a product in order to reduce the probability of failure is another way to tell them to look for alternatives as Elliot did.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 30, 2019 12:30 am

To all posters here,
i'm afraid that this is a combination of HW and SW problem when there's a SFP+ connection between CRS 317 and CRS 328 and simply put, don't expect that anything's gonna change anytime soon.

We've replaced CRS 328 with much more expensive Cisco devices and it works like a charm.

So my advice would be:
If you can replace one of the devices, DO IT!
If your network won't fully utilize 10G just go 1G and figure replacement later.
If you can't or don't want to replace a lot devices for an non-Mikrotik equivalent sell CRS 317 and buy CRS 309 instead.
I can live with GE a while longer, and i'm sure there will be a replacement program at some point. I just wish MT would communicate a little more. What switches did you go for? Changing the poe switches would be a nightmare for us, but changing the crs328 would be less painful. You say you chose cisco, did you consider other options? If so, what were they?
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jul 30, 2019 9:13 am

Let's add some advice:
  • use CRS317 with SwOS (no other ver than 3.7) instead of RouterOS
 
cmavced
just joined
Posts: 1
Joined: Wed Jul 31, 2019 9:27 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 31, 2019 9:50 am

I think we have a similar problem.
I'm testing the two just arrived Microtik CRS 317-1G-16+ switches.

I have my computer connected on ETH 10/100/1000 management/data port and a 100mbs ethernet link connected throught a S-RJ01 SFP (listed in MicroTik compatibility list https://wiki.mikrotik.com/wiki/MikroTik ... lity_table ).
The connection is not stable and the ports seems to flap.

The problem occours with SwitchOS but not with RouterOS.
I've also tried the connection using two S-RJ01 SFP, one for my computer and one for the 100mbs link, but the problem is the same.
No problem if I use a 1000mbs ethernet link, either using S-RJ01 SFP or directly attached to ETH 10/100/1000 management/data port.

I have also done a third test:
I've connected the 100mbs ethernet link to the eth 10/100/1000 management/data port of the first switch, than I connected the two CRS317 with a Cisco 10Gbs DAC SFP+, and I connected my computer to the eth 10/100/1000 management/data port of the second switch (avoiding the use of S-RJ01 SFP). The problem is the same.
Also in this case, no problem if I use a 1000mbs ethernet link.

It seems a problem with MicroTik Switch OS software.

I'm using 2.9 SwitchOS version and 6.45.2 RouterOS.
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 31, 2019 12:42 pm

Just use (mention above) SwOS 2.7 - 2.9 has a lot of bugs (see topic viewtopic.php?f=21&t=144031)
p.s. never use management port for traffic on switch
 
Elliot
Frequent Visitor
Frequent Visitor
Posts: 61
Joined: Tue May 30, 2017 3:04 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 31, 2019 8:53 pm

To all posters here,
i'm afraid that this is a combination of HW and SW problem when there's a SFP+ connection between CRS 317 and CRS 328 and simply put, don't expect that anything's gonna change anytime soon.

We've replaced CRS 328 with much more expensive Cisco devices and it works like a charm.

So my advice would be:
If you can replace one of the devices, DO IT!
If your network won't fully utilize 10G just go 1G and figure replacement later.
If you can't or don't want to replace a lot devices for an non-Mikrotik equivalent sell CRS 317 and buy CRS 309 instead.
I can live with GE a while longer, and i'm sure there will be a replacement program at some point. I just wish MT would communicate a little more. What switches did you go for? Changing the poe switches would be a nightmare for us, but changing the crs328 would be less painful. You say you chose cisco, did you consider other options? If so, what were they?
We have our Mikrotik CRS 317 connected to couple of Cisco SF350-48P (48 port POE switch) via 10G SFP+. And another couple of NETGEAR GS752TXP connected via SPF+ too. In both cases no port flapping.
I might add that we haven't thrown out CRS328 but we run only 1G on uplink due to port flapping when running port in 10G. It's pretty sad because otherwise it would be great value solution when you have one or two core CRS 317 switches connected to multiple site with CRS328.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Aug 01, 2019 12:44 am

I have to say that it seems that there are either

a) just a few CRS317 affected
or/and
b) most buyers not aware of this issue
or/and
c) the amount of CRS317 <- 10G SFP+ -> CRS328 combinations are low

It seems that MikroTik accepts the risk to repair/replace a few CRS317 and continues selling a device which does not provide 10G connections to CRS328. I would go with a) or b) when comparing the stock levels over time of online shops to the amount of posts and active people in this thread.

Telling customers not to buy a product in order to reduce the probability of failure is another way to tell them to look for alternatives as Elliot did.
Well I reported my issues to support and now will have to return the CRS317 for RMA. I can only hope that that will solve my issues. It remains a mystery that this apparently happens only between the CRS317 and CRS328. It still sounds as if the issue is partly caused by the CRS328 as well, otherwise it should occur between the CRS317 and other switches and/or 10G network cards....
 
User avatar
slarner
newbie
Posts: 31
Joined: Wed Jul 18, 2007 10:54 am
Location: UK
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 06, 2019 11:30 am

We are having massive issues with this. We have replaced the switch reset the config and its still shocking. Its 100% the CRS328's not the CRS317's

We have also changed the optics i dont know how many times tried DAC's its still awful.

see the picture this is less than 24hours up-time!
You do not have the required permissions to view the files attached to this post.
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 06, 2019 5:19 pm

Its 100% the CRS328's not the CRS317's
My experience tells otherwise - links between 317 and 326 are flapping, but when link from one 317 is connected to other 326, then flapping travels along with "sick" 317.

I don't know about 328-24P-4S+, but 326 seems to have similar hardware (counting out PoE and amount of sfp+ ports) hence problems might be of similar nature.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Aug 09, 2019 12:33 am

Its 100% the CRS328's not the CRS317's
My experience tells otherwise - links between 317 and 326 are flapping, but when link from one 317 is connected to other 326, then flapping travels along with "sick" 317.

I don't know about 328-24P-4S+, but 326 seems to have similar hardware (counting out PoE and amount of sfp+ ports) hence problems might be of similar nature.
I raised a case with support and they told me to RMA the CRS317. We will see what will happen when I get the CRS317 (or a replacement) back....
 
User avatar
machack
Frequent Visitor
Frequent Visitor
Posts: 65
Joined: Fri Jun 01, 2007 9:35 pm
Location: San Luis Argentina
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Aug 09, 2019 2:16 am

Some can see the post, no port flapping, but other problems,

viewtopic.php?f=2&t=150971

Thanks!
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Aug 14, 2019 3:19 pm

Its 100% the CRS328's not the CRS317's
My experience tells otherwise - links between 317 and 326 are flapping, but when link from one 317 is connected to other 326, then flapping travels along with "sick" 317.

I don't know about 328-24P-4S+, but 326 seems to have similar hardware (counting out PoE and amount of sfp+ ports) hence problems might be of similar nature.
I raised a case with support and they told me to RMA the CRS317. We will see what will happen when I get the CRS317 (or a replacement) back....
I RMAd the device and the problem got acknowledged. The switch now has to be sent to Mikrotik for repair, which will take 6-8 weeks. That is a loooong time.
I was told that replacing it will not solve the issue as even new models have the problem.

Does this mean that Mikrotik knowingly continues to sell a faulty product?
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Aug 14, 2019 3:26 pm

Does this mean that Mikrotik knowingly continues to sell a faulty product?
According to the findings within this thread and the information I received from our distributor: Yes.
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Aug 14, 2019 4:00 pm

Does this mean that Mikrotik knowingly continues to sell a faulty product?
According to the findings within this thread and the information I received from our distributor: Yes.
So almost one year after, we're at the same place....

We've bought high-end devices from Mikrotik, hoping for full 10G support : Mikrotik Support ignores the sheer volume of testing done in this thread, reaching the conclusion that crs317 are the core issue :-(

They should at least acknowledge the issue, recall crs317 from customers wishing to upgrade to CRS326-24S+2Q+RM for instance, and offer competitive pricing to compensate for the inconvenience of months without basic core fonctionality (10G support)
 
wanthalf
just joined
Posts: 1
Joined: Thu Aug 15, 2019 12:32 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Aug 15, 2019 12:41 pm

So, we just bought a faulty device too, I see! We got a second piece of CRS317-1G-16S+ and the interconnection between the two of them has exactly the problems discussed here - port flapping and packet loss. It seems to be much better when connecting the two devices on higher ports rather than on the lower ports, but still there is some small packet loss at 10Gb. Fortunately, we do not really need to have the two devices interconnected at a high speed at the moment (just for management), but this is a disappointment and if there was an alternative at the same price level, I would immediately return the device and buy something else. I do not like to work with unreliable hardware at all. Good to know we should be more careful when buying MikroTik next time. :-(

Fortunately, everything seems to work well on connections to the servers and even on the connection to the CCR1036-8G-2S+, which is the important factor at the moment.
 
shanecaznet
just joined
Posts: 15
Joined: Thu Jul 13, 2017 10:52 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Aug 18, 2019 3:47 pm

Exact same problem here, but it is between any CRS317-1G-16S+. Have confirmed its present on ALL links between CRS317's, but not any link to any other device or switch.

Initially I thought it was a cable fault, but we've changed cables, SFPs, etc. Same result. Once I found this thread we've come to realise its yet another example of a product flaw with no real information from the vendor and no solution in sight.

Unfortunately for us, this was the final straw. We've just placed a order for a whole batch of Cisco kit and all of our Mikrotik gear will be coming out once it arrives. Now officially a dissapointed ex-Mikrotik user but looking forward to dealing with reliable products and actual engagement from the vendor when things aren't right with their product.
 
emunt6
Frequent Visitor
Frequent Visitor
Posts: 87
Joined: Fri Feb 02, 2018 7:00 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 8:41 pm

Hi!

I just found this topic.

Did you use the Mikrotik switch through an UPS(uninterruptible power supply - pure sinus-wave type) hardware ?
If not, then this maybe a main problem - the power supply might have receiving some OVP/UVP/NOISE effects - causing the port flapping.
Last edited by emunt6 on Tue Aug 20, 2019 8:45 pm, edited 1 time in total.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 8:44 pm

Hi!

I just found this topic.

Did you use the Mikrotik switch through an UPS(uninterruptible power supply - sinus wave type) hardware ?
If not, then this maybe a main problem - the power supply might have receiving some OVP/OCP/SCP effects - causing the port flapping.
In my case - yes, they were on a UPS.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 8:47 pm

Hi people! Looks like MT is finally stepping up. I got this email from them today.

We got the Supout.rif from CRS317 that you just sent, looks like we didn't receive couple of emails that you sent previously (sic). But yeah, from Supout.rif we can see that CRS317 - 846C083E29E4 is indeed faulty and needs an hardware repair.

We have become aware of a small number of CRS317-1G-16S+RM devices that may exhibit sporadic port flapping issues in certain usage scenarios. Since we are unable to pinpoint exact devices which could potentially exhibit this issue, we do not recommend replacing the device with an identical model, instead, we recommend using CRS309-1G-8S+IN ( 8x SFP+ ports) and CRS312-4C+8XG-RM ( 4x SFP+/10G Ethernet combo ports and 8x 10G Ethernet ports) as temporary replacements, until you receive repaired units through our RMA procedure. Please contact the seller to submit the device for warranty repair.

You can submit Supout.rif's from any other affected CRS317's that you have and we will take a look at them and check if they need to be sent to RMA as well.


Any of you guys gotten the same?
 
emunt6
Frequent Visitor
Frequent Visitor
Posts: 87
Joined: Fri Feb 02, 2018 7:00 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 8:55 pm

Hi!

I just found this topic.

Did you use the Mikrotik switch through an UPS(uninterruptible power supply - sinus wave type) hardware ?
If not, then this maybe a main problem - the power supply might have receiving some OVP/OCP/SCP effects - causing the port flapping.
In my case - yes, they were on a UPS.
Hi!

I read in other topics/people, the power supply comes with the mikrotik switch - has not the best "quality".
I dont have any other idea what causing the port flapping.
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 9:32 pm

If the problem is on power supply there will be port flapping always, no matter what OS is running.
I have always port flapping when winning RouterOS (every single version on it) and never when running SwOS 2.7. We have a lot of 317 some connected to 326, 328 - different versions, all with SFP+ 10G running without single flap - all 317 running SwOS 2.7, other switches RouterOS or SwOS 2.9.
This is SOFTWARE problem, but I'm sure that MikroTik don't know how to resolve it - just see how many they need to produce new version on SwOS, because 2.9 is hell of the bugs.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 10:12 pm

Hi!

I just found this topic.

Did you use the Mikrotik switch through an UPS(uninterruptible power supply - sinus wave type) hardware ?
If not, then this maybe a main problem - the power supply might have receiving some OVP/OCP/SCP effects - causing the port flapping.
In my case - yes, they were on a UPS.
Hi!

I read in other topics/people, the power supply comes with the mikrotik switch - has not the best "quality".
I dont have any other idea what causing the port flapping.
Can you elaberate on what quality parameters are not up to scratch? Also, the CRS317 has internal PSUs. Furthermore - as per my last post, they have admitted hardware faults in some CRS317.
 
emunt6
Frequent Visitor
Frequent Visitor
Posts: 87
Joined: Fri Feb 02, 2018 7:00 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 10:28 pm

If the problem is on power supply there will be port flapping always, no matter what OS is running.
I have always port flapping when winning RouterOS (every single version on it) and never when running SwOS 2.7. We have a lot of 317 some connected to 326, 328 - different versions, all with SFP+ 10G running without single flap - all 317 running SwOS 2.7, other switches RouterOS or SwOS 2.9.
This is SOFTWARE problem, but I'm sure that MikroTik don't know how to resolve it - just see how many they need to produce new version on SwOS, because 2.9 is hell of the bugs.
I heard a story, RouterBoard copper RJ45 ports had the same strange port flapping issue - they could not solve/trace the problem: software upgrade/config changes.
They tried as a last resort: After replacing the PSU the port flapping is gone.

I am not sure about that.
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 10:43 pm

It's very normal to have issues on copper port, because of potential difference generated by two sides of the cable. On twisted pair technology this must be no problem at all, but very often it is indeed.
On the other hand optic ports have no such problem at all and power related problems are just fiction.
 
emunt6
Frequent Visitor
Frequent Visitor
Posts: 87
Joined: Fri Feb 02, 2018 7:00 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Aug 20, 2019 10:53 pm

Hi!

I just found this topic.

Did you use the Mikrotik switch through an UPS(uninterruptible power supply - sinus wave type) hardware ?
If not, then this maybe a main problem - the power supply might have receiving some OVP/OCP/SCP effects - causing the port flapping.
In my case - yes, they were on a UPS.
Hi!

I read in other topics/people, the power supply comes with the mikrotik switch - has not the best "quality".
I dont have any other idea what causing the port flapping.
Can you elaberate on what quality parameters are not up to scratch? Also, the CRS317 has internal PSUs. Furthermore - as per my last post, they have admitted hardware faults in some CRS317.
I'm not an expert about that.

But you can compare:
https://viva-telecom.org/13121/mikrotik ... rm/review/
https://viva-telecom.org/13024/mikrotik ... rm/review/
https://www.youtube.com/watch?v=KNDZZ5bD-wM

CSR317 have some "custom build" PSU: 2x "OF-WT2402500" in one cage.
 
Adundee89
just joined
Posts: 5
Joined: Wed Jul 24, 2019 3:50 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Aug 26, 2019 9:57 pm

Since it sounds like its not an isolated issue (lol), I wont bother posting all my topology. However, We just deployed close to 10 317s, and are experiencing flapping on ONE of them. If that's useful to anyone. All 317 to 317 connections.
 
K0IBM
just joined
Posts: 7
Joined: Mon Apr 11, 2016 8:11 pm
Location: Denver, Colorado, USA
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Aug 26, 2019 10:34 pm

Hi I have a CRS317-1G-16S+ and have had or trouble ticket open with Mikrotik support for months. I am wondering if anyone has had success getting their unit repaired or replaced and if so was the problem resolved with the new/repaired unit. In my case it works with 1Gb links. 10 GB links flap attached to any CRS switch. I have on 10GB link that is stable to a security video server.
 
ochlocracy
just joined
Posts: 2
Joined: Sat May 26, 2018 5:22 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Aug 26, 2019 10:43 pm

I am wondering if anyone has had success getting their unit repaired or replaced and if so was the problem resolved with the new/repaired unit.
I have one RMA'd with my supplier. On week 2 of the 4-6 week turn around...
 
K0IBM
just joined
Posts: 7
Joined: Mon Apr 11, 2016 8:11 pm
Location: Denver, Colorado, USA
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Aug 28, 2019 6:38 pm

Has anyone tried the new CRS326-24S+2Q+RM Cloud Router Switch? I am wondering if it has the same port issues when connection at 10GB to other CRS3xx switches as the CRS317.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Aug 29, 2019 12:39 am

I am wondering if anyone has had success getting their unit repaired or replaced and if so was the problem resolved with the new/repaired unit.
I have one RMA'd with my supplier. On week 2 of the 4-6 week turn around...
My RMA (6 - 8 weeks) is only in the third week. I was told that a replacement would not make sense as new switches willhave the same problem.... So I am waiting for the repair while Mikrotik continues to selll defective equipment.
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Aug 29, 2019 8:43 am

Hello,

we have the new CRS326-24S-2Q+RM here and they worked 2 days without problems now.
I have connected this device to an CRS328-24P-4S through Mikrotik DAC Cables and multiple Mikrotik S+R10 r2.

We have also sent three of our CRS317-1G-16S+ back for RMA.

regards
 
User avatar
macgaiver
Forum Guru
Forum Guru
Posts: 1764
Joined: Wed May 18, 2005 5:57 pm
Location: Sol III, Sol system, Sector 001, Alpha Quadrant

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Aug 29, 2019 8:49 am

Has anyone tried the new CRS326-24S+2Q+RM Cloud Router Switch? I am wondering if it has the same port issues when connection at 10GB to other CRS3xx switches as the CRS317.
All the sources indicate that is only that specific combination that this topic is affected, and maybe even then only some part of CRS317 affected.
I have several CRS3xx connected to CRS317 no issues (with exception of some doggy DAC, that got replaced).
 
pacman88
newbie
Posts: 31
Joined: Mon Aug 22, 2016 7:08 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Sep 05, 2019 2:19 pm

we got 4 new crs317 as replacement (they have been tested at our supplier) but they show the same behaviour....

the recommended crs309 and 312 do not work as a replacement for us since we need the port density in that specific usecase. Has anyone given the new MikroTik CRS326-24S+2Q+RM a try?
in an other place I would consider the MikroTik CRS312-4C+8XG-RM but I got cautious with MT in general after those issues. Has anybody seen this issue occur on any other of the mentioned devices or only on 317?

BR
Alex
 
michaels
just joined
Posts: 12
Joined: Fri May 17, 2019 8:02 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Sep 07, 2019 9:55 am

Has anyone given the new MikroTik CRS326-24S+2Q+RM a try?

Yes, got a CRS326-24S+2Q+RM yesterday (great device, many switch chip features).
Works great in conjunction with CRS328-4C-20S-4S+RM.
No more SFP+ 10G Port flapping (we have one CRS317-1G-16S+RM in RMA).
 
aidanpryde
just joined
Posts: 1
Joined: Wed Sep 11, 2019 9:19 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Sep 13, 2019 2:12 pm

Hi.
I also see problems with port flapping when using CRS317-1G-16S+RM <-> S+DA0001 <-> CRS326-24G-2S+RM.
CRS317-1G-16S+RM <-> SNR-SFP+LR-2 <-> CRS326-24G-2S+RM the problem is present.
All ports are switched to 1G now. But, on one port after turning on the RX / TX Flow Control option to auto, we observed RX Errors at first time. Yesterday i reset the error counter and so far no errors on this port with 10G. Keep watching
With CRS317-1G-16S+RM <-> S+DA0001 <-> RB4011iGS+RM everything is ok on 10G: no link downs, no rx errors.
 
nicoh
just joined
Posts: 10
Joined: Tue May 22, 2018 8:51 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Oct 11, 2019 11:53 am

Hi,

we can confirm that CRS328-24P-4S+ in combination with CRS312-4C+8XG show the exact same problematic port flapping behavior (RouterOS & FW v6.45.6) as the CRS317-1G-16S+. The exact testing scenario is:

- 2x CRS312-4C+8XG (both new)
- 2x CRS328-24P-4S+ (1 new, 1 used but "working as expected" from our supplier)
- The CRS328s are connected with SFP+ DACs to the CRS312 SFP+ combi ports
- The test scenario ran 9 days in an air-conditioned environment

The outcome is attached to this post. Some observations:
- Both CRS328 show just a few link downs (<20 Link Downs), there is no behavioral difference between the new and the used CRS328
- The CRS312s show different results 50 vs. 1129 Link Downs to the same CRS328
- The screenshot was taken on the Oct. 10th, the Last Link Down Time information do contain wrong information.

We also had two new CRS326 connected (via SFP+) to the CRS328 and CRS312 in question which did not show any port flappings during the testing period. This test is a consequence of the recommendations done by MikroTik to use the CRS312 and CRS326 as replacement for the flapping CRS317. In our tests we see that at least the CRS312 have the exact same issue as the CRS317s. There is still no evidence that the CRS328 is not part of the problem.

Conclusion:

- CRS312-4C+8XG combined with CRS328-24P-4S+ do have flapping SFP+ connections
- We did not receive any feedback from Mikrotik regarding this issue. Therefore, we will stop our tests of Mikrotiks problematic network devices.

br,
nicoh
You do not have the required permissions to view the files attached to this post.
 
User avatar
cbrown
Trainer
Trainer
Posts: 1839
Joined: Thu Oct 14, 2010 8:57 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Oct 14, 2019 6:22 pm

I can confirm this as well.
Hi,

we can confirm that CRS328-24P-4S+ in combination with CRS312-4C+8XG show the exact same problematic port flapping behavior (RouterOS & FW v6.45.6) as the CRS317-1G-16S+. The exact testing scenario is:

- 2x CRS312-4C+8XG (both new)
- 2x CRS328-24P-4S+ (1 new, 1 used but "working as expected" from our supplier)
- The CRS328s are connected with SFP+ DACs to the CRS312 SFP+ combi ports
- The test scenario ran 9 days in an air-conditioned environment

The outcome is attached to this post. Some observations:
- Both CRS328 show just a few link downs (<20 Link Downs), there is no behavioral difference between the new and the used CRS328
- The CRS312s show different results 50 vs. 1129 Link Downs to the same CRS328
- The screenshot was taken on the Oct. 10th, the Last Link Down Time information do contain wrong information.

We also had two new CRS326 connected (via SFP+) to the CRS328 and CRS312 in question which did not show any port flappings during the testing period. This test is a consequence of the recommendations done by MikroTik to use the CRS312 and CRS326 as replacement for the flapping CRS317. In our tests we see that at least the CRS312 have the exact same issue as the CRS317s. There is still no evidence that the CRS328 is not part of the problem.

Conclusion:

- CRS312-4C+8XG combined with CRS328-24P-4S+ do have flapping SFP+ connections
- We did not receive any feedback from Mikrotik regarding this issue. Therefore, we will stop our tests of Mikrotiks problematic network devices.

br,
nicoh
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Oct 15, 2019 5:32 pm

Anyone tested the CRS326-24S+2Q+RM yet?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Oct 21, 2019 11:10 pm

I changed 2 317 with 2 326-24+
The link with all 328 and between 326-24+ are now fine @10Gbps
One link with 326-24G still flap and needed to be set @1Gpbs :-(
Better then before, but seems to be not fully resolved.
Alessandro
 
ochlocracy
just joined
Posts: 2
Joined: Sat May 26, 2018 5:22 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Oct 21, 2019 11:20 pm

Received my CRS-317 back from RMA. The problem was NOT fixed, still produces FCS Errors immediately when configuring the link at 10G with a CRS-328.
 
sotirone
just joined
Posts: 12
Joined: Tue Oct 22, 2019 2:07 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Oct 22, 2019 2:12 am

I am having the same problem with the CSS326-24G-2S+ on the SFP+ ports.

I am connecting a workstation with an Intel X520 10Gb card and Fiberstore Cisco SFP-10G-SR SFP+ modules.

My Linux dmesg is full of this:

ixgbe 0000:42:00.1 enp66s0f1: NIC Link is Down
ixgbe 0000:42:00.1 enp66s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Oct 23, 2019 12:17 pm

Hello,

we have received our CRS317-1G-16S+ back from rma on Oct, 10th since then no port flapping.
We have also running the new CRS326-24S+2Q+ since Aug, 23 and there are no port flapping.

regards
 
nmt1900
Frequent Visitor
Frequent Visitor
Posts: 74
Joined: Wed Feb 01, 2017 12:36 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Oct 25, 2019 3:31 pm

After issuing RMA and receiving new unit it seems like this issue has been resolved - there has been no link downs or any sort of data errors for over a month of uptime...
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Oct 28, 2019 8:20 pm

I am still waiting for the RMA of my CRS317: after 8 weeks I asked the shop and they checked with MT: it is waiting for parts and no idea when they will arrive. I am quite disappointed by this whole story. What a mess!!

The shop sent me a new CRS317 that I installed today. No flaps yet but in only 2 hours I see 15 FCS errrors and 2 RX error events, so I am not hopefull.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Nov 12, 2019 12:33 pm

I am still waiting for the RMA of my CRS317: after 8 weeks I asked the shop and they checked with MT: it is waiting for parts and no idea when they will arrive. I am quite disappointed by this whole story. What a mess!!

The shop sent me a new CRS317 that I installed today. No flaps yet but in only 2 hours I see 15 FCS errrors and 2 RX error events, so I am not hopefull.
The new CRS317 I received to test has port flapping too: 5 - 10 times a day in addition to the FCS and RX errors.

My original CRS317 is apparently still waiting for parts. I am now waiting for the repair for over 3 months and counting.

Does anybody know of a workaround that makes the link stable (the switches are connected by means of a short (50cm) dac.

My conclusion: don't buy a CRS317 when you want to connect to a CRS328
 
OstJoker
just joined
Posts: 2
Joined: Tue Nov 19, 2019 3:07 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Nov 19, 2019 3:12 am

Just installed CRS317-1G-16S+ and connect them with Mikrotik 10G modules to 5x CRS328-24P-4S+ (RouterOS 6.45.7). Port flapping on all links every 3-8 minutes.
I found this theme and now I don't know what to do.
 
andersa
newbie
Topic Author
Posts: 30
Joined: Sat Dec 19, 2015 2:29 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Nov 19, 2019 3:57 pm

Hi all

I recently got a reply from MT after sending them the support files from affected switches. The said that I should start an RMA process with my vendor. I did and got the new qsfp switch instead. Has worked flawlessly so far.
 
User avatar
Deslack
just joined
Posts: 11
Joined: Mon Apr 11, 2016 4:30 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Nov 28, 2019 12:13 pm

I have a network connected via switches as follows:

1 unit CRS317-1G-16S+ as core
5 unit CRS328-24P-4S+, 1 at the same cabinet as core, while the other 4 at each satellite buildings in one campus

The satellite buildings are all connected via singlemode fiber, and I installed 10G LR SFP+ on each.

All running RouterOS v6.45.7, Firmware updated to the latest.

I have been noticing port flapping on all the SFP+ ports connected to the campus switches, intermittently, sometimes every minute, sometimes every several minutes. I would get link downs to the hundreds each day. I tried changing fiber patch cords, but still the same.

A post here suggested I switched the CRS317 to run SwOS. Updated it to 2.10 (from 2.7), been running flawless without any port flapping (checked on each of the satellite switches) for 3hrs already.

All CRS328 switches are still on RouterOS at the moment.
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Nov 28, 2019 10:54 pm

I posted several times above:
This problem persists only on CRS317 running RouterOS (any version).
If you don’t want port flapping at all, use SwOS 2.7 or 2.10 (don’t even try 2.8, 2.9).
We have many 317 in different configurations with heavy traffic, hundreds of vlans, many of them connected with 10G links to CSS326, CRS326, CRS328 (and many more 4011, 1009, other vendor switches and routers), WITH NO ANY PORT FLAPPING!
 
sebg
just joined
Posts: 6
Joined: Fri Nov 16, 2018 5:49 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Nov 29, 2019 12:46 am

I posted several times above:
This problem persists only on CRS317 running RouterOS (any version).
If you don’t want port flapping at all, use SwOS 2.7 or 2.10 (don’t even try 2.8, 2.9).
We have many 317 in different configurations with heavy traffic, hundreds of vlans, many of them connected with 10G links to CSS326, CRS326, CRS328 (and many more 4011, 1009, other vendor switches and routers), WITH NO ANY PORT FLAPPING!
maybe some of us are not interested in SwOS ?

adding unnecessary complexity to existing network setups to circumvent hardware/software bugs is your choice, not mine.

CRS317 are sold as 10G switches, they have to work 10G without kludges
 
User avatar
Deslack
just joined
Posts: 11
Joined: Mon Apr 11, 2016 4:30 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Nov 29, 2019 5:59 am

Follow-up:

Up till now all are running without flapping, except for one, once at 3am. Will continue to monitor this.

Since after changing to SwOS, the flapping mostly stopped, very good indication that this is a software bug. Should be able to fix.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Nov 29, 2019 1:12 pm

I posted several times above:
This problem persists only on CRS317 running RouterOS (any version).
If you don’t want port flapping at all, use SwOS 2.7 or 2.10 (don’t even try 2.8, 2.9).
We have many 317 in different configurations with heavy traffic, hundreds of vlans, many of them connected with 10G links to CSS326, CRS326, CRS328 (and many more 4011, 1009, other vendor switches and routers), WITH NO ANY PORT FLAPPING!
As SwitchOS has very limited management capabilities (web only) and not even HTTPS it is a too limited platform to be taken serious. I do not want any plaintext management traffic in my network. Once they support HTTPS I could consider SwitchOS. I only need very basic functionality anyway but this silly HTTP(S) limitation stops me from even considering SwitchOS.
I still don't understand why SwitchOS could work correctly where RouterOS does not: Mikrotik admits that there is a hardware problem on the CRS317, so why can SwitchOS work correctly when there is a hardware problem? If they could fix it in SW in SwitchOS why do they not fix it in RouterOS?
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Nov 29, 2019 6:44 pm

I just answered on those that ask "did you manage to resolve this problem".
Everybody, of course, has own needs and requirements on same hardware - MikroTik must work hard to fix this.
p.s. forums like this one is the place to be, before buy some equipment.

cheers
 
User avatar
Deslack
just joined
Posts: 11
Joined: Mon Apr 11, 2016 4:30 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Dec 06, 2019 6:34 am

RouterOS 6.46 released. In the changelog:

*) crs3xx - improved switch-chip resource allocation on CRS317-1G-16S+, CRS309-1G-8S+, CRS312-4C+8XG, CRS326-24S+2Q+ devices;

Would this solve the port flapping issue? Has anybody tested it?
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 07, 2019 12:03 am

RouterOS 6.46 released. In the changelog:

*) crs3xx - improved switch-chip resource allocation on CRS317-1G-16S+, CRS309-1G-8S+, CRS312-4C+8XG, CRS326-24S+2Q+ devices;

Would this solve the port flapping issue? Has anybody tested it?
I noticed this comment too. I therefore upgraded my temporary CRS317 half an hour ago. Should know more tomorrow, but I am not optimistic.

I had to return my own CRS317 as it required repair according to Mikrotik. So I would assume that this firmware upgrade does not solve the issue.... The changelog is not very informative so I cannot judge what is fixed. But resource allocation does not seem to be related to RX and FCS errors which seemed to be related to the flaps.

B.t.w. I am seeing 6 RX and 4 FCS errors within 40 minutes after the upgrade....
 
OstJoker
just joined
Posts: 2
Joined: Tue Nov 19, 2019 3:07 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 07, 2019 12:09 am

I have CRS328-24P-4S+ and CRS317-1G-16S+ on the shelf. In the next 1-3 days, I will test RouterOS 6.46 on them in 10G.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 07, 2019 1:34 am

I have CRS328-24P-4S+ and CRS317-1G-16S+ on the shelf. In the next 1-3 days, I will test RouterOS 6.46 on them in 10G.
Don't bother testing: it took 1.5 hours after the upgrade (on both CRS328 and CRS317) for the first flap to occur on my lightly loaded network
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Dec 07, 2019 5:13 pm

I have CRS328-24P-4S+ and CRS317-1G-16S+ on the shelf. In the next 1-3 days, I will test RouterOS 6.46 on them in 10G.
Don't bother testing: it took 1.5 hours after the upgrade (on both CRS328 and CRS317) for the first flap to occur on my lightly loaded network
Less than a full day ater: 29 flaps... routerOS 6.46 does not solve the issues with port flapping
 
roggles
just joined
Posts: 9
Joined: Wed Mar 06, 2019 4:54 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Dec 09, 2019 11:29 am

The only way to fix this problem is to send your devices back to your distributor! This is not a software bug!!!

We have serveral CRS317, CRS328 and the new CRS326 and they worked now without port flappings or other problems.
Now they running with RouterOS 6.46 since last friday.

regards
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Dec 17, 2019 10:37 pm

The only way to fix this problem is to send your devices back to your distributor! This is not a software bug!!!

We have serveral CRS317, CRS328 and the new CRS326 and they worked now without port flappings or other problems.
Now they running with RouterOS 6.46 since last friday.

regards
Last Friday I received my CRS317 back from repair (took "only" 4 months) and now I have not seen any port flaps (0 link downs) nor any receive error counters increase (FCS errors not RX error events) that I used to see. So the repair was successful.
It is ridiculous to see that it took Mikrotik 4 months for a repair but it at least worked out well. I can now listen for a full day to streaming radio without disconnects, Would I recommend Mikrotik to friends? Don't think so....
 
angriukas
Member Candidate
Member Candidate
Posts: 103
Joined: Fri Nov 22, 2013 9:20 am
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jan 07, 2020 11:27 am

Hi,
want to share small story :)
I have two CRS326, both devices powered from APC UPS, both CRS's are out of warranty.
My problem was:
- port flapping on both devices
- Both CRS's with DAC cable on SFP+ interfaces won't work at all.
- High CPU temperature, 76-78 degrees in celsius.

I bought two 24V PSU from Mikrotik, those PSU's are for CCR, not for CRS!
After few hours of DIY I have installed PSU and 24V fan to both devices.

Results:
- Link via SFP+ with DAC cable between both Mikrotiks, no issues at all!
- Regarding flapping: I see link down/up only at the morning and at the evening, only when computer is turnted to on/off. Before modification - up/down happens lot of times during a day.
- CPU temperature dropped to 43-45 degrees in celsius due to installed fan.

Notes:
- CCR PSU is too long to fit to CRS, 7mm of pcb have to be cut. There is enough space to do that.
- PSU C14 inlet socket is also to big to fit to hole in CRS.
- Soldering is needed: PSU cable is too short, routerboard PCB contains no internal connector for power.

Strictly do not reccomend to do that, you can damage CRS.
You do not have the required permissions to view the files attached to this post.
 
r00t
Long time Member
Long time Member
Posts: 672
Joined: Tue Nov 28, 2017 2:14 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jan 07, 2020 2:40 pm

This is interesting. So the port flapping might be just because of noisy PSU? Should be quite easy to verify, put CRS on external clean linear lab powersupply and see if it fixes the problem, or maybe try adding a few ferrites on the wires from original PSU if that would make a difference.... that is as long as yours is out of warranty. I RMA'd my CRS and got replacement that's not flapping ports anymore, so can't test it.
 
angriukas
Member Candidate
Member Candidate
Posts: 103
Joined: Fri Nov 22, 2013 9:20 am
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jan 07, 2020 5:27 pm

I have soldered fan wires directly to PSU 24V outlet. Fan could also produce noise.
Unfortunately both CRS are far enough from me, can't do testing with lab PSU.
linkdowns.txt - events for few last days, 10/100M speed - should be PC NIC in low power mode, I think.
During transition between power modes the network adapter might lose connectivity for a short time.
Situation with new PSU is definitely better!
You do not have the required permissions to view the files attached to this post.
 
AVA
just joined
Posts: 22
Joined: Mon Jun 18, 2018 6:19 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jan 24, 2020 4:02 pm

An update from my side:

We bought CRS326-24S+2Q to replace the CRS317 devices. Mikrotik support told us the flapping problem between CRS317 and CRS328-20S-4C-4S+ is caused by the CRS317. That was over 1 year ago. They also told us to buy other devices but no CRS317. That means over one year later they still sell the faulty devices!! Back then I told MT support that I don't think the problem is the CRS317 but the CRS328....

Now I testet the CRS328 <-> CRS326-24S+2Q and of course I have flapping again. 696 link downs in 3 days. Well done Mikrotik!!

We decided to switch to another vendor. That was too much. Not only the problem itself but also the handling.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Jan 28, 2020 12:27 pm

An update from my side:

We bought CRS326-24S+2Q to replace the CRS317 devices. Mikrotik support told us the flapping problem between CRS317 and CRS328-20S-4C-4S+ is caused by the CRS317. That was over 1 year ago. They also told us to buy other devices but no CRS317. That means over one year later they still sell the faulty devices!! Back then I told MT support that I don't think the problem is the CRS317 but the CRS328....

Now I testet the CRS328 <-> CRS326-24S+2Q and of course I have flapping again. 696 link downs in 3 days. Well done Mikrotik!!

We decided to switch to another vendor. That was too much. Not only the problem itself but also the handling.
I had the flapping problem on the Crs317/CRS328 combo too. I had my CRS317 repaired (took them 4 months, unbelievable) but the link between the 2 is now absolutely stable: I just checked and the link is has now been up since Dec 18 (when I rebooted both switches for a SW u[date). So it shows that the CRS317 was at least part of the problem. It might quite well be that the CRS326-24S+2Q has the same problems as the CRS317... But you can not rule out the CRS328 either.

I don't know what was done to my CRS317 but it now definitely works ok.
Handling of problems is indeed not good at Mikrotik. No information, terrible repair time.
 
pacman88
newbie
Posts: 31
Joined: Mon Aug 22, 2016 7:08 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Feb 12, 2020 12:53 pm

Has anybody introduced the new 48port CRS354-48G-4S+2Q+RM switch into the loop?
Are there any flapping issues with that one?
 
irobot
just joined
Posts: 11
Joined: Wed Sep 04, 2019 3:27 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Mar 02, 2020 2:12 pm

Hello

One of my partner gave me the link to that thread when I was looking for a 10G Mikrotik switch.

I'm still interested in CRS317 switch. What I need is just the following things:
* no crash
* RouterOS as I need kind of integration with other things (at least via CLI)
* no port flapping :)
* VLAN mapping/translation on each port. Hardware based
* dual power source
* most links will be fiber connections at 10G, but I predict mixture of 1G/10G fiber connections with none or few copper 1G connections

I have no other Mikrotik devices. But, If everything works well, I may add more CRS317 or CRS326.
If problem really related to combination of CRS317 and CRS326 I might avoid it. But, there were people saying it is same issue even with recommended CRS309.

Could you please give me (other readers) what is the status with this issue?
Thank you in advance for your information!

PS CSR312 doesn't fit as it has only 4SFP+ cages. CSR309 doesn't fit as it has only one power source (maybe, there is a possibility to use POE-IN + power supply to achieve redundant power configuration?)
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Mar 02, 2020 11:29 pm

Hello

One of my partner gave me the link to that thread when I was looking for a 10G Mikrotik switch.

I'm still interested in CRS317 switch. What I need is just the following things:
* no crash
* RouterOS as I need kind of integration with other things (at least via CLI)
* no port flapping :)
* VLAN mapping/translation on each port. Hardware based
* dual power source
* most links will be fiber connections at 10G, but I predict mixture of 1G/10G fiber connections with none or few copper 1G connections

I have no other Mikrotik devices. But, If everything works well, I may add more CRS317 or CRS326.
If problem really related to combination of CRS317 and CRS326 I might avoid it. But, there were people saying it is same issue even with recommended CRS309.

Could you please give me (other readers) what is the status with this issue?
Thank you in advance for your information!

PS CSR312 doesn't fit as it has only 4SFP+ cages. CSR309 doesn't fit as it has only one power source (maybe, there is a possibility to use POE-IN + power supply to achieve redundant power configuration?)
If you only need 10G go for the CRS317: it works well connected to anything but the CRS328 (and possibly the CRS326).

Since the repair my CRS317 - CRS328 link has been rock solid too. That connection was the only one with flapping. It is now up since Dec 18 without any issues whatsoever. I am happy.
I don't know what was done to fix the switch, but new switches may still have the same problem: at least the temporary replacement for my own CRS317 had the same flapping problem. New CRS 317 switches may still have the problem connected to other Mikrotik switches like the CRS328. It would be nice if Mikrotik could comment on this. It is a shame that the repair took 4 months!
 
irobot
just joined
Posts: 11
Joined: Wed Sep 04, 2019 3:27 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Mar 03, 2020 12:17 pm

...
If you only need 10G go for the CRS317: it works well connected to anything but the CRS328 (and possibly the CRS326).

Since the repair my CRS317 - CRS328 link has been rock solid too. That connection was the only one with flapping. It is now up since Dec 18 without any issues whatsoever. I am happy.
...
Sounds good.
Do you have mixture of 1G/10G connections or 10G connections only? Via SFP+ modules or DAC?
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Mar 03, 2020 1:13 pm

...
If you only need 10G go for the CRS317: it works well connected to anything but the CRS328 (and possibly the CRS326).

Since the repair my CRS317 - CRS328 link has been rock solid too. That connection was the only one with flapping. It is now up since Dec 18 without any issues whatsoever. I am happy.
...
Sounds good.
Do you have mixture of 1G/10G connections or 10G connections only? Via SFP+ modules or DAC?
Right now I only have some 10Gb DACs (FS.com) and an S+RJ10 in the switch, but I used to have some 1Gb Fiber modules to an older (now removed) 1Gb switch. Worked perfectly fine. I never tried 10Gb fiber as I had no use for it.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Apr 05, 2020 4:20 pm

CRS326-24S+2Q+RM @10gbps have the same problem of crs317.. port flapping, link down.. you have 24 ports but you have to do a lottery moving your link, hoping to found a working solution.. (yesterday: 10Gbps Dac to hpe server nic, on port 5 NO LINK, on port 7 flapping link, on port 9 OK).. very disappointed!
 
wispvt
Member Candidate
Member Candidate
Posts: 109
Joined: Tue May 10, 2011 4:20 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 3:44 pm

We have the same issues CRS328 to servers with 10Gtek X520 cards. 1G is fine, but 10G is unstable. We have 4 brand new CRS328 that do the same thing. Its very disappointing as we bought them so we could switch 10G traffic. Not sure what to do now as we need reliable 10G switching. Any recommendations?
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 4:47 pm

Upgrade to RouterOS to last version
Update firmware to last version System->Routerboard->Upgrade
Reboot
Switch to SwOS
Upgrade to last version
Use it with no flapping
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 5:04 pm

Switch to SwOS
Use it with no flapping
ok, you can also buy another vendor switch, but I don't think that it was the question...

Hey Mikrotik guys, where are you?
 
andriys
Forum Guru
Forum Guru
Posts: 1526
Joined: Thu Nov 24, 2011 1:59 pm
Location: Kharkiv, Ukraine

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 5:18 pm

Hey Mikrotik guys, where are you?
This is user forum. Support replies in some topics occasionally, but there's not guarantee they reply to your particular message. If you are looking for an official reply you should contact support@ and/or you supplier/distributor directly.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 5:35 pm

This is user forum. Support replies in some topics occasionally, but there's not guarantee they reply to your particular message. If you are looking for an official reply you should contact support@ and/or you supplier/distributor directly.
I think that after one year and an half, many support request, some device repair, some device went in the bin, and a lot of devices with the same problem, mikrotik guys could pubblicaly response and give us an idea if they want to continue seriusly making routerOs switches or not.
 
User avatar
kosyot
newbie
Posts: 36
Joined: Wed Jan 16, 2019 1:28 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 6:38 pm

Switch to SwOS
Use it with no flapping
ok, you can also buy another vendor switch, but I don't think that it was the question...

Hey Mikrotik guys, where are you?
Very funny - for you MikroTik = RouterOS ??!?
Guy ask for solution, I gave to him one - it's not universal, but if he need basic switch capabilities it work.
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Apr 11, 2020 7:12 pm

for you MikroTik = RouterOS ??!?
onestly, yes.
 
wispvt
Member Candidate
Member Candidate
Posts: 109
Joined: Tue May 10, 2011 4:20 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Apr 13, 2020 7:35 pm

Using Switch OS is not a solution. Its possibly a bandaid, I don't want to be pushing 10G of data hoping that works. Need a reliable fix.
 
Varashi
just joined
Posts: 1
Joined: Tue May 19, 2020 10:29 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue May 19, 2020 10:34 am

I'm also having some severe port flapping issues with a bonded 20G (2 DAC SFP Plus cables) between a CRS328 and a CRS317 switch.
Need to use RouterOS on both because I would really like to have OSPF running on both switches. (i am aware of the routing performance of these switches, no need to comment on this).

So, switching to SWOS is not an option for me.

Need a reliable fix for this as well.
 
llag
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sat Aug 04, 2018 12:12 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue May 19, 2020 3:26 pm

I'm also having some severe port flapping issues with a bonded 20G (2 DAC SFP Plus cables) between a CRS328 and a CRS317 switch.
Need to use RouterOS on both because I would really like to have OSPF running on both switches. (i am aware of the routing performance of these switches, no need to comment on this).

So, switching to SWOS is not an option for me.

Need a reliable fix for this as well.
Mail support at Mikrotik with the support files for both switches. They will probably tell you that the CRS317 needs a repair. In that case prepare for a long wait: it took them 4 months in my case if I remember correctly..... My switches now link perfectly fine: the link has been up since Dec 18: more than 5 months
 
maxfava
Member Candidate
Member Candidate
Posts: 224
Joined: Mon Oct 17, 2005 12:30 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon May 25, 2020 10:45 pm

I'm observing the same flapping issue
I hae noted that temperature is quite high and FAN are at 0 RPM. Checking with snmp the fan are switched some time.
but not enough to cool down the CRS317 with 5 SFP+ installed. the SFP module temperature are between 55 and 60 °C and they start to flap when reach 55 .... and they are mikrotik too ....

question I noted from command line I can set fan trhreshould but noted that nothing change.
Mikoritk manual does not explain the commands so I'm quite trying to set some valut but would be good to get some advice.

thank you
 
gregd
just joined
Posts: 1
Joined: Sun Jun 07, 2020 7:35 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sun Jun 07, 2020 7:47 pm

I have the port flapping problem with my recently purchased CRS328-24P-4S+. The switch has 3 10Gig links plugged in to it. Two of them are 1m dac connections and work fine.

The 3rd connection is a lc multimode fiber connection that is 21.5m in length (1.5m patch, 5m patch, and 15m mm fiber between locations). This fiber connection drops every few minutes and immediately reconnects. Also, I can make it drop the connection just by asking SWoS 3.11 to do a backup. The other two connections don't drop periodically, or exhibit this behavior when asking for a backup... they're reliable. It's only the mutimode fiber that has the problems.

For the connection that doesn't work, I've proved that the switch is the problem by using the fiber link to directly connect two computers. I'm even using the same transceivers. When I do that, everything works perfectly (and in fact that was how the customer had originally setup their network... just a single 10gig fiber connection between the two computers).

....very frustrated.....
Last edited by gregd on Mon Jun 08, 2020 11:35 pm, edited 2 times in total.
 
DmitryAVET
Member Candidate
Member Candidate
Posts: 112
Joined: Thu Mar 26, 2015 12:27 am
Location: Ukraine, Mukachevo
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Sep 04, 2020 9:44 am

Same problem on config:
- CRS317
- CRS328
- DAC SFP+

viewtopic.php?f=3&t=165650&p=815054

Mikrotik why you provide BROKEN hardware?
 
coelliale
just joined
Posts: 23
Joined: Fri Jun 09, 2017 7:47 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Sep 04, 2020 10:20 am

You have to change switch port until you find the correct sequence that not flap.. good luck!
Mk switch @10gbps are not reliable at the moment
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Nov 23, 2020 10:27 am

Hello. I read this post and checked my fiber pop.
CCR1009
CRS317 where are connected (all via 10G SFP cables), CRS328.
on ten switch, one has sfpplus1 flapping as described.
I will try changing the DAC then I will RMA the switch.
lastest long-term on it.
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Nov 25, 2020 8:15 am

I have made further investigations.
I have 10 CRS328 connected to a CRS317.
the only CRS328 that have issues are:

5 CRS with 5mt MT DAC, with 5mt MM fibers.
a lot of CRS errors
two of them flaps, the other 4 dont flap.
I tried to fix everyone of them at 1G to see if it flaps again or give me errors.

I see a lot of FCS errors, it seems that the cable is bad... it is possibile 5 5mt MT cables are all faulty?
The other CRS are connected via a mix of 1MT / 3MT DAC from MT with 0 flaps and 0 errors.
 
yxudous
just joined
Posts: 13
Joined: Wed Mar 16, 2016 5:15 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Nov 30, 2020 8:10 pm

Quick Question : If I try to switch to SWOs to reduce port flapping, How will I know if it's solved? Is there a log event for port down as in RouterOS?
 
User avatar
Deslack
just joined
Posts: 11
Joined: Mon Apr 11, 2016 4:30 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Dec 02, 2020 6:25 pm

Quick Question : If I try to switch to SWOs to reduce port flapping, How will I know if it's solved? Is there a log event for port down as in RouterOS?
You can check the logs on the CRS328 side.

I'm also having port flapping problems on my CRS317 and 4 units of CRS328 pairs. Right now I have the CRS328 connected to a CRS354, no flap yet, almost 12hrs.

Seems the problem is at CRS317.
 
MasteRTriX
just joined
Posts: 10
Joined: Tue Nov 12, 2013 3:02 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jan 22, 2021 2:48 am

CRS326-24G-2S+ 85 degrees steady temperature
SFP+ 10G optical 60 degrees steady
Rack temperature 24 degrees steady
Cpu usage 1-3%

Can´t begin to imagine where temperature will go if cpu usage gets higher
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Sat Feb 13, 2021 8:51 pm

I upgraded the switch with the latest long-term and it no longer flaps!

Finger crossed... 12h without a single flap :D
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Feb 15, 2021 11:08 am

Update, just 1 switch in 4, resumed port flap
the other went flawlessy
 
sspeed
just joined
Posts: 6
Joined: Mon Jul 26, 2021 4:56 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Jul 26, 2021 4:58 pm

Subscribing, I have a CRS326-24G-2S+RM that port flaps on the SFP+ port constantly. I've updated to beta 7 and tried blowing a fan across the SFP+ ports to resolve. I've also swapped ports between the DACs.
Last edited by sspeed on Mon Jul 26, 2021 5:18 pm, edited 1 time in total.
 
sspeed
just joined
Posts: 6
Joined: Mon Jul 26, 2021 4:56 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 28, 2021 5:27 pm

I had high hopes for this switch, but looks like I may have to switch to UniFi. I can't have the SFP+ port randomly dropping several times a day.
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 28, 2021 5:28 pm

I solved most of the flaps with latest long-term and latest firmware on it.
 
User avatar
thomasjsn
just joined
Posts: 3
Joined: Wed May 26, 2021 12:09 am
Location: Norway
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Jul 28, 2021 10:05 pm

I have a CRS328-24P-4S+RM that flaps on two of the four SFP+ ports. My CRS317-1G-16S+RM has no flapping issues. Both switches running SwOs 2.13.
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 29, 2021 11:10 am

try upgrading the routerboot inside routeros, install the latest bugfix, upgrade routerboot, then reboot with switchos.
 
User avatar
thomasjsn
just joined
Posts: 3
Joined: Wed May 26, 2021 12:09 am
Location: Norway
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 29, 2021 11:13 am

try upgrading the routerboot inside routeros, install the latest bugfix, upgrade routerboot, then reboot with switchos.

The documentation says:

RouterBOOT is responsible for starting RouterOS in RouterBOARD devices.

Does it also play a role in booting SwOs?
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 29, 2021 11:15 am

Yes, because in another changelog, I dont remember where, told to start routerOS, upgrade routerboot, then restart in sw os.

I have a 326 that had tx drop, and the suggestion was to upgrade routerboot to the latest, then restart sw0s. now it is working perfectly with 0 tx drops.
 
User avatar
thomasjsn
just joined
Posts: 3
Joined: Wed May 26, 2021 12:09 am
Location: Norway
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 29, 2021 11:22 am

Yes, because in another changelog, I dont remember where, told to start routerOS, upgrade routerboot, then restart in sw os.

I have a 326 that had tx drop, and the suggestion was to upgrade routerboot to the latest, then restart sw0s. now it is working perfectly with 0 tx drops.

Nice, I'm going to try that. Thanks :)
 
User avatar
Maggiore81
Trainer
Trainer
Posts: 558
Joined: Sun Apr 15, 2012 12:10 pm
Location: Italy
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Thu Jul 29, 2021 11:25 am

try then let me know.
on a CRS326 with 2.12 I had a lot of tx drops.
upgraded routerboot from 6.48.3, then put the sw os 2.13
problems resolved.
 
wildfyre
just joined
Posts: 1
Joined: Fri Jun 03, 2022 8:10 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Fri Jun 03, 2022 8:20 am

Same issue here :(, flapping since v6, updated to latest v7, no dice. Still flapping. Solution is to switch to 1gb instead.
Screenshot 2022-06-03 131526.png
[Router] CCR2004-16G-2S+ RouterOS v7.2.3 Generic SFP-10G-T (fs.com) <---> CAT6 LAN cabling <---> [Switch] CRS309-1G-8S+ RouterOS v7.2.3 Generic SFP-10G-T (fs.com)
You do not have the required permissions to view the files attached to this post.
 
PortalNET
Member Candidate
Member Candidate
Posts: 126
Joined: Sun Apr 02, 2017 7:24 pm

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Mon Oct 24, 2022 11:40 pm

Hi guys

i know this is an old thread

but we have the same problem with switch CRS328 on the 4 ports sfp+ ports flapping all the time.. if we plug the same gbic for 10gbps on our switch CRS305 it link 10gbps normal with no issue at all and they work normally, but we need to expand and we bought 2 CRS328 switches.. and soon as we remove the gbics from the crs305 and plug them on the CRS328 it keeps flapping.. we tried upgrading latest long-term version RouterOS .. stable version, older versions and none work.. it seems to be a problem on the CRS328..

btw we also have.. other CRS317 RUNNING flawless without erros on other networks connected runnins switchOS mode.. with mikrotik CCRs all connected on 10gbps and also Dell Servers with SFP+ nic.. and no errors at all.. some CCRs connected 20miles distance linked 10g normally. soon as we try to put CRS328 up.. it keeps flapping ports..
Hello. I need to buy two 24 port switches and I have to choose between CRS326 and second hand Cisco 2960G, the price is the same. If I take CRS326 it will be used with RouterOS for access switch. From what I read in forum, SwOS is not ready for "in production" setups and this is the reason to choose CRS326 instead of CSS326.

My question is - if I use only 100Mbps and 1000Mbps (random mix of ports, PCs, VoIP phones etc.) connections and not 10G connections, the problem with port flapping will be present or not?
According to all posters here, the problem presents itself only in connection with CRS317 and 10G SFP+. So it will not happen to your setup.
 
tangent
Forum Guru
Forum Guru
Posts: 1329
Joined: Thu Jul 01, 2021 3:15 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Tue Oct 25, 2022 5:32 am

latest long-term version RouterOS

It was fixed in 7.4, which is “stable,” not LTS.
 
brg3466
Member Candidate
Member Candidate
Posts: 177
Joined: Sat Aug 01, 2015 7:29 am

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Dec 28, 2022 4:53 am

CRS328-24P <-> CRS312 with 1m Mikrotik DAC, port flapping every 2 hours. both switch running Stable 7.6, herebelow are the sfp+ 3 and sfp+ 4 link down ( sfp3+ and sfp+4 connected to CRS328 with LAG)
[brg3466@CRS312] > log print where message~"combo"
 dec/28 02:56:00 bridge,info hardware offloading activated on bridge "bridge1" po
rts: combo1,combo2
 dec/28 02:56:01 interface,info combo1 link up
 dec/28 02:56:01 interface,info combo3 link up (speed 10G, full duplex)
 dec/28 02:56:01 interface,info combo1 link down
 dec/28 02:56:01 interface,info combo4 link up (speed 10G, full duplex)
 dec/28 02:56:01 interface,info combo1 link up (speed 10G, full duplex)
 dec/28 02:56:02 interface,info combo3 link down
 dec/28 02:56:02 interface,info combo3 link up (speed 10G, full duplex)
 dec/28 02:56:02 interface,info combo1 link down
 dec/28 02:56:03 interface,info combo1 link up (speed 10G, full duplex)
 dec/27 20:10:42 interface,info combo3 link down
 dec/27 20:10:42 interface,info combo4 link down
 dec/27 20:11:38 interface,info combo4 link up (speed 10G, full duplex)
 dec/27 20:11:39 interface,info combo3 link up (speed 10G, full duplex)
 dec/27 21:11:22 interface,info combo4 link down
 dec/27 21:11:22 interface,info combo4 link up (speed 10G, full duplex)
 dec/28 08:12:09 interface,info combo3 link down
 dec/28 08:12:09 interface,info combo3 link up (speed 10G, full duplex)
 dec/28 08:46:29 interface,info combo3 link down
 dec/28 08:46:29 interface,info combo3 link up (speed 10G, full duplex)
 dec/28 10:59:42 interface,info combo3 link down
 dec/28 10:59:42 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 00:32:18 interface,info combo4 link down
 dec/29 00:32:18 interface,info combo4 link up (speed 10G, full duplex)
 dec/29 00:57:25 interface,info combo3 link down
 dec/29 00:57:26 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 05:35:05 interface,info combo3 link down
 dec/29 05:35:05 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 06:11:54 interface,info combo3 link down
 dec/29 06:11:54 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 07:29:38 interface,info combo3 link down
 dec/29 07:29:38 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 12:03:06 interface,info combo4 link down
 dec/29 12:03:07 interface,info combo4 link up (speed 10G, full duplex)
 dec/29 12:03:07 interface,info combo3 link down
 dec/29 12:03:07 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 12:05:52 interface,info combo3 link down
 dec/29 12:05:52 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 12:06:13 interface,info combo3 link down
 dec/29 12:06:13 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 12:06:19 interface,info combo3 link down
 dec/29 12:06:19 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 12:17:12 interface,info combo3 link down
 dec/29 12:17:12 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 16:19:47 interface,info combo4 link down
 dec/29 16:19:47 interface,info combo4 link up (speed 10G, full duplex)
 dec/29 16:19:48 interface,info combo3 link down
 dec/29 16:19:48 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 16:30:16 interface,info combo3 link down
 dec/29 16:30:16 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 16:30:54 interface,info combo3 link down
 dec/29 16:30:55 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 16:40:35 interface,info combo4 link down
 dec/29 16:40:36 interface,info combo4 link up (speed 10G, full duplex)
 dec/29 16:43:24 interface,info combo3 link down
 dec/29 16:43:24 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 16:44:10 interface,info combo3 link down
 dec/29 16:44:10 interface,info combo3 link up (speed 10G, full duplex)
 dec/29 17:04:24 interface,info combo3 link down
 dec/29 17:04:25 interface,info combo3 link up (speed 10G, full duplex)

Last edited by brg3466 on Fri Dec 30, 2022 4:53 am, edited 1 time in total.
 
tangent
Forum Guru
Forum Guru
Posts: 1329
Joined: Thu Jul 01, 2021 3:15 pm
Contact:

Re: Severe port flapping on CRS328-24P-4S+ and CRS317-1G-16S+

Wed Dec 28, 2022 7:53 am

CRS328-24P <-> CRS312 with 1m Mikrotik DAC, port flapping every 2 hours. both switch running Stable 7.6

Please don't hijack unrelated threads. We are clearly not talking about cases like yours here. That should be obvious even to a newbie: nowhere in the world does "every 2 hours" qualify as "severe."

(If you saw this condition happen in the pre-7.4 builds, you'd know what "severe" was!)

Post a new thread, and include any details that might help. Logs, switch configs, etc. Remember: if you knew all the details that were relevant, you'd have the problem solved already, so it's better to post more information than less.

Most especially, I'd want to see STP configurations and a network diagram if there's an RJ45 path between these switches as well.

Who is online

Users browsing this forum: No registered users and 57 guests