Community discussions

MikroTik App
 
fgmt
just joined
Topic Author
Posts: 17
Joined: Fri Sep 09, 2016 1:47 pm

Connection problems over fiber optic connection CRS326 - hEX PoE

Fri Jul 28, 2017 5:25 pm

Hi,

I've recently installed two mikrotik systems connected via fiber optics using S-85DLC05D SFP modules:

- CRS326-24G-2S+RM
- hEX PoE

The CRS326 is connected the main switch via copper. The hEX is connected via a fiber optic connection to the CRS326. The CRS is running without any noticeable problems concerning its reachability from the local LAN. The hEX behind the fiber connection is going crazy. Sometimes it just works, sometimes is reachable only a few minutes every few hours and sometimes it comes and goes every minute. After power cycling the hEX right now to export its config the link came up again.

I've already tested the setup using a short fiber optic cable an replaced the SFP modules. It still doesn't work. For the moment I'm not sure if I've got a hardware problem or some invalid configuration.

Any ideas what the reason might be?
# jul/28/2017 16:14:15 by RouterOS 6.40
# software id = xxxx-xxxxx
#
# model = CRS326-24G-2S+
# serial number = xxxxxxxxxxx
/interface ethernet
set [ find default-name=ether1 ] name=ether1-master
set [ find default-name=ether2 ] master-port=ether1-master
set [ find default-name=ether3 ] master-port=ether1-master
set [ find default-name=ether4 ] master-port=ether1-master
set [ find default-name=ether5 ] master-port=ether1-master
set [ find default-name=ether6 ] master-port=ether1-master
set [ find default-name=ether7 ] master-port=ether1-master
set [ find default-name=ether8 ] master-port=ether1-master
set [ find default-name=ether9 ] master-port=ether1-master
set [ find default-name=ether10 ] master-port=ether1-master
set [ find default-name=ether11 ] master-port=ether1-master
set [ find default-name=ether12 ] master-port=ether1-master
set [ find default-name=ether13 ] master-port=ether1-master
set [ find default-name=ether14 ] master-port=ether1-master
set [ find default-name=ether15 ] master-port=ether1-master
set [ find default-name=ether16 ] master-port=ether1-master
set [ find default-name=ether17 ] master-port=ether1-master
set [ find default-name=ether18 ] master-port=ether1-master
set [ find default-name=ether19 ] master-port=ether1-master
set [ find default-name=ether20 ] master-port=ether1-master
set [ find default-name=ether21 ] master-port=ether1-master
set [ find default-name=ether22 ] master-port=ether1-master
set [ find default-name=ether23 ] master-port=ether1-master
set [ find default-name=ether24 ] master-port=ether1-master
set [ find default-name=sfp-sfpplus1 ] master-port=ether1-master
set [ find default-name=sfp-sfpplus2 ] master-port=ether1-master
/interface vlan
add interface=ether1-master name=vlan-104 vlan-id=104
/interface ethernet switch port
set 0 default-vlan-id=100 vlan-header=add-if-missing vlan-mode=secure
set 1 default-vlan-id=100 vlan-header=add-if-missing vlan-mode=secure
set 2 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 3 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 4 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 5 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 6 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 7 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 24 default-vlan-id=100 vlan-header=add-if-missing vlan-mode=secure
/ip hotspot profile
set [ find default=yes ] html-directory=flash/hotspot
/interface ethernet switch vlan
add ports=\
    ether1-master,ether2,sfp-sfpplus1,ether3,ether4,ether5,ether6,ether7,ether8 \
    switch=switch1 vlan-id=101
add ports=ether1-master,ether2,sfp-sfpplus1 switch=switch1 vlan-id=102
add ports=ether1-master,ether2,sfp-sfpplus1 switch=switch1 vlan-id=103
add ports=ether1-master,ether2,sfp-sfpplus1,switch1-cpu switch=switch1 vlan-id=\
    104
add ports=ether1-master,ether2,sfp-sfpplus1 switch=switch1 vlan-id=105
add ports=ether1-master,ether2,sfp-sfpplus1 switch=switch1 vlan-id=106
add ports=ether1-master,ether2,sfp-sfpplus1 switch=switch1 vlan-id=100
/ip address
add address=xx.yy.51.11/24 comment=defconf interface=vlan-104 network=xx.yy.51.0
/ip dns
set servers=8.8.8.8
/ip route
add distance=1 gateway=xx.yy.51.1
/system clock
set time-zone-name=Europe/Berlin
/system routerboard settings
set boot-os=router-os
# jul/28/2017 16:29:12 by RouterOS 6.40
# software id = XXXX-XXXX
#
# model = 960PGS
# serial number = XXXXX
/interface bridge
add fast-forward=no name=bridge_vlan
/interface ethernet
set [ find default-name=ether2 ] master-port=ether1
set [ find default-name=ether3 ] master-port=ether1
set [ find default-name=ether4 ] master-port=ether1 speed=10Mbps
set [ find default-name=ether5 ] master-port=ether1
/interface vlan
add interface=sfp1 name=sfp1-vlan-100 vlan-id=100
add interface=sfp1 name=sfp1-vlan-101 vlan-id=101
/interface ethernet switch port
set 0 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 1 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 2 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 3 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 4 default-vlan-id=101 vlan-header=always-strip vlan-mode=secure
set 5 vlan-header=always-strip
/ip hotspot profile
set [ find default=yes ] html-directory=flash/hotspot
/interface bridge port
add bridge=bridge_vlan interface=sfp1-vlan-100
add bridge=bridge_vlan interface=ether1
add bridge=bridge_vlan interface=sfp1-vlan-101
/interface ethernet switch vlan
add independent-learning=no ports=ether1,ether2,ether3,ether4,ether5,switch1-cpu switch=switch1 vlan-id=101
/ip address
add address=XX.YY.50.10/24 interface=bridge_vlan network=XX.YY.50.0
/ip dns
set servers=8.8.8.8
/ip route
add distance=1 gateway=XX.YY.50.1
/system clock
set time-zone-name=Europe/Berlin
 
fgmt
just joined
Topic Author
Posts: 17
Joined: Fri Sep 09, 2016 1:47 pm

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 9:57 am

I've activated the watchdog to reboot the system after a downtime of 30 minutes. This was running over the weekend. After each reboot the connection is coming up again without problems but the actual connection loss problem persists.
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 12:03 pm

Which ROS version and firmware versions are both running? (specially the Hex PoE)?

I'd make sure both are using 6.40, and Current Firmware is the same version as Upgrade firmware at System > Routerboard
 
fgmt
just joined
Topic Author
Posts: 17
Joined: Fri Sep 09, 2016 1:47 pm

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 12:39 pm

Which ROS version and firmware versions are both running? (specially the Hex PoE)?

I'd make sure both are using 6.40, and Current Firmware is the same version as Upgrade firmware at System > Routerboard
They are both running RouterOS 6.40. Version information is also included in config export in my first post.

Right now I'm connected using winbox to the hex over the fiber optics connection. Every 5 to 30 minutes I get disconnected from the hex. Reconnecting manually works without any problems. Maybe this is also an indicator.
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 12:52 pm

They are both running RouterOS 6.40. Version information is also included in config export in my first post.
Yes, but had to specify as you may have tried using a different version.

What about Firmware? What's on System > Routerboard?

Have you tested the fiber patch & SFP modules are working to link the CRS326 to a routerboard different from the Hex?
 
fgmt
just joined
Topic Author
Posts: 17
Joined: Fri Sep 09, 2016 1:47 pm

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 2:30 pm

I've just upgraded firmware in the CRS326. The hex is factory default. My versions are:

CRS326: 3.40 (factory default was 3.37)
hex: 3.34 (which is factory default)

For testing I can replace the hex with an RBS260GS running SwOS which I received today. This is the only device I have available right now.
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 3:25 pm

Test with the RB260 to see if it works stably or not. Have you tried swapping SFP modules (to isolate if one of them is faulty)?

Have you tested accessing the hex while it's failing from a copper port? If you are able to do so, generate a supout.rif file with and without the problem happening, so SFP loses link (on both routers).

Also, run if possible while failing (on both routers)
/interface ethernet monitor [find]
And post it here.
 
User avatar
acruhl
Member
Member
Posts: 371
Joined: Fri Jul 03, 2015 7:22 pm

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Mon Jul 31, 2017 4:19 pm

These are classic dirty cable/sfp or bad cable/sfp problems.

1. Clean both ends of the cable. I use the "pen clicker" type for LC connections, you might not have that. Possibly use alcohol and a clean cotton swab, or short of that wipe it LIGHTLY across a very clean cloth (not something you've been using to wipe your phone or monitor in other words).

2. Blow clean air (not from your mouth) in the SFP.

3. Ensure there are no tight bends beyond about 90 degrees in the fiber cable anywhere. If you have a cable tester, test it. If not, try another one.

What does the log show?

Do your link lights go off when you have issues?
 
becs
MikroTik Support
MikroTik Support
Posts: 499
Joined: Thu Jul 07, 2011 8:26 am

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Tue Aug 01, 2017 3:03 pm

I've just upgraded firmware in the CRS326. The hex is factory default. My versions are:
CRS326: 3.40 (factory default was 3.37)
hex: 3.34 (which is factory default)
We have done several tests between CRS326 and "hEX PoE" with the latest versions to check for possible software issues but have not found anything.
You should try suggestions by acruhl and if they do not help, send supout.rif files from both devices to MikroTik support.
 
fgmt
just joined
Topic Author
Posts: 17
Joined: Fri Sep 09, 2016 1:47 pm

Re: Connection problems over fiber optic connection CRS326 - hEX PoE

Wed Aug 02, 2017 11:07 am

These are classic dirty cable/sfp or bad cable/sfp problems.

1. Clean both ends of the cable. I use the "pen clicker" type for LC connections, you might not have that. Possibly use alcohol and a clean cotton swab, or short of that wipe it LIGHTLY across a very clean cloth (not something you've been using to wipe your phone or monitor in other words).

2. Blow clean air (not from your mouth) in the SFP.

3. Ensure there are no tight bends beyond about 90 degrees in the fiber cable anywhere. If you have a cable tester, test it. If not, try another one.

What does the log show?

Do your link lights go off when you have issues?

Thank you guys for your advise. I've did a short test with the RB260 which just worked. Afterwards I switched back to the hex. Additionally I cleaned the SFP connectors and cables as suggested. The strange thing is my monitoring shows almost no problems since first posting here. Configuration is still the same as before.

I think we can consider the issue solved. Thanks for your help!

Who is online

Users browsing this forum: Bing [Bot] and 46 guests