Community discussions

MikroTik App
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

OSPF losing routes randomly

Thu May 26, 2016 6:44 pm

Hello,

I recently moved a network from Static Routing to OSPF, very simple implementation as I always did it on Cisco and Juniper with no big problems.

So, I did the setup normally, all my routes arrived in every router's routing table, that's all ok so far.

However, 30 minutes later, boom. Every OSPF route is gone. I had to disable and enable the OSPF instance in order to get the routes back.

It is happening randomly from every 30 minutes to a hour.

Anyone else having this problem?

I'm using public IPs with a PPPoE Server, Static Routes is becoming a pain with over 500 routes to work with. (/23 ip block)
 
n21roadie
Forum Guru
Forum Guru
Posts: 1949
Joined: Fri Aug 07, 2009 10:36 pm
Location: Limerick,Ireland

Re: OSPF losing routes randomly

Sat May 28, 2016 6:24 pm

I assume you are using a OSPF loopback interface on each ospf device?
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Mon May 30, 2016 1:59 am

I assume you are using a OSPF loopback interface on each ospf device?
Yes, using a loopback interface for the Router ID.
 
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: OSPF losing routes randomly

Tue May 31, 2016 5:56 pm

Are you using this over wireless point-to-point links that are being created by external devices (Ubiquiti)?

Many people recommend using link-type of NBMA and statically-defining the neighbors because the multicast traffic (OSPF hellos) tends to get dropped by these UBNT links, especially when the links carry significant traffic at or near the max throughput rate.

If this is your setup, and you change to NBMA and the problem persists, you may also need to set DSCP on the OSPF packets to 46 so that the UBNT gear will prioritize the OSPF traffic.
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 2:36 pm

Are you using this over wireless point-to-point links that are being created by external devices (Ubiquiti)?

Many people recommend using link-type of NBMA and statically-defining the neighbors because the multicast traffic (OSPF hellos) tends to get dropped by these UBNT links, especially when the links carry significant traffic at or near the max throughput rate.

If this is your setup, and you change to NBMA and the problem persists, you may also need to set DSCP on the OSPF packets to 46 so that the UBNT gear will prioritize the OSPF traffic.
OSPF is running between 4 CCR1009 in the same rack, connected through Cat6a cables.
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: OSPF losing routes randomly

Wed Jun 01, 2016 4:28 pm

What version of RouterOS is on each router?
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 5:02 pm

What version of RouterOS is on each router?
Newest version.

6.35.2 on all 4 routers.
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: OSPF losing routes randomly

Wed Jun 01, 2016 6:36 pm

Do you see the same issue if you use the latest bugfix version on all routers? Can you post configs?
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 6:51 pm

Do you see the same issue if you use the latest bugfix version on all routers? Can you post configs?
Same issue with lastest bugfix version.

Configs:

Border:
/routing ospf instance
set [ find default=yes ] distribute-default=always-as-type-1 name=BORDER \
    router-id=10.10.0.1
/routing ospf interface
add interface=loopback0 network-type=point-to-point
/routing ospf network
add area=backbone network=10.10.0.1/32
add area=backbone network=177.131.x.x/28
Router #1:
/routing ospf instance
set [ find default=yes ] name=TIMBU router-id=10.10.1.1
/routing ospf network
add area=backbone network=177.131.x.x/28
add area=backbone network=10.10.1.1/32
add area=backbone network=100.64.0.0/23
add area=backbone network=10.10.0.1/32
Router 2 3 and 4 uses same config but with different RouterID and different /23 CGNAT blockblock.

177.131.x.x/28 is used to communicate between routers, I also have Private IPs set for administration, but this is mainly for tracing routes.

10.20.0.128/28 is used for the administration.
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: OSPF losing routes randomly

Wed Jun 01, 2016 6:57 pm

Which ports are you using on the CCR1009 to connect the routers together?
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 6:59 pm

Which ports are you using on the CCR1009 to connect the routers together?
BORDER (eth7) to 24p managed switch

Managed switch to port 8 Router #1
Managed switch to port 8 Router #2
Managed switch to port 8 Router #3
Managed switch to port 8 Router #4
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: OSPF losing routes randomly

Wed Jun 01, 2016 7:03 pm

If possible, connect the routers together with a different switch and see if you still have the issue. Another option would be to run a packet capture just for OSPF on eth8 on several different routers to try and catch why this is happening.

We run OSPF/BGP and MPLS on large production networks with CCRs of all models and don't see the issue you're describing unless there is some kind issue in the ethernet transport whether it's RF, copper or fiber.

Hopefully you're not running BFD with OSPF on the CCR1009?
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 7:07 pm

If possible, connect the routers together with a different switch and see if you still have the issue. Another option would be to run a packet capture just for OSPF on eth8 on several different routers to try and catch why this is happening.

We run OSPF/BGP and MPLS on large production networks with CCRs of all models and don't see the issue you're describing unless there is some kind issue in the ethernet transport whether it's RF, copper or fiber.

Hopefully you're not running BFD with OSPF on the CCR1009?
Only OSPF running.

I have static routes distance set to 200, and OSPF distances set to 100 so I can test the OSPF routing without network interruption.

I'll try keeping just 1 router with OSPF enabled for the time, the rest will be done through static routing, so I can see if it is a particular router messing everything up.

Will post results soon.

(Also I already tried connecting them directly, same problem)
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Wed Jun 01, 2016 8:41 pm

Okay its been 2 hours since the system is running with OSPF enabled only between BORDER and Router #1, no problems so far, so we passed the 30 minutes - 1 hour problem.

I'll enable it on Router #2 now.
 
riksk
just joined
Topic Author
Posts: 12
Joined: Thu May 26, 2016 6:38 pm

Re: OSPF losing routes randomly

Thu Jun 02, 2016 12:39 am

NBMA seems to solve the problem.

I've added only the border Neighbor to the Routers, and all the Routers to the Border. 2 hours so far with no problems or warnings, rock solid routing.
 
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: OSPF losing routes randomly

Thu Jun 02, 2016 12:56 am

It sounds like perhaps the ethernet switch is dropping some multicast traffic if switching to NBMA fixes the problem.
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: OSPF losing routes randomly

Thu Jun 02, 2016 9:02 pm

It sounds like perhaps the ethernet switch is dropping some multicast traffic if switching to NBMA fixes the problem.
My thoughts exactly which is why i suggested trying a different switch.

To the OP: Typically when NBMA solves your OSPF issues it means you've masked an underlying problem - most likely dropping multicast traffic for 224.0.0.5 & 224.0.0.6
 
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: OSPF losing routes randomly

Thu Jun 02, 2016 10:08 pm

It's possible that the switch may have some broadcast/multicast storm control or limitation feature, and if the OSPF hellos are coming at times when there is enough multicast/broadcast traffic to trigger the limitations, that could be a possible source of the issue.
 
changeip
Forum Guru
Forum Guru
Posts: 3830
Joined: Fri May 28, 2004 5:22 pm

Re: OSPF losing routes randomly

Fri Jun 03, 2016 5:37 am

netgear gray (not the blue line) switches have this feature and break things unless you disable the storm control features. took me a long time to track it down.
 
StefanM
newbie
Posts: 49
Joined: Sun Dec 13, 2015 1:49 am

Re: OSPF losing routes randomly

Fri Jun 10, 2016 5:09 am

Glad you solve the problem, useful info to know also.

Who is online

Users browsing this forum: No registered users and 47 guests