We have a remote location with "intermittent fiber service" yeah i know what is intermittent fiber service, well its from a provider that has unstable infrastructure in this rural location (best way to put it). We have a CCR1009 on v7.91 (we've tried all sorts of versions) and cannot get the tunneled paths to stay up for manual fail over.
the primary fiber connection is run and is BGP
the secondary Connection is a Spectrum cable modem (dynamic IP Dynamic DNS)
new secondary connection is a 1Gb AT&T ABF fiber/to copper connection. Static IP
As a general rule the fiber path is which is a layer 2 connection to our datacenter runs BGP to our core cisco router directly
our two secondary paths run multihop BGP with the Core Cisco router via a EOIP tunneled connection (we have tried EOIP and GRE and Wireguard tunnels etc, with no change in performance)
the tunnels come up instantly and are stable tunnels, Each tunnel has a static route for the tunneled block to force the traffic out either spectrum or AT&T networks.
Since we have unstable fiber (takes regular errors etc) when it is bad we force the traffic to one connection or another (yes i know we can do this with Med's or preferences, but that gives lower level techs the ability to turn a minor outage into a big deal) so we choose to pre build two static routes in and leave them disabled so all they have to do is enable the route (at each end) and the traffic should flow. and them myself or the lead tech can deal with failing back during normal working hours (ha!)
With that said. the BGP default route, yes we export a default route only to the remote location, shows up with a distance of 15 and the static routes are preconfigured with a 5 and 6 distance respectively.
If I put a static route 0.0.0.0/0 to the far end tunnel address on the ATT circuit the router immediately drops the two tunnels and they cycle 1 sec. down, 1 sec up 1 sec. down etc and the tunnels are unusable. If i put a 0.0.0.0/1 route, everything works fine (except we are missing 1/2 of the internet). I am at a loss for why this behavior happens. the ATT and Spectrum modems are both directly connected to the tik on ports 3 and 4 and the directly connected route (distance 0) should be persistent and not affected by a static route override
Any thoughts on this problem would be appreciated. Its baffled me and my lead tech for about a week now so hopefully the collective brain trust can shine some light on my problem.
Ralph