Last week I upgraded my CCR2004-16G-2S+ to RouterOS 7.9. Migration was fine and everything worked fine for a couple of days. But tonight I noticed that all ports flopped at one moment.
In the logs I see multiple ports suddenly reported as "up" (most of them have no "down" log record except for one) and I see the service beeing disrupted for couple of seconds. Here are the logs that relate to port status:
Code: Select all
2023-05-17 22:44:21.825 interface,info gre-tunnel2 link down ---> link over leased line
2023-05-17 22:44:23.946 interface,info ether2 link up (speed 1G, full duplex) ---> link over leased line
2023-05-17 22:44:23.946 interface,info ether3-LEASED_LINE link up (speed 1G, full duplex) ---> link over leased line
2023-05-17 22:44:23.946 interface,info ether1 link up (speed 1G, full duplex) ---> main uplink
2023-05-17 22:44:23.946 interface,info ether5 link up (speed 1G, full duplex) ---> internal link
2023-05-17 22:44:23.947 interface,info ether8 link up (speed 1G, full duplex) ---> internal link
2023-05-17 22:44:23.947 interface,info ether6 link up (speed 1G, full duplex) ---> internal link
2023-05-17 22:44:23.947 interface,info ether7 link up (speed 1G, full duplex) ---> internal link
One interesting thing I noticed is that the problem occurred exactly 8 days after the upgrade. I have made the upgrade to 7.9 at 2023-05-09 22:40:38, at this time router was rebooted. and the issue with port flopping happened at 2023-05-17 22:44:21. I found this post where user has similar issue with port flapping every 7 days for him.
Does anyone else have this or similar issue?
I can't do much debugging since this happened on production router.
On the router I have configured 5 VLANs and there are ~10 IPsec tunnels running. The same setup was running with previous ROS versions for the last year without such issues.
If this happens again I will downgrade to 7.8 and see if it repeats on this version.