Community discussions

MikroTik App
 
User avatar
savagedavid
Trainer
Trainer
Topic Author
Posts: 320
Joined: Thu Aug 25, 2005 12:58 pm
Location: Cape Town, South Africa
Contact:

Router Upgrade causes network lockup

Mon Apr 01, 2019 11:47 am

Wondering if anyone has experienced anything like this. We have a CCR1072 core router that links to several other CCR routers (1016, 1036, 1072). The router runs both BGP and OSPF and links our AS to the internal network.

We decided to embark on a routine upgrade since it had net been done for close to a year, due to the high availability requirements of the router we are always reluctant to do so. However we went ahead with an upgrade to the current Long Term release.

Absolute disaster. The router did not come back up after the upgrade. This necessitated a drive to the data center to hard reboot. After that the router came back up, however this is when we discovered that almost every CCR router that was connected to this router had also frozen up. This required driving to multiple data centers to reboot routers.

This has been completely unprecedented for us. A lockup on upgrade, while very rare, has occurred before. However I have never seen a failure on one router manage to lock up multiple other routers simultaneously. The locked up routers could still be logged onto locally, however they did not pass any traffic through interfaces. Only a hard reboot solved the problem.

This is extremely worrisome as it locked up our network for several hours. Has anyone else ever experienced anything like this? Any feedback is appreciated.

Unfortunately at the time I did not think to collect supout files manually, and since the routers did not think they were down they did not do an auto supout.
 
alanlevin
just joined
Posts: 2
Joined: Tue May 28, 2019 3:00 pm

Re: Router Upgrade causes network lockup

Tue May 28, 2019 3:04 pm

At Vanilla we had this, something to do with ospf I think
 
escor
just joined
Posts: 7
Joined: Thu Apr 09, 2020 3:17 pm

Re: Router Upgrade causes network lockup

Thu Nov 02, 2023 8:59 am

Good evening, did a consultation solve the problem or did they tell you why this is happening?

I have a similar problem, my CCR1072 blocks out of nowhere, I can enter the computer through the interface but however I can't do anything, it is completely hung up, I see its cpu and it is back under 3%.
However, until now I don't know what problem it would be.
 
jirinovak
just joined
Posts: 6
Joined: Fri Oct 22, 2010 1:45 pm

Re: Router Upgrade causes network lockup

Fri Nov 03, 2023 6:29 am

I have the same issue. Router 1016 out of the blue does not respond on all LAN interfaces (interface list) except WAN. When connected to the router over WAN I can reboot. After reboot everything went back to normal. Routing - OSPF - MPLS VPLS.
 
User avatar
mutluit
Forum Veteran
Forum Veteran
Posts: 821
Joined: Wed Mar 25, 2020 4:04 am

Re: Router Upgrade causes network lockup

Fri Nov 03, 2023 6:48 pm

Which RouterOS versions are affected?
 
jirinovak
just joined
Posts: 6
Joined: Fri Oct 22, 2010 1:45 pm

Re: Router Upgrade causes network lockup

Sun Nov 05, 2023 9:53 pm

Version 7. I think it is a TILE problem. Everything is OK on an ARM with the same configuration. It is strange. After upgrade you can expect a stuck of router untill 14 days. Is there anybody who does not have this problem on a TILE architecture?

Who is online

Users browsing this forum: CGGXANNX and 67 guests