CCR Lock out

I have a CCR1036-12G-4S running 6.18 (yes the firmware is upgraded) that is currently not allowing me to login. I’m quite sure I have the username / password correct.

→ Winbox isn’t connecting (it just sits there saying 'Logging in to xxx.xxx.xxx.xxx).
→ Telnet / ssh is returning ‘Login failed, incorrect username or password’.
→ The web version tries for about 1/2 minute then returns ‘ERROR: Internal Server Error’.

Traffic is still flowing so I know the router is online and working but I can’t get into it to configure anything. This happens to be our BGP edge router so I would like to know what is going on, assuming serial cable works I’ll attempt to create a supout.rif otherwise what information can I collect to debug this issue? I will be going down this evening so any suggestions would be appreciated (about 10 hours from now).

Have you tried default admin with no password?

There is / was a bug when ccr can not access the data storage , and then there is no password for logging in.

Yes, no luck.

The router has since recovered, any idea if / when this was fixed? I’m not using this with a micro sd or any sort of external storage.

This is a pretty common issue with the CCR’s.
It seems that the Admin account with no password or the last password it was changed to will normally work. Any addition accounts will fail. A reboot will clear it up for a few days. This was said to be fixed in 6.17, and 6.18, and 6.19.. Though I’ve still ran into it several times.

I have a pretty ugly work around;
The CCR that I have this problem most with is attached to a UPS that I can cycle the outputs. I have a Linux server that makes an SSH connection to the router. If the connection fails, the CCR gets power cycled. The CCR’s reboot and are online in about 15 seconds. Any other router and this “fix” wouldn’t be realistic.

That said, Out of 12 CCR’s that I’ve deployed, only one is still doing this after the 6.19 update.

Netinstall fixes it for good.

Hmm, that is not good.

This is our BGP router (all our upstream’s fiber plugs into it at his location) even if the CCR reboots in 15 seconds (BGP peers will take about another minute on top of that) I can’t afford to be having that kind of outage on any sort of regular basis.

I’ll probably wait a week to watch if there is are any bugs other than the usermanager and schedule an upgrade to 6.19.

Thanks for all the help / info.