CCR CPU Spikes

Hi,

I have 2xCCR1036-8G-2S+'s deployed in core routing.

An interesting issue came up where one decided, randomly, to start spiking ALL CPU’s to 100%, locks up management, stops forwarding packets for a second or 2, basically puts a 1500ms pause on my whole network.

With 2 CCR’s installed, I’ve been able to move service between them to try figure out the issue. It only ever seems to be 1 CCR experiencing an issue at a time. I have meticulously moved single service by single service, giving each one time to settle and see when the problem swaps from one CCR to the other. It doesn’t specifically. It seems random.

I can’t reproduce the spikes in the lab.

Has anyone experienced anything like this before?

I’ve attempted help from support but they had the same problem of not being able to reproduce - and they we requesting a setup that I couldn’t achieve on production devices.

I wanted to reach out to the forum and see if anyone has had a similar problem before and if so, what was causing it? Or if you are currently experiencing it and cant figure it out, I’d love to compare notes/configs.

BTW I have observed the problem on:

6.12
6.15
6.19
6.21.1
6.25

Skipping versions as I dont always upgrade to latest every release.

One router is currently 6.25 the other is 6.21.1, the 6.21.1 is currently showing the behaviour, but I could almost bet on waking up tomorrow and the problem may have switched to the other one (as it was on the other one earlier today).

Desperately,
joegoldman