RB1000 closing tens of pppoe connections at once

Update to what I mentioned earlier. I believe this problem to be associated to the 4.x firmware. I had realized a similar problem in a previous RB1000 (It has firmware 4.6) which has now been re-deployed in another area of our network. I had pulled all the configs and uploaded them to a new RB1000 with 3.x firmware and had no PPPoE connection drops during that time. However i had a fairly high CPU usage which prompted me to upgrade to the latest firmware 4.9. And a couple of days afterwards I have started to experience the same problem. I have reverted to firmware 3.30 and will test it for a few days. If will post the results of my little test.

Corey.

We have this problem since the day we bought our first RouterBOARD from MikroTik (RB1000) 1,5 years ago. Well, if I remember correctly, the board had RouterOS v3.22 installed. Since that day we’re always looking forward for the next firmware update hoping they fixed it.

cuz2000m: The support told me to upgrade to v5.x beta as they may changed something with the PPPoE stuff. But as my RB1000 is about 450 kilometers away I can’t do the upgrade hoping nothing bad will happen. Maybe you can check it out if v5.x will fix it as you’re next to the boards? We’ve to buy another solution if MikroTik doesn’t get this fixed soon! :frowning:

We have 2 PowerRouter 732’s and an RB1000 that keep having “spontaneous rebooting”. The PowerRouters keep crashing and we have had to - disable 1 of the CPU’s, disable “multi threading” and try v5.x beta and v4.9 for each unit - without success and we continue to crash every 1-2 days, which has been going on for several weeks now. The RB1000 is stable for us though.

Mikrotik support have been given all the support logs and we are urgently waiting for a quick reply. Mikrotik have a great product (we are very happy) but Iv’e been reading many threads regarding this and it is a big issue that needs fixing.

Hi All,
As promised, I just wanted to update you on the progress so far and that is to say that I have not yet experienced the same problem since I downgraded to 3.30.

I’m sorry rborz but I can’t upgrade to the 5.x beta at this time. It would be really irresponsible for me to do this and needless to say, I have already lost a few customers because of these outages.

Maybe someone else who had the problem with Firmware version 4.x can upgrade or downgrade to version 3.30 like I did and maybe confirm a possible problem with the 4.x line or firmwares.

Corey.

hi all
I am having very similar problems where is run a RB1000 with 500+ pppoe sesions and all the sessions drops at once. When this happens all sesions will immediately start to reconnect without problems.

Little bit background on my setup. I make use of a radius server for the AAA functions that uses the RB1000 as the pppoe server. when the client connects i simple queue is created to provide bandwith limit to the session on a per session basis.

cuz2000m i have also downgraded to 3.30 with no change in the problem. Have gone through version 3.3, 4.5, 4.6 recently and some other along the way. All give the same problem. Can not find any pattern in when this happens.

Have also replaced the RB1000 with a new one and problem persists (and all other common hardware between RB1000 and clients). have 4 other Routerboards also using the same radius server with no problems, however they are running a max of 150 clients. Can this be load related?

well for any other ideas im willing to try almost anything at this point have lost a few dozen clients already…

Hi All,
Another update. Was busy for the past few days. Well, the problem did subside with v3.30, but only for a week. After which, it started all over again. User47, I have been wondering the same thing. I have a very similar setup to you in that there is an external radius server which does our authentication but there is no queues setup on that mikrotik. I also have a few customers (around 50) on another mikrotik running 4.6 without these drops. So I was also wondering if it was a load problem. The RB1000 according to specs is suppose to handle around 5000 PPPoE sessions. CPU load is between 30-50 % and there is not much memory load at all.
I have updated to version 5.0 beta 2 which in this case seems to correct itself somewhat but I can’t allow the disconnections to continue in this form. It makes us look very Unprofessional and Unreliable.
Does anyone have any ideas?

hi
i have the same problem.
when clients trying to conncet pppoe they gets error 691 and in mikrotik log says “peer is not responding” and afer two or more retry, clients can conncet.
my OS version is 4.9

Same problem here… after a time with all clients connected all connections are terminated… after 2~3 seconds all clients reconnect normally… i have send the supout.rif to mikrotik and they not encounter no signal of software crash… but the clients continues to disconnect.

We are seeing the same issues except on two RB450G routers and a lot less clients. 70 clients in Mikrotik 69 will drop session and within seconds re-enter session.We have tried all the suggestions given here minus going to the beta firmware
We have
wifi link–>switch–>RB450G–>Engenius 2611AP–>customers
when the sessions drop all customers are in AP.They all authenticate to a central Radius server.
We have 15 Mikrotiks in use none have quite the client load of these two and never do the drop all customers thing, the two that drop are both using 4.10 firmware. We added a 5.8 link to one of the Microtiks (all are 2.4)so one has 2.4 and 5.8 customers and all drop the same.Which to me sets common point of issue with microtik. We have replaced pretty well everything on the tower AP 3 different units even went with ubiquity radio but that was the original radio and had a few issues before we converted to PPPOE and Mikrotik (errors on RX and TX which we attributed to to many customers). We are going to try downgrading to 4.5 but reading this thread not holding much hope of it being the cure.

This may be related.
http://forum.mikrotik.com/t/ethernet-reset-on-some-rb-with-ros-3-30/36073/3

It almost appears ours is bandwidth usage that is the root cause of disconnects. We set everyone of the people down to 384/128 and they so far have stayed connected 4 hours longer than they used to(will see if any hit the 1 day mark).
OK definately not working dropped everybody at about 20 hours.

Hi,
Has anyone been able to check their logs to see if they recognize any similarities before the “crash” of the PPPoE servers. In mine, I notice that my VLAN interfaces all switch to the UP state. I don’t see anything going to the DOWN state prior to this though. So I have no idea why the state changed to UP. Is anyone else logging to a syslog server that can confirm this?


Corey.

Hi all.

I’d like to ask everyone who reported this problem if there was no solution up to date?

Hi,

I’m having same issue with RB1100 as PPPoE concentrator and RocketM5 directly connected to a port of RB1100 in order to terminate wireless connections that connect to such AP.

Just BEFORE pppoe bulk disconnections I see in the RocketM5 logs:

[1404166.824000] AG7240: unit 0: phy 4 not up carrier 1
[1404166.825000] br0: port 1(eth0_real) entering disabled state
[1404168.635000] AG7240: enet unit:0 phy:4 is up…RGMii 100Mbps full duplex
[1404168.636000] AG7240: done cfg2 0x7135 ifctl 0x10000 miictrl
[1404168.636000] br0: port 1(eth0_real) entering learning state
[1404169.636000] br0: topology change detected, propagating
[1404169.636000] br0: port 1(eth0_real) entering forwarding state

This happens from time to time; not very often… Now the question is: which device is going down/up? mikrotik? ubiquity?

I have asked in the Ubiquity forums too: http://www.ubnt.com/forum/showthread.php?t=23032

The simplest workarround I can figure is to put a switch between the pppoe and the AP in order both ends always see and ethernet link up independently of the other end.

Regards,
Antonio

:confused: RB1000 discontinued?!
http://www.routerboard.com/pricelist.php?showProduct=57

since a long time already. RB1100

I have noticed that when the cpu reaches 100% of usage and stays there for over a couple of minutes, all the connections go down. I hope this can be helpfull for someone. Now I am tryng to install router OS on a HP DL 380 2.8 ghz quad core double cpu server, with 4 GB Ram and sas HD and equipped with ESX since Router OS doesn’t support sas hd’s. It seems to work fine but I am not sure that the Hardware performance is the problem.
I’ll keep you all up with the results of the trial.

Same problem. Replacing rb1000 with x86 machine , solved the problem.

Did you all submit tickets to support about this issue with RB1000 as suggested above? Please tell me the ticket numbers and I will check the status.

Same problem. I notice the problem about 20 sessions and it persist until now, 215 sessions. Problem does not include pptp session connected thru WAN port. What is the “ticket numbers” ?