RB433AH Crash

Hardware MikroTik hardware general
1

This is a first for me.

At 3:36am our management system SMS’d me to tell me that one of our RB433AH’s was down.

The board has two wireless cards (omni and backhaul) and three ethernet connections (lan1, iap and lan2). iap port has a public ip address.

I couldn’t do anything remotely and eventually had to drive to the site. The ports where the router cables terminate on various switches were all dead.

I unplugged the power supply from the UPS, waited a while and plugged it back in.

Lights on the switches went on, stayed on for a couple of seconds, flashed off, stayed on for a couple seconds more and then went off.

Router still dead. So I unplugged the power supply again.

I then unplugged the iap and lan2 ports and waited for about two minutes before plugging in. This time the router started. I plugged the two other ports in and all is well…so far…

Any ideas as to what could have happened?

This is what my syslog server shows

2009-05-04 03:29:21 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: fnnpr (192.168.77.182): sending RADIUS accounting Interim-Update request
2009-05-04 03:29:21 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: fnnpr (192.168.77.182): RADIUS accounting request sent
2009-05-04 03:29:38 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: 5kwjs (192.168.77.183): sending RADIUS accounting Interim-Update request
2009-05-04 03:29:38 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: 5kwjs (192.168.77.183): RADIUS accounting request sent
2009-05-04 03:32:25 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: gkejx (192.168.77.211): sending RADIUS accounting Interim-Update request
2009-05-04 03:32:25 Local7.Debug 192.168.75.254 hotspot,debug CC_HP-1: gkejx (192.168.77.211): RADIUS accounting request sent
2009-05-04 03:45:12 Local7.Debug 192.168.75.254 system,error,critical CC_HP-1: router rebooted without proper shutdown, probably power outage
2009-05-04 03:45:14 Local7.Debug 192.168.75.254 wireless,info CC_HP-1: 00:15:6D:A9:49:F2@wlan1: connected
2009-05-04 03:45:15 Local7.Debug 192.168.75.254 wireless,info CC_HP-1: 00:15:6D:A9:F6:8C@wlan1: connected
2009-05-04 03:48:02 Local7.Debug 192.168.75.254 system,error,critical CC_HP-1: router rebooted without proper shutdown, probably power outage
2009-05-04 03:48:04 Local7.Debug 192.168.75.254 wireless,info CC_HP-1: 00:15:6D:A9:F6:8C@wlan1: connected
2009-05-04 03:48:05 Local7.Debug 192.168.75.254 wireless,info CC_HP-1: 00:15:6D:A9:49:F2@wlan1: connected
2009-05-04 03:48:19 Local7.Debug 192.168.75.254 wireless,info CC_HP-1: 00:23:CD:C9:02:D3@wlan1: connected
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: dhcp1 received discover with id 4125175751 from 0.0.0.0
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: ciaddr = 0.0.0.0
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: chaddr = 00:23:CD:C9:02:D3
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Msg-Type = discover
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Unknown(116) = 01
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Client-Id = 01-00-23-CD-C9-02-D3
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Host-Name = “peter-525216a31”
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Class-Id = “MSFT 5.0”
2009-05-04 03:48:20 Local7.Debug 192.168.75.254 dhcp,debug,packet CC_HP-1: Parameter-List = Subnet-Mask,Domain-Name,Router,Domain-Server,NETBIOS-Name-Server,Unknown(46),Unknown(47),Unknown(31),Static-Route,Unknown(249),Vendor-Specific

2

Hi eben,
What wireless cards do you have on it?
What kind of power supply are you using? (volt and amp rating)
How does the power get to it? (PoE or separate supply line, and the length)

3

Radios are 2 x R52H.

The PSU is actually quite a fancy beast. It crashed. The entire processes repeated itself two hours later. I replaced it with a MikroTik 24V PSU and so far so good.

Here are pictures of the cabinet and the PSU.

Power is provided by a 1.8KVA UPS.
IMG_4750.JPG
IMG_4750.JPG

4

Like I see your RB connected to 28V DC - it’s very close to RB433 OVP threshold and that can be reason RB power problem. If you use this PSU try with 12V DC

5

It’s never given 28V.

This was a typical day’s power output.

23:00 = 26.7
22:00 = 26.9
21:00 = 27.2
20:00 = 27.2
19:00 = 27.0
18:00 = 27.0
17:00 = 27.0
16:00 = 27.0
15:00 = 27.0
14:00 = 27.0
13:00 = 27.0
12:00 = 27.2
11:00 = 26.8
10:00 = 26.4
09:00 = 26.2
08:00 = 26.2
07:00 = 26.2
06:00 = 26.2
05:00 = 26.2
04:00 = 26.2
03:00 = 26.3
02:00 = 26.2
01:00 = 26.3
00:00 = 26.3

6

Update.

This is what the output from a genuine MikroTik 24V power supply looks like:

23:00 = 23.0
22:00 = 23.0
21:00 = 22.9
20:00 = 22.9
19:00 = 23.0
18:00 = 22.9
17:00 = 23.0
16:00 = 22.9
15:00 = 22.9
14:00 = 22.9
13:00 = 23.0
12:00 = 23.0
11:00 = 23.2
10:00 = 23.2
09:00 = 23.2
08:00 = 23.2
07:00 = 23.2
06:00 = 23.2
05:00 = 23.2
04:00 = 23.2
03:00 = 23.2
02:00 = 23.2
01:00 = 23.2
00:00 = 23.0

7

How about power problem? Is it work fine without crash? Are you sure about this voltage precision :slight_smile:)

8

I have not tested the 28V power supply yet. It is high up in the roof of a building and I don’t like crawling into that small space.

Those are the voltages as shown in “System → Health” from winbox.

9

I am sure about the precision. If I am not mistaken, that is my script from the wiki checking the voltage every hour.
http://wiki.mikrotik.com/wiki/Monitor_input_voltage_on_RB333/433AH

10

You are correct :smiley:

11

Script work fine but I talking about voltage on RB input and voltage what we see in /system health. For example when we see 26.2V actually it’s 29V :slight_smile:) Not believe - take any multimeter and check.

12

I always thought that the RB’s could only run 12-24v? has anyone gota a datasheet showing they should be able to run 28?

13

It’s in the manual.

14

You may be correct on the higher voltages. I have only checked two units to 14.5 volts, and they are both within 0.2v.

http://routerboard.com/comparison.html#powerSeries
Click on the little “More” arrow at the end of the row to see the data. RB433s are 10-28vdc.

15

Thanks for the tip!