Nray w60g station hangs and generates unknown traffic

Hello!
I facing problems with two links of wireless wire nray:

  • Links is 700m and 3km. Connected as station->ap->switch->ap->station.
  • Carries same traffic (failover while optic fails)
  • POE is good: one link at 48v 0.5a/another at 24v 1a (worked flawlessly with previous gear)
  • Swapping station/ap sides does not change situation, only station side hangs.
  • Two stations hangs at the same time, brings down ethernet and when port goes up there is no traffic until reboot by watchdog.
  • Management is not accessible via http/ssh/mac-telnet. Not traffic coming from station side.
  • Station is connected to ap, but if I reboot ap it wont connect until station reboots.
  • Switching offload and learning does not help. STP, loopdetect and multicast is off.
  • Tried firmware 6.47.10, 6.48.2, 6.48.3, 6.49beta54 (watchdog helps to reboot), 7.1beta6 (hangs totally, watchdog didnt help at all, only power cycle)
  • Even if I enabled storing supout.rif on watchdog page, after reboot there is no such file. Logging to disk also did not reveal anything.
  • Before hang w60g interface generates about 400k of traffic with ethertype=4 between wireless side macs (I changed bridge mac not to match it, clearly traffic is directed only to radio interface)
  • Captured traffic on w60g interface via packet sniffer & wireshark. Seems unknown to me, but src and dst macs is w60g radio interfaces.
    mik4.png.415a30ad917b390c21d98aa0d445cb2d.png
    mikr.png
    Anyone can help in this situation?
/export

of both devices

# aug/05/2021 08:31:30 by RouterOS 6.49beta54
# software id = VZWL-P47P
#
# model = nRAYG-60ad
# serial number = DB8D0D07C70B
/interface bridge
add admin-mac=08:55:31:D3:9A:60 auto-mac=no comment=defconf name=bridge \
    protocol-mode=none
/interface ethernet
set [ find default-name=ether1 ] l2mtu=1600 loop-protect=off
/interface w60g
set [ find ] arp=disabled disabled=no l2mtu=1600 mode=station-bridge name=\
    wlan60-1 password=secure_222 region=usa scan-list=\
    58320,60480,62640,64800,66000 ssid=secure_333
/interface vlan
add interface=bridge loop-protect=off name=mgmt vlan-id=961
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/queue interface
set wlan60-1 queue=only-hardware-queue
/routing bgp instance
set default disabled=yes
/routing ospf instance
set [ find default=yes ] disabled=yes
/snmp community
set [ find default=yes ] name=secure_111
/interface bridge port
add bridge=bridge comment=defconf interface=ether1 learn=no multicast-router=\
    disabled
add bridge=bridge comment=defconf interface=wlan60-1 learn=no \
    multicast-router=disabled
/ip neighbor discovery-settings
set discover-interface-list=none protocol=""
/ip settings
set secure-redirects=no send-redirects=no
/ip address
add address=10.6.1.26/26 interface=mgmt network=10.6.1.0
/ip ipsec policy
set 0 disabled=yes
/ip route
add distance=1 gateway=10.6.1.1
add distance=2 gateway=10.6.1.4
/ip service
set telnet disabled=yes
set ftp disabled=yes
set www port=25480
set api disabled=yes
set winbox disabled=yes
set api-ssl disabled=yes
/ip smb
set allow-guests=no
/routing bfd interface
set [ find default=yes ] disabled=yes
/snmp
set contact=default enabled=yes location=default trap-generators=""
/system clock
set time-zone-name=Asia/Novosibirsk
/system identity
set name=p1-p5-GE
/system logging
set 3 action=memory
add disabled=yes topics=interface
add disabled=yes topics=wireless
add disabled=yes topics=debug,!snmp,!ntp
/system note
set show-at-login=no
/system ntp client
set enabled=yes primary-ntp=10.6.188.1 secondary-ntp=10.6.180.17
/system watchdog
set ping-start-after-boot=30m ping-timeout=10m watch-address=10.6.1.27
/tool sniffer
set filter-interface=wlan60-1 filter-stream=yes streaming-enabled=yes \
    streaming-server=10.6.184.34

# aug/05/2021 08:32:47 by RouterOS 6.49beta54
# software id = 234X-SZMV
#
# model = nRAYG-60ad
# serial number = DB8D0DE03B17
/interface bridge
add admin-mac=08:55:31:D3:98:EF auto-mac=no comment=defconf name=bridge protocol-mode=none
/interface ethernet
set [ find default-name=ether1 ] l2mtu=1600 loop-protect=off
/interface w60g
set [ find ] arp=disabled disabled=no frequency=64800 l2mtu=1600 mode=bridge name=wlan60-1 password=secure_222 put-stations-in-bridge=bridge region=usa ssid=secure_333
/interface w60g station
add arp=disabled mac-address=08:55:31:D3:98:F1 name=wlan60-station-1 parent=wlan60-1 remote-address=08:55:31:D3:9A:65
/interface vlan
add interface=bridge loop-protect=off name=mgmt vlan-id=961
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/queue interface
set wlan60-1 queue=only-hardware-queue
set wlan60-station-1 queue=only-hardware-queue
/routing bgp instance
set default disabled=yes
/snmp community
set [ find default=yes ] name=secure_111
/system logging action
set 3 remote=10.6.185.196
/interface bridge port
add bridge=bridge comment=defconf interface=ether1 learn=no multicast-router=disabled
/ip neighbor discovery-settings
set discover-interface-list=none protocol=""
/ip settings
set secure-redirects=no send-redirects=no
/ip address
add address=10.6.1.27/26 interface=mgmt network=10.6.1.0
/ip route
add distance=1 gateway=10.6.1.4
add distance=2 gateway=10.6.1.1
/ip service
set telnet disabled=yes
set ftp disabled=yes
set www port=25480
set api disabled=yes
set winbox disabled=yes
set api-ssl disabled=yes
/ip smb
set allow-guests=no
/routing bfd interface
set [ find default=yes ] disabled=yes
/snmp
set contact=default enabled=yes location=default trap-generators=""
/system clock
set time-zone-autodetect=no time-zone-name=Asia/Novosibirsk
/system identity
set name=p5-p1-GE
/system logging
set 3 action=memory
add disabled=yes topics=wireless
add disabled=yes topics=interface
/system note
set show-at-login=no
/system ntp client
set enabled=yes primary-ntp=10.6.188.1 secondary-ntp=10.6.180.17
/system watchdog
set ping-start-after-boot=30m ping-timeout=10m
/tool sniffer
set filter-interface=wlan60-station-1 filter-mac-protocol=802.2 streaming-enabled=yes streaming-server=10.6.184.34

Second link is now inaccessible (needs power cycle with 7.x firmware) but config almost same except ip addesses.
Default preconfigured config after reset (with only management vlan added) hangs too.
Link passes only tagged frames, untagged frames disabled by switches on both sides.

On this graph each spike represents device reboot.
image.png

I cant’ see anything strange on your export,
I have 4 links (no one in same pole, 2 near 300m, 1 900m, 1 1200m ) with 6.47.10 (but without “software” vlan) and I do not have any problem till now…

You sure no other operators or hobbyst use same frequency near your?

Absolutely sure that there is no other radio gear close than 200m on any ends of the link, absolutely sure that there is no 60ghz gear closer than 1km at 2 of 3 stations.
Selecting different frequency also does not help.
I think that passing some broadcast/multicast (since there is no proper unicast packets without failed optics) packet brings down links.

How strong is the signal strength?

-52 on 700m link, -59 on 3km.
aligned center or not more than 0.2-0.4degrees

For me, one nRAY constantly loses signals every few seconds. There were also problems with the other nRAY. I tried everything, nothing helps.
Honestly, there is no Mikrotik W60G that would not have been a problem (so far the exception is the Cube60ac, but I think it’s a matter of time).
I am determined not to buy any more Mikrotik antennas. Today I took the warehouse antenna W60G to the customer and offered 1) the customer configures it himself and serves himself 2) we put another manufacturer. The customer stayed at Mikrotik. Accordingly, it is no longer our problem.
Screenshot (388).png

More results:
100% default configuration (reset to defaults with both sides, preconfigured bridge with ip 192.168.88.2 and 192.168.88.3) does not help.
Station hangs/reboots with “router rebooted without proper shutdown”.
When station in hanging state I can reach it via wireless side if I disconnect wired link. Even after enabling wired link theres is no connectivity until reset.

Update:
Updating 7.1rc1 is even more unstable.
Very frequent reboots in 1-2 minutes:
11.png
supout.rif is not informative also:

  uptime: 15s
                  version: 7.1rc1 (testing)
               build-time: Aug/19/2021 10:06:34
         factory-software: 6.46.6
              free-memory: 130.6MiB
             total-memory: 256.0MiB
                cpu-count: 2
                 cpu-load: 7%
           free-hdd-space: 1984.0KiB
          total-hdd-space: 16.0MiB
  write-sect-since-reboot: 46
         write-sect-total: 46
               bad-blocks: 0%
        architecture-name: arm64
               board-name: nRAY 60G
                 platform: MikroTik

CLOCK
                  time: 00:00:14
                  date: jan/02/1970
  time-zone-autodetect: yes
        time-zone-name: manual
            gmt-offset: +00:00
            dst-active: no

IRQs
Columns: IRQ, USERS, CPU, ACTIVE-CPU, COUNT
# IRQ  USERS            CPU   ACTIVE-CPU    COUNT
0   5  d0012000.serial  auto           0       34
1   7  d0010600.spi     auto           1  509 439
2   8  advk-pcie        auto           0      365


CPU
processor	: 0
BogoMIPS	: 25.00
Features	: fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid
CPU implementer	: 0x41
CPU architecture: 8
CPU variant	: 0x0
CPU part	: 0xd03
CPU revision	: 4

processor	: 1
BogoMIPS	: 25.00
Features	: fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid
CPU implementer	: 0x41
CPU architecture: 8
CPU variant	: 0x0
CPU part	: 0xd03
CPU revision	: 4

Are you sure you have not got a power supply fault or a faulty cable?

100% sure. Before nray there was no problems with this cables. Tried diffеrent POE - 24/1a,48/0.5a,56v/1a. Tried POE switch (no errors on port, nray just reboots).
Reboots can avoided by disabling W60G interface or disabling traffic on ethernet or W60G side.

Can you take them back under warranty?

Can you do a screen shot of the Routerboard TAB

Which devices? All four?
I think there is software problem (as hanging only one, station side), warranty will not cover it. Or it does?

Routerboard screenshots for example:
14.png
13.png
Already updated bootloader with beta, was stock in the beginning of testing.

Is it only locking up when you connect to your network?
A few others have had problems with them being unstable and they swapped them for the old version and everything worked fine.

Yes, only when connecting to network.
Is there “old version” for nray? Which version I must request from dealer?

Its not an Nray its the old version LHG60G which most go back too.

I know there is a simular fault on the Ubiquiti 60G causing the units to lockup, its something to do with how the network is setup (routed or bridged).

One of the guys on the ubiquiti site wrote:-
There’s something running out of boundaries, too many ARP-MAC entries, something low on TCP/IP stack due to memory constraints… Definitely, all reports of these problems here on forum have been solved when flat bridged network was changed to routed. All of them.
0

Some customers want VLANs and loading them with tons of MACs inside. What should we do in this situation?

I have asked Lubomirz if he would a look, just waiting to see.