Community discussions

MikroTik App
 
User avatar
Mantic
just joined
Topic Author
Posts: 12
Joined: Fri Jan 24, 2014 5:47 am

CubeSA 60Pro ac: 60Ghz clients flapping

Sat Aug 20, 2022 10:10 pm

We have a new setup of about 15 CubeSA 60Pro AC access points with Cube 60Pro AC client radios and since we installed them, we're getting frequent drops on all 60Ghz clients. We have a simple setup with bonding (for 5Ghz failover) and can't see why this is happening. Any suggestions on where to look? Both AP and CPE are running 7.4.1.

I've tried turning on wireless / info or debug in the logs and aren't getting anything. The client signal strenghts are in the 80's and 90's with an MCS of 8.

AP 60ghz config:
/interface w60g set [ find ] disabled=no frequency=66960 isolate-stations=no name=AP-60Ghz put-stations-in-bridge=bridge region=usa ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=AP-60Ghz slaves=AP-60Ghz,AP-5Ghz 
Client 60ghz config:
/interface w60g set [ find ] disabled=no mode=station-bridge name=wlan60 put-stations-in-bridge=bridge region=usa scan-list=58320,60480,62640,64800,66000,66960 ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=wlan60 slaves=wlan60,wlan1
I mean, it's all pretty vanilla.
20220820 12_45_09.png
20220820 12_44_25.png
You do not have the required permissions to view the files attached to this post.
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Aug 21, 2022 9:59 pm

We have the same problem in multiple places. So problem is in RouterOS. We wait for fix....
 
User avatar
Mantic
just joined
Topic Author
Posts: 12
Joined: Fri Jan 24, 2014 5:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 22, 2022 5:57 pm

We are looking into increasing our vertical separation on several of our APs. What distance are your APs from each other? Ours are about 10" away from each other vertically. We are also considering adding some EM shields on the backs... if that could help.
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 22, 2022 9:19 pm

The problem is not caused by interference. It also happens to us in places where is 1x AP
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Aug 23, 2022 12:55 pm

The same is happening with old 802.11AD devices I think its a driver issue
 
Wolfgang4973
just joined
Posts: 4
Joined: Wed Aug 24, 2022 6:57 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Aug 25, 2022 8:13 pm

I met this problem also , Both AP and client running 6.49.6,I saw large amount of IRQ related with ether net interface. Hope this will be useful to solve this.
You do not have the required permissions to view the files attached to this post.
Last edited by Wolfgang4973 on Fri Aug 26, 2022 9:10 am, edited 1 time in total.
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Aug 26, 2022 6:23 am

We have a new setup of about 15 CubeSA 60Pro AC access points with Cube 60Pro AC client radios and since we installed them, we're getting frequent drops on all 60Ghz clients. We have a simple setup with bonding (for 5Ghz failover) and can't see why this is happening. Any suggestions on where to look? Both AP and CPE are running 7.4.1.

I've tried turning on wireless / info or debug in the logs and aren't getting anything. The client signal strenghts are in the 80's and 90's with an MCS of 8.

AP 60ghz config:
/interface w60g set [ find ] disabled=no frequency=66960 isolate-stations=no name=AP-60Ghz put-stations-in-bridge=bridge region=usa ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=AP-60Ghz slaves=AP-60Ghz,AP-5Ghz 
Client 60ghz config:
/interface w60g set [ find ] disabled=no mode=station-bridge name=wlan60 put-stations-in-bridge=bridge region=usa scan-list=58320,60480,62640,64800,66000,66960 ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=wlan60 slaves=wlan60,wlan1
I mean, it's all pretty vanilla.

20220820 12_45_09.png

20220820 12_44_25.png
Same exact setup and hardware. Same issue :(
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Aug 26, 2022 9:42 am

The same problem with 7.5rc1. Mikrotik are you working on it?
You do not have the required permissions to view the files attached to this post.
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Aug 26, 2022 9:02 pm

Any update on this @Mikrotik? I have purchased quite a bit of these and they are currently useless. @normis
 
Ramik
just joined
Posts: 5
Joined: Mon Aug 29, 2022 5:25 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 29, 2022 5:27 pm

We deployed 2 sectors and 12 Cube60Pro AC's at a fairground for a recent event and had nothing but problems. I ended up having to disable 60Ghz entirely to get them working, and nearly lost the contract for the event while it was going on.

Mikrotik, let's get an answer on this please before I end up returning the entire lot to our distributor.
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 29, 2022 9:58 pm

It seems like it only happens when you pair the CubeSA 60Pro with the multiple Cube 60Pro.

I have swapped out the Cube 60Pro with wAP60 and paired those with CubeSA 60Pro work fine.

I also swapped out the CubeSA 60Pro with wAP 60Gx3 AP and paired those with multiple Cube 60Pro and that worked fine.

I hope there is an update soon...
 
lambert
Long time Member
Long time Member
Posts: 548
Joined: Fri Jul 23, 2010 1:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Aug 30, 2022 9:33 am

Have any of you filed support tickets with MikroTik? They often fail to notice posts like this.

The way to get MikroTik to look at an issue is to file a support request with support@mikrotik.com
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Sep 01, 2022 3:10 pm

Guys
802.11 AD and AY are not TDMA protocols. Maybe thats why it flaps...
a hidden node
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Sep 01, 2022 9:45 pm

Yes. Reported 12/Jul/22 to support. SUP-86857
No sollution yet
 
Wolfgang4973
just joined
Posts: 4
Joined: Wed Aug 24, 2022 6:57 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Sep 02, 2022 4:47 am

Only TCP Stream pass through AP Bridge Ether1 interface can cause this
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Sep 03, 2022 12:01 am

Yup. SUP-91227
 
Wolfgang4973
just joined
Posts: 4
Joined: Wed Aug 24, 2022 6:57 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Sep 03, 2022 9:44 pm

Client's Up&Down are closely related with Ether interface's IRQ , and It seemed that there is no IRQ load Balance , CPU#0 will response All those IRQ, then, CPU #0 reached 100% usage, then, flapping occurred. and I think IRQ Load Balance and IRQ Merge will reduce flapping.
And I also feel puzzled abut why not Ethernet hardware forwarding does not work.
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Sep 15, 2022 11:30 pm

Any update on this? Support sent me an alpha build to test, but it didnt work. Same issue....
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Sep 16, 2022 12:04 pm

Any update on this? Support sent me an alpha build to test, but it didnt work. Same issue....
I can confirm. I'm also testing alpha and it didn't help
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Sep 29, 2022 12:03 pm

@mikrotik.com Any update on this?
 
Ramik
just joined
Posts: 5
Joined: Mon Aug 29, 2022 5:25 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Sep 30, 2022 8:01 pm

I can't comprehend this kind of bug existing since product release (effectively rendering it unusable) and not having a fix for it.
 
Rox169
Member
Member
Posts: 432
Joined: Sat Sep 04, 2021 1:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Sep 30, 2022 10:58 pm

And we are not talking here that hhen you point Cube 60 down, there is big chance to get water inside and break the device.
 
Wolfgang4973
just joined
Posts: 4
Joined: Wed Aug 24, 2022 6:57 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Oct 01, 2022 4:00 pm

Guys, does any one make a try on 7.6beta10 ?
 
bielsteinit
just joined
Posts: 1
Joined: Thu Oct 06, 2022 9:15 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Oct 06, 2022 9:19 am

Having this issue on a brand new deployment of CubeSA as ptmp access point for 6 stations. It's 100% recreatable. If I run an internet speed test from any 60g station the CubeSA immediately drops and re-associates all stations, resulting in service disruption for all stations.

I've updated tonight to new 7.6rc1. Issue unaffected - still 100% reproducable. Going to tower tonight to take this hardware down and replace it. Sad. It's really beautifully constructed. Had high hopes for it.

Only thing we found to prevent it was to go power down all but one station. When only one is connected it's completely solved, reliably, over many tests. Reconnect the other stations again so it's now having to do point to multipoint? 100% reproducable again.

Odd because on the previous series APx3 and even the original cubes upgraded to level 4 license to act as ptmp access point we can run huge loads with complete stability no problem.

Sent our support file into mikrotik. SUP-94299
 
Bomber67
Member
Member
Posts: 383
Joined: Wed Nov 08, 2006 10:36 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Oct 11, 2022 7:16 am

AP 60ghz config:
/interface w60g set [ find ] disabled=no frequency=66960 isolate-stations=no name=AP-60Ghz put-stations-in-bridge=bridge region=usa ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=AP-60Ghz slaves=AP-60Ghz,AP-5Ghz 
Client 60ghz config:
/interface w60g set [ find ] disabled=no mode=station-bridge name=wlan60 put-stations-in-bridge=bridge region=usa scan-list=58320,60480,62640,64800,66000,66960 ssid=myap
/interface bonding add mode=active-backup name=bond1 primary=wlan60 slaves=wlan60,wlan1
Not directly related to your problem:
I see that your config includes bonding of the 60G interface itself, I didn't know I could do it that way?
In the default setup for the preconfigured Cube 60 kit the station interface is included as both primary and slave in the bonding.
As station interfaces are added dynamically as new clients connect, I thought I could not use bonding, and resorted to an RSTP bridge on both sides instead.

I guess detecting broken 60G on the client side is easy for the bonding, but with this way of doing it, what will make the AP side switch to 5G? One client disappearing does not necessary mean that they all leave?
Last edited by Bomber67 on Tue Oct 11, 2022 7:44 am, edited 1 time in total.
 
Bomber67
Member
Member
Posts: 383
Joined: Wed Nov 08, 2006 10:36 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Oct 11, 2022 7:42 am

Not directly related to your problem:
I see that your config includes bonding of the 60G interface itself, I didn't know I could do it that way?
In the default setup for the preconfigured Cube 60 kit the station interface is included as both primary and slave in the bonding.
As station interfaces are added dynamically as new clients connect, I thought I could not use bonding, and resorted to an RSTP bridge on both sides instead.

I guess detecting broken 60G on the client side is easy for the bonding, but with this way of doing it, what will make the AP side switch to 5G? One client disappearing does not necessary mean that they all leave?
Gave your way of doing it a try now.
Appears to me that all the failover functionality is taken care of by the client side; when disabling the 60G-interface on either side, the client side bonding instantly switches 5G to active port and 60G to inactive, when re-enabling 60G it switches back.
On the AP side the 60G interface is permanently rendered as inactive port and 5G as active, it does not react to the 60G being disabled or enabled.
Disabling 5G however makes it swap active and inactive ports, but that does not do anything to the client side, which is happy with its 60G connection...

For the time being I have not yet tested with serveral clients using this setup.
But my question is:
In a PtMP setup, what is the advantage of using bonding in favour of RSTP bridges?
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed Oct 26, 2022 10:09 pm

@mikrotik any news on this? Hook us up already? It's been months without a solution on a new product that failed to work as advertised.
 
TragedyMan
just joined
Posts: 1
Joined: Tue Nov 01, 2022 6:15 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Nov 01, 2022 6:18 pm

I have the same problem... When I try Btest between client and AP from client side... Recieve is OK.... Send = link down... no data.. AP sometimes freeze, only power recycle helps. FW 7.6

But I see the problem.. The wireless Phy rate was >3Gbps ..then it's always link down and up.. When we change direction, the quality drops under 2.5 Gbps... everything stable...

Can be the Phy rate set manually ?
Last edited by TragedyMan on Tue Nov 01, 2022 9:34 pm, edited 1 time in total.
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Nov 03, 2022 2:59 am

Can they be downgraded to ROSv6? I havn't tried the CubeSA yet, but found with other 60ghz mikrotik products that its quite stable with 6.49.6

Other things to think of...
/int w60g set 0 mgmt-fix=yes
Can try that on the AP, no idea if its supported with the CubeSA products. Not even entirely sure what it does, but noticed an improvement in stability on a wap60gx3
My guesstimate is it duplicates certain management traffic frames across all clients, as I noticed all clients have more traffic instead of all sitting idle except those that are actively transmitting

Get rid of the bonding interface? Try with just 60ghz
If that works it would be possible to use an isolated OSPF+BFD instance between AP and all SM's for failover, instead of using bonding interface
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Nov 08, 2022 12:16 am

Anyone get any luck on this front since @mikrotik says they can't replicate the issue....

I have all this gear and can't use it. My bosses are like WTF you going to do with all this gear....
 
Ramik
just joined
Posts: 5
Joined: Mon Aug 29, 2022 5:25 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Nov 14, 2022 1:45 am

If Mikrotik says it can't replicate the issue then let's see a youtube video from them on how to get it working - our engineers (who also happen to be 'tik instructors) have spent days trying to get it working without any luck.
 
tberg
Frequent Visitor
Frequent Visitor
Posts: 61
Joined: Sun Sep 22, 2013 6:34 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Nov 26, 2022 7:39 pm

Has anyone who opened a support ticket received any updates on this issue? It was pretty easy to replicate in a lab with 3 CubeSA 60Pros on 6.49.6. 1 in AP Bridge mode and the other 2 station bridges. Within 10-20 seconds after initiating a speed test from the AP to 1 of the stations, the other station drops for a few seconds then comes back up. I don't have any bonding configured and 5 GHz interfaces are disabled. Also, set 0 mdmg-fix=yes did not make any difference.

I was hoping to use these in multipoint mode, but I guess I'll have to come up with another plan. Glad I saw this before deploying.
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Nov 27, 2022 8:41 pm

I have several tickets open. From the beginning, Mikrotik trying to help - communication. Now silence and no solution. Same as here on the forum.
I don't know why, but Mikrotik often chooses the tactic of silence :-( I don't know why, but it's not good for this new products - could say "flagships"

@Mikrotik can you coment it?
 
mlicko
just joined
Posts: 2
Joined: Sun Jan 27, 2013 4:29 am
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed Dec 07, 2022 5:05 pm

I have the same problem. From 6.49.6 to 7.6. Twenty times every day. 1x CubeSA 60Pro ac + 5x Cube 60Pro ac....
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Dec 10, 2022 6:08 am

This "flapping" happens not only with AY devices, AD devices also have such problem, but please read logs, drops are usually a second or less, you hardly mention that.
Don't forget it's not an TDMA protocol, it might have a hidden node problem, or other 802.11/FDMA issues
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Dec 10, 2022 6:12 am

Also it may be an beam-forming problem. Client tries to find a better sector and looses connection. Set it manual maybe it will help
Mikrotik 60 Ghz devices are great
thank you guys
your Siberian fan
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Dec 12, 2022 10:37 am

Mikrotik 60 Ghz devices are great
thank you guys
your Siberian fan
You can't say they are great when they just flat out have problems
My biggest gripe is MikroTik has done NOTHING in actually educating the community on the ins and outs of their 60ghz products, nor how to use them properly
It's frustrating because I know for a fact they can be made to work good, but you have to fight your way there. It took me a long time to finally understand the LHG60 products, now I finally know how to install and use them properly and exactly what is realistic and what isn't. And am almost there with the Cube60 PTP setups

MikroTik could easily fill people in and bring them up to speed with a single wiki page, but they don't. And every bit of information i've been given my MikroTik reps on this forum has been blatantly wrong, and i've proven them wrong (to which they just go silent). It's frankly bullshit, makes it seem like they have absolutely NFI about their own product
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Dec 12, 2022 2:04 pm


My biggest gripe is MikroTik has done NOTHING in actually educating the community on the ins and outs of their 60ghz products, nor how to use them properly
Totally agree with that
 
server8
Long time Member
Long time Member
Posts: 592
Joined: Fri Apr 22, 2011 1:27 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Dec 12, 2022 6:55 pm


My biggest gripe is MikroTik has done NOTHING in actually educating the community on the ins and outs of their 60ghz products, nor how to use them properly
Totally agree with that
We read on the forum that a lot of new Mikrotik product has problem flaghsip included, when it can't be resolved they go silent!! I have several CCR2004 on the shelf
 
User avatar
maks750i
newbie
Posts: 30
Joined: Tue Feb 19, 2013 11:18 pm
Location: Serbia Nis
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Dec 15, 2022 9:11 pm

is problem solved @normis or sombody from mikrotik ?
All ARM devices have some problems.
Mipsbe,mmips,tile are better product and very stable
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Dec 16, 2022 4:13 am

is problem solved @normis or sombody from mikrotik ?
All ARM devices have some problems.
Mipsbe,mmips,tile are better product and very stable
ALL 60 GHz devices have this problem. It is not an ARM-thing
 
Ivoshiee
Member
Member
Posts: 483
Joined: Sat May 06, 2006 4:11 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Dec 23, 2022 9:44 am

Does that issue trigger 5GHz failover and is able to soften the blow?
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Jan 16, 2023 9:26 pm

AP 7.7, clients 7.7 and problem is still here. Does anyone have a solution?
You do not have the required permissions to view the files attached to this post.
 
mlicko
just joined
Posts: 2
Joined: Sun Jan 27, 2013 4:29 am
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Jan 16, 2023 9:48 pm

Does that issue trigger 5GHz failover and is able to soften the blow?
Dropout is from 1 to 5 seconds 20-30 times a day regardless of configuration and system version, even without bonding, 60GHz only. 5 clients Cube60 Pro ac. Clients distance between 50-70 meters.
You do not have the required permissions to view the files attached to this post.
 
User avatar
osc86
Member Candidate
Member Candidate
Posts: 197
Joined: Wed Aug 09, 2017 1:15 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Jan 16, 2023 10:25 pm

ALL 60 GHz devices have this problem. It is not an ARM-thing
I can only speak for a pair of Cube 60G ac we use, but they run pretty stable, just upgraded them to 7.7 a few days ago.
2023-01-16 at 21.21.13.png
You do not have the required permissions to view the files attached to this post.
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Feb 06, 2023 8:19 pm

The problem also occurs with the latest 7.8beta. So it's not fixed yet. :?
Mikrotik has a ticket with a video on how to simulate the problem. So I hope it will be fixed soon
 
User avatar
Mantic
just joined
Topic Author
Posts: 12
Joined: Fri Jan 24, 2014 5:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Feb 07, 2023 12:04 am

ALL 60 GHz devices have this problem. It is not an ARM-thing
I can only speak for a pair of Cube 60G ac we use, but they run pretty stable, just upgraded them to 7.7 a few days ago.
2023-01-16 at 21.21.13.png
It seems to happen when you have 2+ clients on a cube. I just had an AP + 1 client where it never happened, then as soon as I added a second client, it all started again. These are all on 7.7.
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Feb 07, 2023 6:53 am

Earlier a few people said "all 60GHz products".

I have roughly 150 or so 802.11ad radios on the air and they have been solid since 6.48.6 and all 6.49 releases. I have zero Cube60 SA's; my AP's are all wAP 60's or Cube60's. All the 802.11ad radios work fine as CPE, and I have roughly 10 Cube 60 Pro's (802.11ay) as CPE too, with no complaints.

It would appear the common thread for those with problems are the 802.11ay Cube 60 SA AP's.
 
Rox169
Member
Member
Posts: 432
Joined: Sat Sep 04, 2021 1:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Feb 07, 2023 8:26 am

Hi,

what clients do you have on 10 Cube 60 Pro's? Only AY or even AD?
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Feb 07, 2023 10:17 am

It doesn't matter what clients you use. We have a sector where there are only AD clients and it disconnects them. Then we have another sector where there are only AY clients and it disconnects them. As mentioned above - a common problem is CubePro-SA
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Feb 14, 2023 11:58 am

Latest 7.8rc1 on Cube-SA and also 7.8rc1 on all clients. Problem is still there. Reported several times to support.
@mikrotik.com Are you working on a repair or should we choose another 60Ghz multipoint manufacturer?
You do not have the required permissions to view the files attached to this post.
 
kabrutus
just joined
Posts: 17
Joined: Mon Nov 10, 2014 7:49 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed Feb 15, 2023 2:30 am

sucks, i bought a bunch of these in September.... can't even use them. :cry:
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed Feb 15, 2023 5:28 am

Are you working on a repair or should we choose another 60Ghz multipoint manufacturer?
What manufacture at that cost? Do not use Cube-SA as it's mentioned above.
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed Feb 15, 2023 9:12 pm

Do not use Cube-SA as it's mentioned above.
WAP60G also does not understand with CubePRO clients. So what to use as a sector?
What manufacture at that cost? Do not use Cube-SA as it's mentioned above.
Not in this price range, but at least it will work.
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Feb 16, 2023 8:41 am

Do not use Cube-SA as it's mentioned above.
WAP60G also does not understand with CubePRO clients. So what to use as a sector?
What manufacture at that cost? Do not use Cube-SA as it's mentioned above.
Not in this price range, but at least it will work.
sirbryan says that WAP60G works fine with cube pro
Or try using Cube pro as an AP
 
kbatke
just joined
Posts: 1
Joined: Fri Feb 17, 2023 9:53 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Feb 17, 2023 9:56 pm

We're seeing the exact same thing with all 60ghz mikrotik products. hot garbage, do not buy, return if you can. No reply what so ever from Mikrotik with issues.
 
DeDMorozzzz
Frequent Visitor
Frequent Visitor
Posts: 81
Joined: Tue Aug 22, 2017 7:09 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Feb 19, 2023 2:44 am

We're seeing the exact same thing with all 60ghz mikrotik products. hot garbage, do not buy, return if you can. No reply what so ever from Mikrotik with issues.
we are seeing that 60GHz is great
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Feb 19, 2023 5:13 am

We're seeing the exact same thing with all 60ghz mikrotik products. hot garbage, do not buy, return if you can. No reply what so ever from Mikrotik with issues.
Rubbish, in multipoint they are a bit meh but in point-to-point setups they are AWESOME. Just cannot be beaten for anywhere close to the money, stupid performance, seemingly little to no impact from having multiple products on the exact same frequency on the same pole, the gigabit port is the limiting factor

Just have to dial the expectations back, sub 1km for heavy rain (will still drop briefly as it hits), sub 700m if you don't want any downtime at all. Mount them rigidly not on a flimsy TV antenna

Multipoint works, but set the expectation of speeds you'd otherwise never see at the price of the occasional drop-out. Keep your distances under 350m, ideally under 200m
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Mar 13, 2023 10:16 am

I try 7.8 and the problem is still there. (1x AP Pro and 2x AD client or 1x AP Pro and 1x AD and 1x Pro client)
I observed that when the traffic on the clients is below 200M, it does not happen, or only at a minimum.
Once the traffic exceeds 250M, it starts to drop in a big way.

Is anyone from Mikorotik working on a solution?

Thanx
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Mar 13, 2023 9:58 pm

Yes. With 7.8 the same problem. No solution.

What's worse, support stopped answering questions. https://mikrotik.com/support.

I described a way how to simulate the problem. No reaction, no response from support.
I really do not know :( :(
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Mar 14, 2023 8:55 am

A strange thing happened to me.
I tried to turn on "Isolate stations" on the AP (CubeSA Pro) and this stopped happening with high traffic.
Then I turned off "Isolate stations" again and it still doesn't happen.
So far, I have tried it on a test in the lab and on one operating transmitter.
Can anyone else try this? Maybe it's a coincidence.
Thanx
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Mar 14, 2023 5:11 pm

What is working for me:

As AP's:
- wAP 60
- wAP 60 180
- Cube 60G

At close range, despite their 60° pattern, wAP 60's mounted to a round mast almost act like they have a 180° pattern. I have one customer with a Cube 60 90° to the side of the wAP 60 at 200m and it's working great.

On the flip side, wAP 60 180's do not work with metal behind them. The two I have in production are mounted to plastic masts or have the top 1.5" (30mm) of the radio extended above the mast.

Cube 60 G's and Cube Pro's are a good option as AP if you want more range and a narrower sector.

I do not have any Cube SA's.

As CPE:
- wAP 60 (≤180m)
- Cube Lite (≤400m)
- Cube 60 G (≤400m)
- Cube Pro (≤400m)
- LHG 60 Light (≤700m)
- LHG 60 G (≤700m)

Settings on AP:
- Every AP on its own frequency; also ensure backhauls are on different channels
- All radios in the parent bridge
- Enable client Isolation
- It's simpler to manage VLAN filtering at the CPE than it is on the AP

I limit it to at three AP's per site (mast); with some shielding, you could probably get some ABC/ABC/ABC reuse around a larger installation. I also use AF60/AF60LR/AF60XR for backhaul as much as possible, with 65880-68040 for backhaul and 58320-64800 for serving customers.

An OmniTik PoE AC is both an excellent POE switch for the AP's as well as a backup (rain fade) AP for dual-band Cubes. Use bonding (active/passive) on the Cube, and make sure whatever VLANs you put on the wAP's are also on the OmniTiks' wlan interface.

On all 60GHz gear:
- 58320 and 64800 are best for up to 600-700m PTMP, 1km PTP
- 60480 and 62640 are OK up to about 300m PTMP, 500-600m PTP (your experience may vary)
- 6.49.x versions are the most stable
- 7.6+ looks promising (testing it on three Cube 60's)

I have dozens of wAP 60's and Cube 60's as AP's, with anywhere from 2 to 8 CPE on each one. Many of them will drop and reconnect within a split second, but nobody notices those drops. It's the ones that last longer than a couple seconds, or when they're really frequent. Sometimes a channel change is all that's needed.
 
syadnom
Forum Veteran
Forum Veteran
Posts: 794
Joined: Thu Jan 27, 2011 7:29 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Mar 25, 2023 9:02 pm

I'm imagining no progress on this? Is there are Cube Pro ('ay) firmware and settings that is stable PtMP?
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Mar 26, 2023 1:40 am

I seem to have a slightly different issue, only recently have I used the newer cube60 pro radio's in a multipoint setup (all radio's are the cube60 pro's, not the cube60sa) and it seems the AP soft locks, it responds to pings but you can't log into it, winbox shows no content, no interfaces etc. and data does not flow
OR it will respond and work but the 60ghz clients are connected (at least according to the AP, couldn't check the SM side) but no traffic flows across. They do not appear in neighbors etc. Log shows the odd authentication failed message but its not very frequent.
Do not have to restart the SM's at all, just power cycle the AP and everything reconnects and works again
This happens every few days, and it only happens when the AP is used as a multipoint to connect to more than 1 SM. In a PTP situation its fine. Doesn't happen with the older 60ghz products
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Mar 31, 2023 9:45 am

We have potential fix for PtMP issues. We are still testing, but it should be ready in next beta releases.
 
Rox169
Member
Member
Posts: 432
Joined: Sat Sep 04, 2021 1:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Mar 31, 2023 10:16 am

Goood...... in the end I will may buy the new CubeG-5ac60ay-SA :) I have been waitng over a year :)
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Mar 31, 2023 11:40 am

Fix should improve stability to 802.11ad line as well. Unfortunately we will not have it ready to next stable release cycle.
 
Rox169
Member
Member
Posts: 432
Joined: Sat Sep 04, 2021 1:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Mar 31, 2023 12:14 pm

Thats great... I have few of those :) Thank you
 
Gu475v
just joined
Posts: 3
Joined: Tue Mar 20, 2018 9:57 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Mar 31, 2023 3:56 pm

Looks like PTMP fix is working as intended. Testing it for 1 hour now with nonstop bandwidth tests from clients and without any client drop! Looking for ASAP inclusion in any stable version. Thanks.
 
syadnom
Forum Veteran
Forum Veteran
Posts: 794
Joined: Thu Jan 27, 2011 7:29 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Apr 01, 2023 1:14 am

awesome, looking forward to release.
 
spikycactus524
just joined
Posts: 1
Joined: Sun Apr 02, 2023 8:35 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Apr 04, 2023 2:03 am

Has anyone had any throughput issues with PtMP? I have the 2x CubeSA 60Pro with either Cube60G or Cube60Pro clients (One SA has all 60G, other has all 60Pro).
All clients are within 200m and have decent signal/MCS levels. 5GHz is disabled on all units.

When there is one subscriber connected I can easily saturate the 200mbps WAN connection, with 2 client speeds drop down, often <20mbps.
Looking at peak load last night there was approx 60mbps going over the AP, which was enough to cause regular disconnections of all clients. This is also below the normal peak load of the site.
Currently on 6.49.6 but have also tested up 7.8 and 7.9rc1 with the same results. Also tested using a Cube60G as the Access Point with the same results (but did not test long enough to see if disconnections were occuring.

Btest between AP and Clients still shows 600mbps TCP but over WAN shows 20-40mbits.
Btest over WAN to AP shows 150+
Btest over WAN to client (multiple clients connected) show 20-40
Btest over WAN to client (single client connected) shows 150+
Similar results with speedtest.net from directly connected laptop

Edit 12/4: Upon further investigation we suspect that the 30-40ms jitter when multiple clients are connected is causing a significant hit to TCP performance. No resolution as yet.
Last edited by spikycactus524 on Wed Apr 12, 2023 7:37 am, edited 1 time in total.
 
tetecko
Frequent Visitor
Frequent Visitor
Posts: 72
Joined: Sun Jun 11, 2006 7:44 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Apr 06, 2023 12:09 am

yes! same here...
Has anyone had any throughput issues with PtMP? I have the 2x CubeSA 60Pro with either Cube60G or Cube60Pro clients (One SA has all 60G, other has all 60Pro).
All clients are within 200m and have decent signal/MCS levels. 5GHz is disabled on all units.

When there is one subscriber connected I can easily saturate the 200mbps WAN connection, with 2 client speeds drop down, often <20mbps.
Looking at peak load last night there was approx 60mbps going over the AP, which was enough to cause regular disconnections of all clients. This is also below the normal peak load of the site.
Currently on 6.49.6 but have also tested up 7.8 and 7.9rc1 with the same results. Also tested using a Cube60G as the Access Point with the same results (but did not test long enough to see if disconnections were occuring.

Btest between AP and Clients still shows 600mbps TCP but over WAN shows 20-40mbits.
Btest over WAN to AP shows 150+
Btest over WAN to client (multiple clients connected) show 20-40
Btest over WAN to client (single client connected) shows 150+
Similar results with speedtest.net from directly connected laptop
 
jellex
just joined
Posts: 20
Joined: Tue Mar 12, 2019 10:32 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Apr 07, 2023 12:09 pm

We have potential fix for PtMP issues. We are still testing, but it should be ready in next beta releases.
Hi, which beta can I test for more stable w60g ptmp? I have a lot of trouble stabilizing wap60gx3 with three Cube60gAC attached. Using fw 6.49. Thanks!
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Apr 07, 2023 4:16 pm

Hi, which beta can I test for more stable w60g ptmp? I have a lot of trouble stabilizing wap60gx3 with three Cube60gAC attached. Using fw 6.49. Thanks!
How is your wAP60gx3 mounted? I found they don't work when mounted on a metal pipe/mast/pole/wall. The signal leaks out through the back enough that it causes major reflections.

If you mount it on a plastic pipe or standoff, or lift the top of the AP above the top of the metal, it will work much better. The trick on those is to get the the upper 1"/250mm (where the patch antennas are) away from reflective material.

There is also a command line setting for those (forgot what it is) that's supposed to help with stabilization; it's in the help pages for 60GHz and on the forum.
 
syadnom
Forum Veteran
Forum Veteran
Posts: 794
Joined: Thu Jan 27, 2011 7:29 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Apr 07, 2023 7:16 pm

How is your wAP60gx3 mounted? I found they don't work when mounted on a metal pipe/mast/pole/wall. The signal leaks out through the back enough that it causes major reflections.

If you mount it on a plastic pipe or standoff, or lift the top of the AP above the top of the metal, it will work much better. The trick on those is to get the the upper 1"/250mm (where the patch antennas are) away from reflective material.

There is also a command line setting for those (forgot what it is) that's supposed to help with stabilization; it's in the help pages for 60GHz and on the forum.
Use the QME/QMP mount for the wAP shaped devices. Put the included metal bracket right up flust with the top of the mount so the top of the wAP is above it when it's clicked into the bracket. This is dramatically better than direct to a pole of any kind, even a wood pole. Noticed the issue putting the top of the AP flat with a j-arm, move it up 3" and it gets a ton better.
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Apr 07, 2023 8:29 pm

Use the QME/QMP mount for the wAP shaped devices. Put the included metal bracket right up flust with the top of the mount so the top of the wAP is above it when it's clicked into the bracket. This is dramatically better than direct to a pole of any kind, even a wood pole. Noticed the issue putting the top of the AP flat with a j-arm, move it up 3" and it gets a ton better.
I have a bunch of 60° wAP 60's on various mounts, and they all work fine, metallic or not. As a matter of fact, I have one Cube 60 at 200m+ to the left of one wAP 60 (-270° if front of AP is 0°) attached to a metal J-Arm, and it works beautifully. In that case, it's as if the J-Arm is actually helping the patch. At another site, I have two AP's on a single mast (I think it's EMT), one facing west and one facing north, with the same SSID and 8 customers spread out across them, all within 400m. They all switch between the two as atmospheric conditions change. Those antennas work better (worse?) than they should.

I didn't notice a problem initially when swapping a couple of 60°'s for 180° x3's because the ones I swapped were all on non-metallic conduit. It wasn't until I put one on a pipe that things went south and I figured out what the issue was. Resolution there was the QMP, as you stated.
 
jellex
just joined
Posts: 20
Joined: Tue Mar 12, 2019 10:32 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Apr 08, 2023 8:48 am

How is your wAP60gx3 mounted? I found they don't work when mounted on a metal pipe/mast/pole/wall. The signal leaks out through the back enough that it causes major reflections.

If you mount it on a plastic pipe or standoff, or lift the top of the AP above the top of the metal, it will work much better. The trick on those is to get the the upper 1"/250mm (where the patch antennas are) away from reflective material.

There is also a command line setting for those (forgot what it is) that's supposed to help with stabilization; it's in the help pages for 60GHz and on the forum.
Thanks. That must be the issue then. It's mounted on a small metal mount which is attached to a metal fence behind it. Much metal reflection behind it.

Would there be a good material which i can put behind the AP to prevent reflection? Something like a wooden plate?
I might have an option to mount it on a brick wall (with the QMP) would that be sufficient?

(I'll have some photos later this weekend)
 
syadnom
Forum Veteran
Forum Veteran
Posts: 794
Joined: Thu Jan 27, 2011 7:29 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat Apr 08, 2023 7:40 pm

Would there be a good material which i can put behind the AP to prevent reflection? Something like a wooden plate?
I might have an option to mount it on a brick wall (with the QMP) would that be sufficient?
(I'll have some photos later this weekend)
Make more space. That's the best solution. If you have to have it against something, make sure that it's a flat surface. A round pipe is a convex reflector, think about eyeglass lenses, that bends and distorts the signal and more specifically, if a radio can see a round pole, it WILL reflect back at it. Round shapes always have a fact that will reflect back. A flat surface will having things bounce off at an equal but opposite angle.
 
jellex
just joined
Posts: 20
Joined: Tue Mar 12, 2019 10:32 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Apr 09, 2023 3:37 pm

So, since I don't have the QMP yet, I've tried this first. As you can see, first it was mounted below with the fence behind it. Now I've mounted it higher, but still with some metal pole behind it.
First impression and tests are positive. Tested it with real throughput (+- 150mbit) and everything is stable for now. I had 1 to 10% loss on an active link before. Now it stays at 0% and no links down. But... it was only my first test and no offices open today. I'll keep an eye on it and figure out a plan to mount it even better later on.
Image

ps: Setting I had set before, but didn't help out:
- static sector (/in w60g set 0 tx-sector=36)
- mdmg-fix ON (/interface w60g set wlan60-1 mdmg-fix=yes)
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Apr 10, 2023 9:07 pm

Looks good. The only thing I'd personally do is to bolt the radio higher up on the tilt mount so there's zero metal behind the patches (the top inch or two).

I've never locked the sectors on any radios. And I likewise haven't noticed any difference with mdmg fix enabled.
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Apr 11, 2023 3:26 pm

Next beta (after RC and stable) release, should address some of x3 issues as well. Hopefully mdmg-fix could be switched to off onward.
 
User avatar
damadmai
just joined
Posts: 6
Joined: Fri Nov 01, 2019 11:54 pm
Location: Vienna, Austria
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Apr 18, 2023 1:18 am

do you mean version 7.10 or will it be included already in 7.9?
 
Rox169
Member
Member
Posts: 432
Joined: Sat Sep 04, 2021 1:47 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Apr 18, 2023 9:16 am

think guys.... 7.9 is already RC, it will not became beta again......
 
jellex
just joined
Posts: 20
Joined: Tue Mar 12, 2019 10:32 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Apr 23, 2023 8:56 am

Hi,
Small update on the progress of moving the AP upwards (see picture above)

The link hasn't been down even once the past two weeks! The reflection definitely was to blame and your solutions have solved a lot of trouble for me. Thanks!
 
vecino
just joined
Posts: 7
Joined: Fri Jul 08, 2016 11:59 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sun Apr 30, 2023 8:21 pm

@MikroTik Support Please release a working version as soon as possible. Customers complain to us that their online streams/games etc are interrupted. We don't have a workable solution for them.
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed May 03, 2023 1:07 pm

We updated to the latest RC a couple weeks ago and the AP's stopped soft locking
However there's still an issue, not sure if its always been there (I would say so) but we have only just recently narrowed it down to being replicate able

Using 3x Cube60Pro AC's in a multipoint setup, when I run mikrotik btest across them absolutely no issues at all holding a solid 2gbit/s in either direction
However when the client behind one of the SM's runs a test from speedtest.net it will cause 'both' SM's to disconnect from the AP
The download test is fine, its always the upload test that does it. It's 100% repeatable that it will cause both SM's to disconnect after approx 3 seconds on the upload test (which is about 400mbit/s at the time, well below what the radio link can do)

When I kick off 1 of the SM's and run it in PTP mode, no issues at all it'll stay connected
Am currently on the latest 7.9rc5 on all radio's. As long as no one attempts to upload at a high speed then its fine it'll stay connected, but very quickly after that the SM's disconnect. Isolate-stations is turned on so traffic is not bleeding between SM's
Have tried all the frequencies, makes no difference so its highly unlikely to be a neighboring interference issue
Unless the SM running the speed test is causing interference on the other SM that is in-line with it, and that somehow signals to the AP to kick the session
But its looking like this is a bug
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Wed May 10, 2023 11:18 am

fix is there:

7.10beta5
*) w60g - improved interface stability for PTMP setups;
 
vecino
just joined
Posts: 7
Joined: Fri Jul 08, 2016 11:59 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu May 11, 2023 5:57 pm

Have you seen any noticeable improvement? Are all clients still being disconnected (7.10beta5)?
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu May 18, 2023 2:53 am

The latest 7.10beta5 appears to have fixed the issue I was having, can now run upload tests from client side without causing radio disconnections. Note that importantly it never disconnected with a mikrotik btest, it was only specific types of traffic
Note also that you only need to update the AP and not the SM for the fix to take effect. So the issue was definitely AP specific

I would like to hear from MikroTik support in some technical detail as to what they suspect the issue was, and what specifically was implemented to fix it
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu May 18, 2023 12:36 pm

You're unlikely to get that kind of detail. It's most likely some kind of driver update or tweak at a really low level.

I loaded it on some of my lightly-loaded AP's a couple hours ago and so far haven't seen the same kind of split-second disconnects I'm used to seeing. So now I'm loading it up across the network on busier AP's to see how it does.
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu May 25, 2023 1:01 pm

Could we please get a bit more feedback before we include this fix in upcoming stable version? Thanks!
 
User avatar
honzam
Forum Guru
Forum Guru
Posts: 2394
Joined: Wed Feb 27, 2008 10:27 pm
Location: Czech Republic

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu May 25, 2023 9:03 pm

Tested on many sectors. It's much better than it was.
But the problem is not completely eliminated.
 
vecino
just joined
Posts: 7
Joined: Fri Jul 08, 2016 11:59 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri May 26, 2023 1:59 pm

Yes I agree with the opinion above. It's much better - the disconnections don't happen as often, but they do occasionally. If you tweak it even more like 802.11ad, that would be fine.
 
User avatar
sirbryan
Member Candidate
Member Candidate
Posts: 298
Joined: Fri May 29, 2020 6:40 pm
Location: Utah
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Sat May 27, 2023 1:06 pm

@antonsb It would be nice to know why they dropped, if that's possible to glean from the driver (example: signal too weak, stopped transmitting, too many errors, etc.). Perhaps the AP and/or the station could also log the last known signal level as they leave.

I have loaded this onto a number of wAP 60's and, in some cases, things appear better (less flapping). In other locations, it looks like it did before: stations going away for a second or so at a time, then coming back.

We've had pretty regular afternoon thundershowers these past two weeks, and I don't know if some of the stations have dropped due to low signal from rain fade, or something else (power outages, reboots, etc.).
 
vecino
just joined
Posts: 7
Joined: Fri Jul 08, 2016 11:59 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Jun 01, 2023 8:40 pm

What are your PMTP pings from AP to CPE?

For me they are in the range of 1 - 10ms. That seems like a lot to me. When only one client is connected, they are around 1ms all the time. I understand that there is some extra overhead with multiple clients, but by that much?
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Jun 13, 2023 5:16 pm

We will have additional fixes for 802.11ay devices in upcoming beta versions.
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Thu Jun 29, 2023 9:55 am

Hi, i try 7.11b2, problem still here. 3x nRay client.
Compared to version 7.10, the client is no longer permanently disconnected until the AP is restarted.
In version 7.10, the client was sometimes permanently disconnected.

LOG :
06-25 09:23:09 interface,info wlan60-station-1: link down
06-25 09:23:09 interface,info wlan60-station-2: link down
06-25 09:23:31 interface,info : link down
06-25 09:23:31 interface,info wlan60-station-2: link up
06-25 09:23:32 interface,info wlan60-station-1: link up
06-25 11:08:06 interface,info wlan60-station-1: link down
06-25 11:08:06 interface,info wlan60-station-2: link down
06-25 11:08:09 interface,info wlan60-station-1: link up
06-25 11:08:09 interface,info wlan60-station-1: link down
06-25 11:08:13 interface,info wlan60-station-1: link up
06-25 11:08:30 interface,info wlan60-station-2: link up
06-25 12:34:53 interface,info wlan60-station-3: link down
06-25 12:34:53 interface,info wlan60-station-2: link down
06-25 12:34:54 interface,info : link down
06-25 12:34:54 interface,info wlan60-station-2: link up
06-25 12:34:54 interface,info wlan60-station-3: link up
06-25 12:34:58 interface,info wlan60-station-3: link down
06-25 12:34:59 interface,info wlan60-station-3: link up
06-25 12:35:02 interface,info wlan60-station-3: link down
06-25 12:35:04 interface,info wlan60-station-1: link down
06-25 12:35:04 interface,info wlan60-station-2: link down
06-25 12:35:07 interface,info wlan60-station-3: link up
06-25 12:35:15 interface,info wlan60-station-2: link up
06-25 12:35:15 interface,info wlan60-station-2: link down
06-25 12:35:15 interface,info wlan60-station-1: link up
06-25 12:35:38 interface,info wlan60-station-2: link up
06-25 12:35:41 interface,info wlan60-station-2: link down
06-25 12:35:41 interface,info wlan60-station-3: link down
06-25 12:35:42 interface,info wlan60-station-1: link down
06-25 12:35:46 interface,info wlan60-station-3: link up
06-25 12:35:46 interface,info wlan60-station-2: link up
06-25 12:35:50 interface,info wlan60-station-2: link down
06-25 12:35:53 interface,info wlan60-station-1: link up
06-25 12:36:03 interface,info wlan60-station-2: link up
06-25 13:34:01 interface,info wlan60-station-2: link down
06-25 13:34:15 interface,info wlan60-station-2: link up
06-25 13:34:15 interface,info wlan60-station-2: link down
06-25 13:34:23 interface,info wlan60-station-2: link up
06-25 15:26:55 interface,info wlan60-station-2: link down
06-25 15:26:55 interface,info wlan60-station-1: link down
06-25 15:26:57 interface,info wlan60-station-3: link down
06-25 15:27:00 interface,info wlan60-station-2: link up
06-25 15:27:00 interface,info wlan60-station-3: link up
06-25 15:27:06 interface,info wlan60-station-1: link up
06-25 15:27:09 interface,info wlan60-station-1: link down
06-25 15:27:09 interface,info wlan60-station-2: link down
06-25 15:27:10 interface,info wlan60-station-3: link down
06-25 15:27:27 interface,info wlan60-station-2: link up
06-25 15:27:27 interface,info wlan60-station-1: link up
06-25 15:27:30 interface,info wlan60-station-1: link down
06-25 15:27:30 interface,info wlan60-station-3: link up
06-25 15:27:34 interface,info wlan60-station-3: link down
06-25 15:27:36 interface,info wlan60-station-3: link up
06-25 15:27:39 interface,info wlan60-station-3: link down
06-25 15:27:48 interface,info wlan60-station-3: link up
06-25 15:27:49 interface,info wlan60-station-1: link up
06-25 18:06:56 interface,info wlan60-station-2: link down
06-25 18:06:57 interface,info wlan60-station-2: link up
06-25 18:07:01 interface,info wlan60-station-2: link down
06-25 18:07:02 interface,info wlan60-station-2: link up
06-25 18:07:05 interface,info wlan60-station-2: link down
06-25 18:07:12 interface,info wlan60-station-2: link up
06-25 18:07:15 interface,info wlan60-station-2: link down
06-25 18:07:22 interface,info wlan60-station-2: link up
06-25 21:17:04 interface,info wlan60-station-1: link down
06-25 21:17:04 interface,info wlan60-station-3: link down
06-25 21:17:04 interface,info wlan60-station-2: link down
06-25 21:17:07 interface,info wlan60-station-2: link up
06-25 21:17:10 interface,info wlan60-station-3: link up
06-25 21:17:21 interface,info wlan60-station-1: link up
06-25 21:17:21 interface,info wlan60-station-1: link down
06-25 21:17:25 interface,info : link down
06-25 21:17:25 interface,info : link down
06-25 21:17:25 interface,info wlan60-station-1: link up
06-27 13:14:09 interface,info wlan60-station-3: link up
06-27 14:44:49 interface,info wlan60-station-2: link down
06-27 14:44:49 interface,info wlan60-station-3: link down
06-27 14:44:50 interface,info wlan60-station-1: link down
06-27 14:44:57 interface,info wlan60-station-2: link up
06-27 14:45:01 interface,info wlan60-station-3: link up
06-27 14:45:03 interface,info wlan60-station-1: link up
06-27 15:38:36 interface,info wlan60-station-2: link down
06-27 15:38:38 interface,info wlan60-station-2: link up
06-27 16:24:02 interface,info wlan60-station-2: link down
06-27 16:24:02 interface,info wlan60-station-1: link down
06-27 16:24:03 interface,info wlan60-station-3: link down
06-27 16:24:07 interface,info wlan60-station-1: link up
06-27 16:24:08 interface,info wlan60-station-3: link up
06-27 16:24:11 interface,info wlan60-station-3: link down
06-27 16:24:12 interface,info wlan60-station-3: link up
06-27 16:24:15 interface,info wlan60-station-2: link up
06-27 16:24:18 interface,info wlan60-station-2: link down
06-27 16:24:18 interface,info wlan60-station-3: link down
06-27 16:24:19 interface,info wlan60-station-1: link down
06-27 16:24:23 interface,info wlan60-station-1: link up
06-27 16:24:27 interface,info wlan60-station-3: link up
06-27 16:24:28 interface,info wlan60-station-2: link up
06-27 20:15:01 interface,info wlan60-station-3: link down
06-27 20:24:18 interface,info wlan60-station-3: link up
06-27 20:24:18 interface,info wlan60-station-3: link down
06-27 20:24:20 interface,info : link down
06-27 20:24:20 interface,info wlan60-station-3: link up
06-27 21:34:58 interface,info wlan60-station-3: link up
06-27 21:35:01 interface,info wlan60-station-3: link down
06-27 21:35:01 interface,info wlan60-station-1: link down
06-27 21:35:02 interface,info wlan60-station-2: link down
06-27 21:35:09 interface,info wlan60-station-1: link up
06-27 21:35:13 interface,info wlan60-station-3: link up
06-27 21:35:16 interface,info wlan60-station-3: link down
06-27 21:35:17 interface,info wlan60-station-1: link down
06-27 21:35:20 interface,info wlan60-station-3: link up
06-27 21:35:35 interface,info : link down
06-27 21:35:35 interface,info wlan60-station-1: link up
06-27 21:35:35 interface,info wlan60-station-1: link down
06-27 21:35:41 interface,info wlan60-station-1: link up
06-27 21:35:48 interface,info wlan60-station-2: link up
06-27 21:35:51 interface,info wlan60-station-2: link down
06-27 21:35:51 interface,info wlan60-station-3: link down
06-27 21:35:53 interface,info wlan60-station-1: link down
06-27 21:36:02 interface,info wlan60-station-1: link up
06-27 21:36:02 interface,info wlan60-station-3: link up
06-27 21:36:06 interface,info wlan60-station-2: link up
06-27 21:36:09 interface,info wlan60-station-2: link down
06-27 21:36:09 interface,info wlan60-station-3: link down
06-27 21:36:10 interface,info wlan60-station-1: link down
06-27 21:36:14 interface,info wlan60-station-1: link up
06-27 21:36:15 interface,info wlan60-station-2: link up
06-27 21:36:18 interface,info wlan60-station-2: link down
06-27 21:36:21 interface,info wlan60-station-3: link up
06-27 21:36:24 interface,info wlan60-station-3: link down
06-27 21:36:29 interface,info wlan60-station-3: link up
06-27 21:36:32 interface,info wlan60-station-3: link down
06-27 21:36:33 interface,info wlan60-station-1: link down
06-27 21:36:36 interface,info wlan60-station-1: link up
06-27 21:36:40 interface,info wlan60-station-3: link up
06-27 21:36:43 interface,info wlan60-station-3: link down
06-27 21:36:46 interface,info wlan60-station-3: link up
06-27 21:36:52 interface,info wlan60-station-2: link up
06-28 09:56:12 interface,info wlan60-station-1: link down
06-28 09:56:12 interface,info wlan60-station-3: link down
06-28 09:56:13 interface,info wlan60-station-2: link down
06-28 09:56:16 interface,info wlan60-station-2: link up
06-28 09:56:16 interface,info wlan60-station-3: link up
06-28 09:56:20 interface,info wlan60-station-3: link down
06-28 09:56:21 interface,info wlan60-station-2: link down
06-28 09:56:25 interface,info wlan60-station-2: link up
06-28 09:56:27 interface,info wlan60-station-1: link up
06-28 09:56:27 interface,info wlan60-station-1: link down
06-28 09:56:33 interface,info wlan60-station-1: link up
06-28 09:56:33 interface,info wlan60-station-3: link up
06-28 09:56:37 interface,info wlan60-station-3: link down
06-28 09:56:37 interface,info wlan60-station-1: link down
06-28 09:56:38 interface,info wlan60-station-2: link down
06-28 09:56:44 interface,info wlan60-station-3: link up
06-28 09:56:46 interface,info wlan60-station-2: link up
06-28 09:56:46 interface,info wlan60-station-1: link up
06-28 11:47:30 interface,info wlan60-station-3: link down
06-28 11:47:32 interface,info wlan60-station-2: link down
06-28 11:47:32 interface,info wlan60-station-1: link down
06-28 11:47:33 interface,info wlan60-station-3: link up
06-28 11:47:43 interface,info wlan60-station-1: link up
06-28 11:48:03 interface,info wlan60-station-2: link up
06-28 12:11:11 interface,info wlan60-station-3: link down
06-28 12:11:11 interface,info wlan60-station-2: link down
06-28 12:11:13 interface,info wlan60-station-3: link up
06-28 12:11:16 interface,info wlan60-station-3: link down
06-28 12:11:17 interface,info wlan60-station-3: link up
06-28 12:11:19 interface,info wlan60-station-2: link up
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Fri Jun 30, 2023 12:50 pm

@moly

what is AP used in this setup? all devices upgraded to 7.11beta2?
Could you please monitor signal levels for each station as well?
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Jul 10, 2023 10:44 am

AP is CubeG-5ac60ay-SA , all client have 7.11beta2.
Signal level : -53,-51,-57 , all MCS 8 , distace : 307m,284m,330m. Freq 58320MHz.
 
millenium7
Long time Member
Long time Member
Posts: 538
Joined: Wed Mar 16, 2016 6:12 am

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Jul 10, 2023 1:21 pm

at 300m in a multipoint setup (i'm assuming they are more than 5 degrees apart) i'd strongly suggest not using 58ghz. Try 64.8ghz and if thats stable step it down to 62ghz if you have other radio's in the area, or you're using it for a point-to-point backhaul

I havn't extensively tested frequency on 802.11ay, but on 802.11ax 58ghz is garbage and by far had the worst stability. I use it for fairly short links but 64.8ghz is substantially better as you start to push things out

As for signal levels, I find it to be completely and utterly meaningless on the 60ghz products. Part of that is due to beamforming, but I'm not sure if they also automatically adjust power and that throws off the reading. Either way its not a reliably indicator of anything useful. Have had links holding on at -70dbm and still kicking along, whilst also had links at -50db just immediately shit the bed when someone sneezes in a 500m radius
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Aug 15, 2023 1:39 pm

Tried another frequency and it keeps happening. We will have to replace it with the RBwAPG-60ad-A. People are upset about the constant outages.
 
ssbtech
just joined
Posts: 1
Joined: Mon Aug 14, 2023 6:39 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 21, 2023 7:53 pm

Tried another frequency and it keeps happening. We will have to replace it with the RBwAPG-60ad-A. People are upset about the constant outages.
Is this a stable and reliable solution? Was the problem described in this thread limited to the CubeSA 60 Pro? We have a temporary event coming up and trying to decide what to use for our PtMP Access Point.
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Mon Aug 28, 2023 10:04 am

And one more problem what is happening to us. Observed on multiple versions including 7.11. For some clients, the speed gets stuck at 385Mbps - MCS0. They do not display RSSI, TX sector, RX sector and TX sector info. After disconnecting and connecting the client, everything is ok again. It doesn't happen immediately after connecting, but after some time.
You do not have the required permissions to view the files attached to this post.
 
DenisPDA
Frequent Visitor
Frequent Visitor
Posts: 63
Joined: Tue Sep 04, 2018 5:42 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Aug 29, 2023 5:20 pm

And one more problem what is happening to us. Observed on multiple versions including 7.11. For some clients, the speed gets stuck at 385Mbps - MCS0. They do not display RSSI, TX sector, RX sector and TX sector info. After disconnecting and connecting the client, everything is ok again. It doesn't happen immediately after connecting, but after some time.
@moly
@mikrotik
@routeros

Hello
Have you tried contacting support?
What they're saying ?
I want to use Cube 60Pro AC
I'm very interested in what problems I can encounter and how stable the Mikrotik equipment works at 60GHz
Thank you
 
DenisPDA
Frequent Visitor
Frequent Visitor
Posts: 63
Joined: Tue Sep 04, 2018 5:42 pm

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Aug 29, 2023 5:23 pm

I came across the CubeSA 60Pro WATER DANGER theme viewtopic.php?t=189614
Can someone comment???
Who has a long history of using the Cube 60Pro (CubeG-5ac60ay)?
 
moly
newbie
Posts: 44
Joined: Tue Dec 06, 2005 3:14 pm
Contact:

Re: CubeSA 60Pro ac: 60Ghz clients flapping

Tue Oct 17, 2023 11:24 am

We solved the problem by replacing the technology by Ubiquity Wave.
Nothing flaps, nothing disconnects, and latency has dropped significantly.
You do not have the required permissions to view the files attached to this post.

Who is online

Users browsing this forum: Amazon [Bot] and 36 guests