Community discussions

MikroTik App
 
shadow478
just joined
Topic Author
Posts: 1
Joined: Tue Oct 09, 2018 12:25 pm

CCR1072 PCC Multi-WAN Performance Stuck

Wed Jun 19, 2019 11:40 am

Hello everyone,
Pardon me for my English not very well,
I’ll explain my problem as possible as I can.

We build local LAN party events from 2014 in Taiwan. That is the largest game party in east Asia we believe. Peoples bring their PC/Game Console to a place to play games with others.
The players increased from 125 to 1200 people now. And we tried to provide the total bandwidth up to 4Gbit download / 2.4Gbit upload (1 G/600M each line )
Here is the video of the event :
https://www.youtube.com/watch?v=cWjrj-euGmE

2 years ago, we use a load balancer router provided by the local vendor. It can carry 8 WAN ports and 4 LAN ports with 2 Gbit bandwidth traffics. And that is not enough. We also encounter NAT performance issues when we reach 600 peoples. Then we decide to upgrade our router to CCR1072-1G-8S+.

=========================

Network structure here :
https://drive.google.com/file/d/1i0DNxE ... sp=sharing

Problem :
1. Hotspot makes CPU loading to 100% when clients only reach 60% ( about 700 clients ), back to normal CPU usage when I turned off.

2. Bandwidth limited to 2.3G and stuck
The first thought is Fastpath won't work with QoS and PCC Loadbalance. I'm not sure this right.
Is anyone know the performance when PCC running?

3. When the admission peoples reach 80 %, The CPU usage hit to 100%, at the meantime Packages drops.
After disabled some filters, it back to normal usage, a few moments it goes 100% again, then I turned off Queue Tree. Yes, CPU usage back to an acceptable level, Just only 40 ~ 70 %, but the latency increased a lot in gaming. I know packages might be in a queue to cause high latency. Don't know a way to solve it.

Here is the backup file :
https://drive.google.com/file/d/1a7wapG ... sp=sharing

=========================

What We Need:
PCC Outbound Load balance
- ISP can only provide 1G/600M max each line
- Static IP and same Gateway
- I want to feed all bandwidths to players

Queue Tree
- Most PC game players play online games
- 70% Streamer in the area and they are streaming with RTMP
- P2P software could cause lack bandwidth
- Game download needed
- Gaming packages first ( small packages with high priority )

Hotspot
- Need to control access with account and password
( Is PPPoE a solution ? )

VLANs
- To separate subnets and decrease broadcast impact network

UPnP
- It's necessary to use UPnP for PS4. If not, PS4 players can't create in-game-room or connect to others.

Some other things :
I did a lot of work after the event. Tried to familiar with RouterOS.
I got more about knowledge about Queue tree and the rules and others. But I can't test or simulate the environment. It can't be a test before the event. So I looking for someone with experience or solid solution suggestions.

Later this year, we are going to bring 1500+ people in this event. I really need some supports seriously. Can't imagine the players who couldn't enjoy the party because of an unstable network. I could pay for someone willing to help me or official support maybe.

Thanks for your reading and attention.
 
User avatar
sebastia
Forum Guru
Forum Guru
Posts: 1782
Joined: Tue Oct 12, 2010 3:23 am
Location: Antwerp, BE

Re: CCR1072 PCC Multi-WAN Performance Stuck

Wed Jun 19, 2019 11:31 pm

Hi

Some feedback...

1. See https://wiki.mikrotik.com/wiki/Manual:IP/Hotspot. It has quite some limitations / requirements. In high load scenario some can become a bottleneck, ex "users accounting in local database on the router", local storage => SLOW
Only use what you really need and optimise where possible.

2. Fastpath is incompatible with Simple Queues & PCC. It can work with Queue Tree, but see below
Another option: given you have large user base, why not statically route traffic to different links based on source range? so instead of PCC

3. QueueTrees (linked to an interface) were (still are?) limited to single CPU core. So on high bandwidth link, one core won't be enough.
Simple queues have been optimised for CCR's, and can be configured in a hierarchical manner.
see also Bandwidth management 2.0: https://www.slideshare.net/AlexVishnyak ... ikrotik-20

Note: regarding config, better to share the "/export hide-sensitive compact" not backup
 
LesTaylor
just joined
Posts: 2
Joined: Sat Oct 05, 2019 6:49 am

Re: CCR1072 PCC Multi-WAN Performance Stuck

Sat Oct 05, 2019 7:05 am

Hi sebastia, thanks for your post. I own a small video gaming shop in bangladesh, we faced some problem as mentioned here. and with your tricks i solved it. thanks again

Who is online

Users browsing this forum: mkx, xaar and 58 guests