Community discussions

MikroTik App
 
discoengineer
just joined
Topic Author
Posts: 12
Joined: Wed Jul 20, 2016 2:40 pm

BW Limit of more than 4200 Mbps CCR1072

Tue Apr 19, 2022 12:20 am

Hi,

We have a CCR1072 which is acting as edge router for providing internet services to customers. We have recently taken on board a customer whose BW requirement is of 5000 Mbps. I was trying to implement this download limit via PCQ and simple queue but when we enter the value of more than 4200 Mbps in Max Download Limit (in case of simple queue) or in Rate (in case of PCQ) Mikrotik does not accept the value. How can we achieve this?
 
guipoletto
Member Candidate
Member Candidate
Posts: 195
Joined: Mon Sep 19, 2011 5:31 am

Re: BW Limit of more than 4200 Mbps CCR1072

Tue Apr 19, 2022 12:31 am

As far as i know, queues are single-core things.
It is even impressive that you managed to see 4+Gbps under a softqueue

I don't think this is really scalable.

Do you have a switch in the path where you could set the limit at the interface?
 
discoengineer
just joined
Topic Author
Posts: 12
Joined: Wed Jul 20, 2016 2:40 pm

Re: BW Limit of more than 4200 Mbps CCR1072

Mon Apr 25, 2022 12:18 pm

I havent been able to achieve 4200 Mbps on the CCR for the customer. Though the CCR accepts the value of 4200M but once the queue is enabled, the traffic is choked at 500 Mbps. Further to add, yes i have NX3k on which the customer is terminated but the NX3K can apply traffic police on physical interface but not on LAGs or SVIs. Is there anyway we can achieve this capping on Mikrotik as we were hoping to use this CCR for customers link 1G to 5G capacity.
 
guipoletto
Member Candidate
Member Candidate
Posts: 195
Joined: Mon Sep 19, 2011 5:31 am

Re: BW Limit of more than 4200 Mbps CCR1072

Tue Apr 26, 2022 7:20 pm

but once the queue is enabled, the traffic is choked at 500 Mbps.
This makes more sense.

You have 72 cores, but the queue will limit _all_ the customer traffic to a single core

therefore you will not be able to control the bandwidth to this customer using this tool. Simple-queues are software-queues, and for that ammount of bandwidth, you need a hardware-based queue.

I suggest putting a switch with limiting capabilities in the path for this client

For instance, in a CRS317, you can go to Switch --> port --> SFP11 --> set ingress (upload) and Egress (download) rate limits for that port.
 
Zacharias
Forum Guru
Forum Guru
Posts: 3459
Joined: Tue Dec 12, 2017 12:58 am
Location: Greece

Re: BW Limit of more than 4200 Mbps CCR1072

Tue Apr 26, 2022 7:27 pm

As far as i know, simple queues use multiple processor cores...
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: BW Limit of more than 4200 Mbps CCR1072

Tue Apr 26, 2022 11:54 pm

As far as i know, simple queues use multiple processor cores...
afaik:

multiple simple queues without parent or different parents uses multiple different processor cores

a single simple queue only uses a single processor core for most of his load, the same apply for multiple simple queues whit the same parent
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: BW Limit of more than 4200 Mbps CCR1072

Tue Apr 26, 2022 11:58 pm

I havent been able to achieve 4200 Mbps on the CCR for the customer. Though the CCR accepts the value of 4200M but once the queue is enabled, the traffic is choked at 500 Mbps. Further to add, yes i have NX3k on which the customer is terminated but the NX3K can apply traffic police on physical interface but not on LAGs or SVIs. Is there anyway we can achieve this capping on Mikrotik as we were hoping to use this CCR for customers link 1G to 5G capacity.
maybe try an ACL not for the LAG or SVI interface
instead of that for the Destination MAC address of the traffic

or

for the ip address or addresses of the traffic you want to limit

in Mikrotik CRS 3xx you can do that, i think is very likely NX3k can do that too
 
User avatar
BartoszP
Forum Guru
Forum Guru
Posts: 2855
Joined: Mon Jun 16, 2014 1:13 pm
Location: Poland

Re: BW Limit of more than 4200 Mbps CCR1072

Wed Apr 27, 2022 9:24 am

4200MB looks like a victim of a 4294967295 (unsigned 32-bit) number limit
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: BW Limit of more than 4200 Mbps CCR1072

Wed Apr 27, 2022 6:56 pm

i was expecting that with ROS 7.x the 4200MB queue limit will be eradicated but until today is not

i have used that on big CHR with big CPU to do QoS deployments sucessfully

but when we reach 4200 limit we had to abandon it
 
discoengineer
just joined
Topic Author
Posts: 12
Joined: Wed Jul 20, 2016 2:40 pm

Re: BW Limit of more than 4200 Mbps CCR1072

Fri May 06, 2022 11:58 am

but once the queue is enabled, the traffic is choked at 500 Mbps.
This makes more sense.

You have 72 cores, but the queue will limit _all_ the customer traffic to a single core

therefore you will not be able to control the bandwidth to this customer using this tool. Simple-queues are software-queues, and for that ammount of bandwidth, you need a hardware-based queue.

I suggest putting a switch with limiting capabilities in the path for this client

For instance, in a CRS317, you can go to Switch --> port --> SFP11 --> set ingress (upload) and Egress (download) rate limits for that port.
Thanks for the input guipoletto. I see your suggestion and get your point but in case we have multiple customers, some being allocated 2 x 10G interfaces for redundancy, allocated each customer a dedicated port whether he has 2 Gbps traffic or 5 Gbps traffic, we will need many switches as we will only be able to apply hardware limit using the switch. Applying on SVI or IP level would save the number of physical ports we use as one 10G interface could facilitate multiple customers. But at the end of the day, if CCR is not capable enough, there is now choice but to allocate each customer a dedicated physical port.
 
discoengineer
just joined
Topic Author
Posts: 12
Joined: Wed Jul 20, 2016 2:40 pm

Re: BW Limit of more than 4200 Mbps CCR1072

Fri May 06, 2022 12:00 pm

I havent been able to achieve 4200 Mbps on the CCR for the customer. Though the CCR accepts the value of 4200M but once the queue is enabled, the traffic is choked at 500 Mbps. Further to add, yes i have NX3k on which the customer is terminated but the NX3K can apply traffic police on physical interface but not on LAGs or SVIs. Is there anyway we can achieve this capping on Mikrotik as we were hoping to use this CCR for customers link 1G to 5G capacity.
maybe try an ACL not for the LAG or SVI interface
instead of that for the Destination MAC address of the traffic

or

for the ip address or addresses of the traffic you want to limit

in Mikrotik CRS 3xx you can do that, i think is very likely NX3k can do that too
Hi chechito. Thanks for the input. Ill check and see if I can get this done on N3K and will share update.
 
discoengineer
just joined
Topic Author
Posts: 12
Joined: Wed Jul 20, 2016 2:40 pm

Re: BW Limit of more than 4200 Mbps CCR1072

Thu Jun 02, 2022 11:32 pm

Just to update, talked to Mikrotik support and the guy there gave an excellent suggestion which was to use firewall to restrict traffic. Used the below mentioned command:

/ip firewall filter
add action=drop chain=forward out-interface=ether1 limit=!1G,100M:bit

"This simple firewall filter rule will limit ether1 outgoing traffic to 1Gbps with 100Mbp burst "

I changed the out-interface to the designated vlan of the customer and the download was restricted. No heavy utilization of CPU cores. Have implemented upto 3Gbps using this for another customer on the same CCR and no CPU choking observed. All seems normal till now. Will keep under monitoring. Do share if anyone else has had an experience with using this rule to do BW shaping.
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: BW Limit of more than 4200 Mbps CCR1072

Fri Jun 03, 2022 4:41 pm

interesting rule

thank you for sharing


looks like MikroTik is working on the subject

changelog of 7.3rc1 shows this:
*) queue - allow to set higher limits than 4G;

maybe in no distant future we will enjoy queues with big limits

we will see how the 1.000 mhz tilera in order execution cores on ccr1072 perform vs 2.000 mhz arm out of order execution cores on ccr2116/2216
 
User avatar
shailparmar
Frequent Visitor
Frequent Visitor
Posts: 97
Joined: Wed Aug 20, 2014 6:07 pm
Location: GB
Contact:

Re: BW Limit of more than 4200 Mbps CCR1072

Sun Oct 29, 2023 8:24 am

4200MB looks like a victim of a 4294967295 (unsigned 32-bit) number limit
The same limit of 4200 is there in /Switch Rules .

I tried searching reason for that, but now I understand from this comment.

Can anyone confirm is this limit is still there or removed.

Thanks

Who is online

Users browsing this forum: diasdm, MrBrick, Sailwebwifi, SMARTNETTT and 69 guests