Community discussions

MikroTik App
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Set CPU frequency to 1200MHz on ccr1072

Sun May 14, 2017 5:16 am

Hi All,
i'm new on Mikrotik (our network is full cisco), but we planned to send 20 CCR1072 to peer on IX's. I just activated one CCR1072 (for optimize the configuration) on local IX with 2x10Ge uplink with 57 active peers. After some optimization i got CPU usage around 11% with about 5Gbps traffic.

I see an option to increase CPU frequency to 1200MHz, there are any reason why is now set to 1000? If i set to 1200MHz can i expect some strange behavior or contraindications?
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Sun May 14, 2017 7:03 pm

We run ours at 1200Mhz and it seems to work just fine.
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 2:40 am

We run ours at 1200Mhz and it seems to work just fine.
thank you. Following your words I upgraded to 1200Mhz this aftenoon. Profile show that CPU usage lowered from 11% to 8%. No routing issue and CPU temperature still around 43°C
 
Ascendo
Frequent Visitor
Frequent Visitor
Posts: 68
Joined: Sun Sep 09, 2012 12:06 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 7:58 am

Interesting use case for Mikrotik. Do you have any strategy in place for DDoS attacks? How well is the 1072 handling that many peers?
 
User avatar
nz_monkey
Forum Guru
Forum Guru
Posts: 2104
Joined: Mon Jan 14, 2008 1:53 pm
Location: Over the Rainbow
Contact:

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 8:32 am

We run ours at 1200Mhz and it seems to work just fine.
It is probably just at 1000Mhz to make sure it will work under all conditions. If you have it in an air conditioned DC then 1200Mhz should be fine.
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 12:25 pm

Interesting use case for Mikrotik. Do you have any strategy in place for DDoS attacks? How well is the 1072 handling that many peers?
For DDoS - Andrisoft Wanguard + RTBH and Source-based blackhole - (set RP Filter to Loose is an absolute must - viewtopic.php?t=114664).
You can of course scrub incoming traffic during a DDoS until a certain limit is reached and then enforce the blackholes.

The 1072 usually stand up well depending on the type and size of the DDoS and whether or not you are using Fastpath.
Most issues occur when the firewall is enabled, causing inspection of packets coming in.

In normal fastpath mode with the CPU at 1200Mhz it does (according to Mikrotik tests) 86 mpps & 44 gbps @ 64 bytes.
If 25 firewall rules are applied, this drops dramatically to 5.8mpps and 3gbps @ 64bytes.
 
Ascendo
Frequent Visitor
Frequent Visitor
Posts: 68
Joined: Sun Sep 09, 2012 12:06 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 12:43 pm

Interesting use case for Mikrotik. Do you have any strategy in place for DDoS attacks? How well is the 1072 handling that many peers?
For DDoS - Andrisoft Wanguard + RTBH and Source-based blackhole - (set RP Filter to Loose is an absolute must - viewtopic.php?t=114664).
You can of course scrub incoming traffic during a DDoS until a certain limit is reached and then enforce the blackholes.

The 1072 usually stand up well depending on the type and size of the DDoS and whether or not you are using Fastpath.
Most issues occur when the firewall is enabled, causing inspection of packets coming in.

In normal fastpath mode with the CPU at 1200Mhz it does (according to Mikrotik tests) 86 mpps & 44 gbps @ 64 bytes.
If 25 firewall rules are applied, this drops dramatically to 5.8mpps and 3gbps @ 64bytes.
Is it possible to secure the router (remote management etc) without such a big performance hit? IP RAW filters maybe?
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 3:01 pm

Interesting use case for Mikrotik. Do you have any strategy in place for DDoS attacks? How well is the 1072 handling that many peers?
For DDoS - Andrisoft Wanguard + RTBH and Source-based blackhole - (set RP Filter to Loose is an absolute must - viewtopic.php?t=114664).
You can of course scrub incoming traffic during a DDoS until a certain limit is reached and then enforce the blackholes.

The 1072 usually stand up well depending on the type and size of the DDoS and whether or not you are using Fastpath.
Most issues occur when the firewall is enabled, causing inspection of packets coming in.

In normal fastpath mode with the CPU at 1200Mhz it does (according to Mikrotik tests) 86 mpps & 44 gbps @ 64 bytes.
If 25 firewall rules are applied, this drops dramatically to 5.8mpps and 3gbps @ 64bytes.
Is it possible to secure the router (remote management etc) without such a big performance hit? IP RAW filters maybe?
RAW has practically the same performance as normal firewalling, I tested it in that blackhole topic (post 7).

For remote management we use a VPN into our private network and all devices are assigned private IP's where we bind the remote services to (ssh, winbox, etc).
Disable all services that your don't need and move the ones you do need to different port numbers.
On the mikrotik's side, also disable all un-needed packages like dhcp, hotspot, ppp, wireless, etc.
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Mon May 15, 2017 4:43 pm

@Ascendo For DDoS we're highly specialized on that. For uplinks and edge we use ASR9k. As distribution nexus. But we're now creating a parallels network and mikrotik seems to be fine. This is the project we're building

http://seflow.net/2/index.php/en/blog/s ... on-roadmap
(please if is considered spam remove the link).

For this use we planned to configure 1072 mikrotik on every IX. Now on Milan, with 57 active peers this is the usage (5.8Gbps troughtput)

NAME CPU USAGE
spi 0%
ethernet 0%
console 0%
firewall 1.3%
networking 14.4%
management 0.6%
routing 0.4%
profiling 0.1%
unclassified 0.1%
total 16.9%


Router was put in production about 2 days ago and all ddos received not created any issue, but we use only for peer and we not do incoming firewalling, Mitigation is doing with traffic diversion feature. We have only outbound firewalling raw rules to avoid spoofing

For all users that do bgp in full route, i suggest to peer with cymru bogons this save incoming firewall rules and resource. Is an open source project http://www.team-cymru.org/bogon-reference-bgp.html
 
Ascendo
Frequent Visitor
Frequent Visitor
Posts: 68
Joined: Sun Sep 09, 2012 12:06 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Tue May 16, 2017 9:17 am

@Ascendo For DDoS we're highly specialized on that. For uplinks and edge we use ASR9k. As distribution nexus. But we're now creating a parallels network and mikrotik seems to be fine. This is the project we're building

http://seflow.net/2/index.php/en/blog/s ... on-roadmap
(please if is considered spam remove the link).

For this use we planned to configure 1072 mikrotik on every IX. Now on Milan, with 57 active peers this is the usage (5.8Gbps troughtput)

NAME CPU USAGE
spi 0%
ethernet 0%
console 0%
firewall 1.3%
networking 14.4%
management 0.6%
routing 0.4%
profiling 0.1%
unclassified 0.1%
total 16.9%


Router was put in production about 2 days ago and all ddos received not created any issue, but we use only for peer and we not do incoming firewalling, Mitigation is doing with traffic diversion feature. We have only outbound firewalling raw rules to avoid spoofing

For all users that do bgp in full route, i suggest to peer with cymru bogons this save incoming firewall rules and resource. Is an open source project http://www.team-cymru.org/bogon-reference-bgp.html
Very nice!
 
abakisensoy
just joined
Posts: 21
Joined: Tue May 02, 2017 12:15 am

Re: Set CPU frequency to 1200MHz on ccr1072

Sun May 21, 2017 9:45 pm

We run ours at 1200Mhz and it seems to work just fine.

we are thinking to buy CCR1072 for just firewall is it a right move ?

here our topic: viewtopic.php?f=13&t=121781
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Tue May 23, 2017 12:28 pm

We run ours at 1200Mhz and it seems to work just fine.

we are thinking to buy CCR1072 for just firewall is it a right move ?

here our topic: viewtopic.php?f=13&t=121781
I would definitely not use an CCR as a firewall that you are expecting to take punishment, the clock speed on the CPU isn't good enough for high packet inspection and it will probably fall over.
A firewall (in general) is never going to stop a volumetric DDoS attack, even with drop rules.
This is because a packet still has to come in on the incoming interface in order to be inspected by the firewall before a decission to drop it is made.
Here is a youtube video I made showing this - https://www.youtube.com/watch?v=SHjBbbF ... e=youtu.be
Even when the drop rule is enabled, traffic still hits the incoming interface and there is still load on the router.
When a blackhole is used, the packets accepted on the incoming interface drop and so does the CPU load.


You better off splitting your protection into DDoS protection and application / access control.
For DDoS protection, use something like fastnetmon or Wanguard to help mitigate volumetric type attacks whereby you can setup BGP with your routers, enable loose RP-Filters and blackhole the destination or source IP addresses.

Then a decent firewall for application / access control. At the highend, I would recommend the fortigate firewalls, we use them extensively for IDS/IPS and firewalling and they work great, however they are expensive. On the lower-end, Use a server with decent 10G network interfaces and a E3-1200v6 or E5-1600v4 Processor (clock speed above cores) and load up pfsense. You can use suricata or snort on pfsense for the IDP/IPS side of things and the pfsense firewall is rock solid.
 
abakisensoy
just joined
Posts: 21
Joined: Tue May 02, 2017 12:15 am

Re: Set CPU frequency to 1200MHz on ccr1072

Wed May 24, 2017 1:18 am

We run ours at 1200Mhz and it seems to work just fine.

we are thinking to buy CCR1072 for just firewall is it a right move ?

here our topic: viewtopic.php?f=13&t=121781
I would definitely not use an CCR as a firewall that you are expecting to take punishment, the clock speed on the CPU isn't good enough for high packet inspection and it will probably fall over.
A firewall (in general) is never going to stop a volumetric DDoS attack, even with drop rules.
This is because a packet still has to come in on the incoming interface in order to be inspected by the firewall before a decission to drop it is made.
Here is a youtube video I made showing this - https://www.youtube.com/watch?v=SHjBbbF ... e=youtu.be
Even when the drop rule is enabled, traffic still hits the incoming interface and there is still load on the router.
When a blackhole is used, the packets accepted on the incoming interface drop and so does the CPU load.


You better off splitting your protection into DDoS protection and application / access control.
For DDoS protection, use something like fastnetmon or Wanguard to help mitigate volumetric type attacks whereby you can setup BGP with your routers, enable loose RP-Filters and blackhole the destination or source IP addresses.

Then a decent firewall for application / access control. At the highend, I would recommend the fortigate firewalls, we use them extensively for IDS/IPS and firewalling and they work great, however they are expensive. On the lower-end, Use a server with decent 10G network interfaces and a E3-1200v6 or E5-1600v4 Processor (clock speed above cores) and load up pfsense. You can use suricata or snort on pfsense for the IDP/IPS side of things and the pfsense firewall is rock solid.
Thanks for replying.

I read all of your posts on this forum. I am really new to mikrotik.
You are suggesting us to use blackhole which is ip null route right ? That method is that we cant use. we cant null client's ip otherwise they will leave us. We need to protect them no matter what happens. If is it possible to null only coming ips i think it could solve our problem. You are the second specialist who recommends us fortigate which is reall above our budget.

We have 2x10G uplink to use. We are gonna try RouterOS on i7 7700K to see how will react when we get ddos with out IP firewall rules. If it works we will use otherwise we need E3-Model cpus like Intel Xeon E3-1240 v5.

We dont have any idea how to use fastnetmon or pfsense. We can learn of course if its gonna solve our problem.

Again thanks for helping us we really need help to solve this problem.
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Wed May 24, 2017 11:47 am

Thanks for replying.

I read all of your posts on this forum. I am really new to mikrotik.
You are suggesting us to use blackhole which is ip null route right ? That method is that we cant use. we cant null client's ip otherwise they will leave us. We need to protect them no matter what happens. If is it possible to null only coming ips i think it could solve our problem. You are the second specialist who recommends us fortigate which is reall above our budget.

We have 2x10G uplink to use. We are gonna try RouterOS on i7 7700K to see how will react when we get ddos with out IP firewall rules. If it works we will use otherwise we need E3-Model cpus like Intel Xeon E3-1240 v5.

We dont have any idea how to use fastnetmon or pfsense. We can learn of course if its gonna solve our problem.

Again thanks for helping us we really need help to solve this problem.
You don't need to blackhole your client's IP's, you can blackhole incoming source IP's.
To do this, you would put fastnetmon on a server and setup a BGP session with your mikrotiks (or other routers).
Set your routers to export a netflow / sflow to the fastnetmon server.
When fastnetmon pick's up a DDoS attack, it advertises the abusive IP's to your routers which then get blackholed dynamically.
There is a Mikrotik plugin for fastnetmon to make this implimentation easier - https://github.com/pavel-odintsov/fastn ... tik_plugin
 
abakisensoy
just joined
Posts: 21
Joined: Tue May 02, 2017 12:15 am

Re: Set CPU frequency to 1200MHz on ccr1072

Wed May 24, 2017 1:55 pm

Thanks for replying.

I read all of your posts on this forum. I am really new to mikrotik.
You are suggesting us to use blackhole which is ip null route right ? That method is that we cant use. we cant null client's ip otherwise they will leave us. We need to protect them no matter what happens. If is it possible to null only coming ips i think it could solve our problem. You are the second specialist who recommends us fortigate which is reall above our budget.

We have 2x10G uplink to use. We are gonna try RouterOS on i7 7700K to see how will react when we get ddos with out IP firewall rules. If it works we will use otherwise we need E3-Model cpus like Intel Xeon E3-1240 v5.

We dont have any idea how to use fastnetmon or pfsense. We can learn of course if its gonna solve our problem.

Again thanks for helping us we really need help to solve this problem.
You don't need to blackhole your client's IP's, you can blackhole incoming source IP's.
To do this, you would put fastnetmon on a server and setup a BGP session with your mikrotiks (or other routers).
Set your routers to export a netflow / sflow to the fastnetmon server.
When fastnetmon pick's up a DDoS attack, it advertises the abusive IP's to your routers which then get blackholed dynamically.
There is a Mikrotik plugin for fastnetmon to make this implimentation easier - https://github.com/pavel-odintsov/fastn ... tik_plugin

i will start working on it. I am planing to buy couple of e-books about mikrotik to learn in depth of how to use. Do you have any recommendation ?

You showed me the way that i will follow it. if you have any suggestion please tell me. Thanks :)
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Thu Jun 01, 2017 9:38 pm

Router worked fine for 2 weeks, but ttoday i got two random reboot with that error

"router was rebooted without proper shutdown by watchdog timer"

I not know if is cpu related or not, so i revert back to 1000Mhz

If i still experiencing reboot i will inform users on this thread that is not related to CPU frequency.
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Thu Jun 01, 2017 10:34 pm

after furter investigation we realized that the issue is not on cpu frequency that was changed 7 days ago, but the flow exporter. We did some changes todat like move from all interfaces to selected one and changing inactive and active timeouts.

I reverting back these parameters, meanwhile generated supout file and sent tu support@
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 9:23 am

after furter investigation we realized that the issue is not on cpu frequency that was changed 7 days ago, but the flow exporter. We did some changes todat like move from all interfaces to selected one and changing inactive and active timeouts.

I reverting back these parameters, meanwhile generated supout file and sent tu support@
In our case, we have the cpu at 1200Mhz but do not have any traffic flow enabled and have also recently started seeing these random reboots.
I'm going to drop the cpu down to 1000Mhz and test.
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 9:26 am

hi,
yes my previous consideration was wrong, the issue is confirmed on CPU overclock. We identified it keeping serial console opened and after reboot you see a message related to cpu error, something like:

"processor error"
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 4:24 pm

hi,
yes my previous consideration was wrong, the issue is confirmed on CPU overclock. We identified it keeping serial console opened and after reboot you see a message related to cpu error, something like:

"processor error"
I would love to get a response from Mikrotik Staff regarding this issue.

The TILE72 processor comes in 2 models, a 1Ghz and a 1.2Ghz version:
http://www.mellanox.com/page/products_d ... =tile_gx72
http://www.mellanox.com/related-docs/pr ... E-Gx72.pdf

The question is if the CCR-1072 units come with a 1Ghz processor or a 1.2Ghz processor that's been downgraded to 1Ghz

Do you know if Mikrotik has confirmed this as being an issue that they looking to resolve?
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 4:39 pm

The exact cpu model should be TLR4-07280DG-10CE A0a that is 1000Mhz by default.

I was in contact with Mikrotik Support but the result is that they ask for RMA for broken part. I have "hard head" so did some additional testing and found the issue. I really doubt that they will fix it because overclocking mean that cpu will work on not optimal range, so you can experiencing unexpected behaviour.

For example, if you overclock the cpu and try to generate supout file you will get incomplete file and if you keep serial console opened and try to do some activity on the router, at 1200Mhz you will see some ecc memory error. CPU at 1200Mhz, as tile is built, need powerfull memory, this is why they created new model TLR4-07280DG-12CE A0a with 1866 memory support. If we overclock at 1200Mhz memory can't follow the cpu causing noise

Honestly i think they never developed/tested this product at 1200Mhz so they not know what reply on support request. Checking the exact error we see that the issue is related to hardware bug on 1200Mhz (that i think tile fixed on TLR4-07280DG-12CE A0a with 1866 memory support) and not on o.s. level.
 
User avatar
Murmaider
Member Candidate
Member Candidate
Posts: 126
Joined: Fri Oct 30, 2015 10:10 am

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 5:45 pm

Honestly i think they never developed/tested this product at 1200Mhz so they not know what reply on support request. Checking the exact error we see that the issue is related to hardware bug on 1200Mhz (that i think tile fixed on TLR4-07280DG-12CE A0a with 1866 memory support) and not on o.s. level.
They have done some testing at 1200Mhz and they have publised the results of it, lower down on the product page under "Ethernet test results" - https://routerboard.com/CCR1072-1G-8Splus

My question is always, why allow it if it causes issues:
[admin@rt-bgp01.jhb] > /system routerboard settings set cpu-frequency=
400MHz  600MHz  800MHz  1000MHz  1200MHz
Those are the allowed options, they should really remove the 1200Mhz if it is causing these issues.

Now if only I can find a way to flag this topic for an admin.
 
berlo
newbie
Topic Author
Posts: 45
Joined: Sat May 13, 2017 5:11 pm

Re: Set CPU frequency to 1200MHz on ccr1072

Fri Jun 30, 2017 5:48 pm

yes i read it but for testing i mean in real enviroment. I mean reboots are random. For do these testing i think they upgrade to 1200Mhz, rebooted, test the bandwidth, rebooted... so no time to check if everything is well.

For developing products, test stability etc, i think they use standard 1000Mhz frequency.

Who is online

Users browsing this forum: timotei and 87 guests