CCR1036-12-4S vs PC Server

planetbr · Tue Jun 18, 2013 1:57 am

Hi , this is my question , The best option in your opinion ?

a CCR1036-12-4S

or a PC Server , Eight Core , with 8 GB in Ram .

Thanks .

cheeze · Tue Jun 18, 2013 3:58 am

Do you need extra ports?

ronix · Tue Jun 18, 2013 11:21 am

you want to use it for what ? PPPoE server, hotspot server , routing... etc ?

and what is the no. of users that you have ?

Tue Jun 18, 2013 11:23 am

If you would need to add 4 SFP ports and 12 server quality NIC cards to that server, price difference would be huge.

Like others have asked, some more info is needed to answer your question

hapi · Tue Jun 18, 2013 11:38 am

this is CCR1036-12-4S

only 2 queue tree for shaping TX (Max limit 290Mbit) and RX (Max limit 290Mbit). CCR is droping 50% packets and packet lost in forwarding in use queue tree. (watch difference between ether1 RX and ether2 TX). CCR was exchanged for intel xeon and everything is ok. CCR is bad. Small performance per core. Wrong way.

planetbr · Tue Jun 18, 2013 5:57 pm

Thank you very much , i have 3 another questions here in the forum , but no answer at all .

This is what i need .

Hi , i have a Router OS in a Quad Core Xeon Server with 4 GB Ram , but i have problem with queues , i need several queues , like :

/queue simple add dst-address=110.0.0.0/8 max-limit=256000/256000

The server that i m using is rebooting when i use queues , i dont know , but i think that is CPU usage .

So i need to know if the CCR1036 will work fine with the Queues , or know a good server configuration to do that .

What i need to do , is limit Bandwith used in Countrys like China or Japan .

Is for a Data Center that trafic permanently 50000 Packets per Second , and 500 MB per second .

What is the best solution ?

hapi · Tue Jun 18, 2013 6:06 pm

My example is from the data center. For flow limitation or restriction DDOS is absolutely useless. SQ was also used with the same poor result. Sometimes i have random reboots. Currently used Intel Xeon X5500 quad code, two sockets. No problem.

I recommend Xeon E3 or E5. For example, from Supermicro.

The problem is that the CCR has little power per core. Always the case as one ethernet uplink and one gets confused. Mikrotik can not effectively spread between 36 slow cores. Actually, it always walk away with one core as the recipient of packets from one Ethernet.

Wed Jun 19, 2013 9:53 am

Hapi, do you still have it? Many issues were addressed in v6.1 and also now in v6.2 (not released). If you could try these versions, it would help us improve the situation. Also it would be great if you could send your supout.rif file from v6.1 to support, so we can see what configuration you have

krajnalic · Fri Jun 21, 2013 1:31 am

ASUS P8P67 WS Revolution + Core i7 + Some quality Intel i350 cards would be the best solution for PPPoE server. We had around 3000 dynamic queues (pppoe users) on one machine, CPU is below 20% but there is problem with router os and we splited it into multiple pppoe servers. It would be great if you can make one pppoe server per 500 users. Mikrotik cant handle more than that.

hapi · Fri Jun 21, 2013 9:39 am

Hapi, do you still have it? Many issues were addressed in v6.1 and also now in v6.2 (not released). If you could try these versions, it would help us improve the situation. Also it would be great if you could send your supout.rif file from v6.1 to support, so we can see what configuration you have

I can not go back there. It has to work hard. All previous RC versions do the same, I doubt that anything will change v6.1.

Have you repaired the problem with the bridge on the CCR and X86? Just create a bridge interface and see what happens.

Fri Jun 21, 2013 10:59 am

I can not go back there. It has to work hard. All previous RC versions do the same, I doubt that anything will change v6.1.

Have you repaired the problem with the bridge on the CCR and X86? Just create a bridge interface and see what happens.

What are you talking about??? I use bridge a lot, everything works fine.

About load distribution over CPU cores, you need to realize that not all things can be distrusted, for example layer-7 filter - you need all packets of matching stream under control of single core, so before spreading panic, post your configuration

hapi · Fri Jun 21, 2013 11:09 am

I usage only 2 QT and 2 Mangle. Other is default. No filter, no nat, no everything other.

Fri Jun 21, 2013 11:11 am

I usage only 2 QT and 2 Mangle. Other is default. No filter, no nat, no everything other.

Either something specific in those rules, or some setting you are not aware of. Show us your rules

ros code

/export compact

hapi · Fri Jun 21, 2013 11:30 am

I usage only 2 QT and 2 Mangle. Other is default. No filter, no nat, no everything other.
Either something specific in those rules, or some setting you are not aware of. Maybe you are being DDoSed ?

DDOS in forwarding on servers. CCR is only forwarding. Without rules. ONLY FORWARDING ABOUT 300.000pps. CCR si unavailable. After switching off the QT to CCR was better but was still unavailable.

This picture is not DDOS. Only forwards UDP test on a different machine. Incoming 66kpps but outgoing only 33kpps!!! 50% packet lost!!! Where is 24Mpps? Where is only 1Mpps? Only 33kpps? Baaad!!!
This is only usage code. CCR can not handle forward through one QT. Low performance peer core!! Bad CCR. This is not use for heavy load.

/ip firewall mangle add action=mark-packet chain=forward in-interface="ether1 - wan" new-packet-mark=download out-interface=ether2 passthrough=no
/ip firewall mangle add action=mark-packet chain=forward in-interface=ether2 new-packet-mark=upload out-interface="ether1 - wan" passthrough=no

/queue tree add limit-at=290M max-limit=290M name=download packet-mark=download parent=ether2 queue=manual
/queue tree add limit-at=290M max-limit=290M name=upload packet-mark=upload parent="ether1 - wan" queue=manual

Fri Jun 21, 2013 11:33 am

what is "queue=manual" ???

what does /tool profiler shows ??

hapi · Fri Jun 21, 2013 11:41 am

what is "queue=manual" ???

I know? This is "compact export".

what does /tool profiler shows ??

I know? After switching off the QT(SQ) is throughput ok.

Fri Jun 21, 2013 11:43 am

This is not the full compact export, just two lines.

hapi · Fri Jun 21, 2013 11:49 am

OMG

/queue tree export compact

there are only two lines!! ONLY TWO QT IS USAGE. How many times did I say?

Fri Jun 21, 2013 11:50 am

command is following:

/export compact

please see above and write exactly as written, don't invent other commands

hapi · Fri Jun 21, 2013 11:59 am

/interface ethernet
set 0 name="ether1 - wan"
set 12 auto-negotiation=yes
set 13 auto-negotiation=yes
set 14 auto-negotiation=yes
set 15 auto-negotiation=yes
/port
set 0 name=serial0
/queue type
add kind=sfq name=sfq sfq-perturb=1
/queue tree
add limit-at=290M max-limit=290M name=queue1 packet-mark=download parent=global \
    queue=sfq
add limit-at=290M max-limit=290M name=queue2 packet-mark=upload parent=global \
    queue=sfq
/snmp community
.....
/ip address
.....
/ip dns
set servers=8.8.8.8,8.8.4.4
/ip firewall connection tracking
set enabled=no
/ip settings
set secure-redirects=no send-redirects=no
/ip firewall mangle
add action=mark-packet chain=forward disabled=yes in-interface="ether1 - wan" \
    new-packet-mark=download out-interface=ether2 passthrough=no
add action=mark-packet chain=forward disabled=yes in-interface=ether2 \
    new-packet-mark=upload out-interface="ether1 - wan" passthrough=no
/ip route
.....
/ip service
set telnet disabled=yes
set ftp disabled=yes
set www disabled=yes
set ssh disabled=yes
/lcd
set current-interface="ether1 - wan" read-on
/lcd interface
set 0 disabled=yes
set 1 disabled=yes
set 2 disabled=yes
set 3 disabled=yes
set 5 disabled=yes
set 6 disabled=yes
set 7 disabled=yes
set 8 disabled=yes
set 9 disabled=yes
set 10 disabled=yes
set 11 disabled=yes
set 12 disabled=yes
set 13 disabled=yes
set 14 disabled=yes
set 15 disabled=yes
/snmp
set enabled=yes trap-community=public
/system clock
set time-zone-name=Europe/Prague
/system ntp client
set enabled=yes primary-ntp=195.113.144.201
/system routerboard settings
set cpu-frequency=1200MHz memory-frequency=1
/tool bandwidth-server
set enabled=no
/tool graphing interface
add
/tool graphing resource
add

..... is manual hide

Fri Jun 21, 2013 12:12 pm

SFQ with sfq-perturb=1 ...... looks like wrong configuration

use FIFO size 50 and test again,

hapi · Fri Jun 21, 2013 5:04 pm

this is not bad. On x86 it is used commonly and current x86 is that instead of CCR also goes ok. But to placate you, and there was a FIFO it had no effect. Hell, I'm no novice. I'm in this area is very experienced. This is the basic shaping and CCR can not handle it.

Fri Jun 21, 2013 5:05 pm

this is not bad. On x86 it is used commonly and current x86 is that instead of CCR also goes ok. But to placate you, and there was a FIFO it had no effect. Hell, I'm no novice. I'm in this area is very experienced. This is the basic shaping and CCR can not handle it.

Please do ask he asked, he is right, your config is not correct.

hapi · Fri Jun 21, 2013 5:22 pm

What is it wrong? I wrote that there was also FIFO.

SFQ with sfq-perturb=1 is not wrong. On x86 is working.