Community discussions

MikroTik App
 
User avatar
Wolfraider
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 88
Joined: Wed Jul 15, 2015 8:06 pm

CHR bandwidth test questions

Tue Jul 30, 2019 9:53 pm

We are working on getting our new CHR's tuned and configured. We have used the bandwidth test to the internal loopback interface with good success. We are getting different results on testing between the 2 different CHRs. Is this to be expected? We have tried disabling VMQ, offloading, upping the queues.

Loopback test
ESXi
100% CPU Load
62Gbps receive throughput

Hyper-V
100% CPU Load
28Gbps receive throughput

External test
ESXi
35% CPU Load
8Gbps receive throughput

Hyper-V
2% CPU Load (one CPU running at 25%, rest are idle)
5Gbps receive throughput

2 separate HP DL380 G8 servers with 2x2690 3GHz 10-core, 64GB RAM
Hyperthreading disabled
High Performance enabled on all options
Mellanox 40Gb Infiniband/Ethernet NIC
40Gb DAC

CHR configured with 10 cores (tested with 4, 6, 8 and 10 core with no difference)
30GB RAM
 
elbob2002
Member Candidate
Member Candidate
Posts: 252
Joined: Tue May 15, 2018 8:15 pm
Location: Ireland

Re: CHR bandwidth test questions

Sat Aug 03, 2019 4:36 pm

The Hypervisor is the obvious difference.

There are a few here who swear HyperV is better for hosting CHR and others (myself included) swear by VMware. But I'm biased slightly as I used to work for VMware.

I'm assuming you are using the P unlimited license as on my ProLiant DL385p G8 I only get 9.2Gbps on a P10 license and that's with 2 cores and 128MB RAM running on ESXi, 6.7.0, 10302608. Standard install, no hypervisor tuning and VMware image rather than the HP one.

I've always maintained that VMware's drivers are much more robust than Windows. It's a much leaner hypervisor too.

Edit - Forgot to mention that my ProLiant has 24 AMD Opteron 6344 cores over two CPUs.
 
User avatar
Wolfraider
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 88
Joined: Wed Jul 15, 2015 8:06 pm

Re: CHR bandwidth test questions

Sat Aug 03, 2019 10:51 pm

We tried esx 6.7 but never could get actual throughput over 7Gb. Loopback testing was 61Gb. We are testing debian 10 with frrouting right now and are getting 38Gb throughput and around 25% load across all 20 cores. No core is loaded more than 30%. We much prefer the mikrotik interface but as of right now, they can't handle the load.

Who is online

Users browsing this forum: No registered users and 10 guests