Page 1 of 1

CHR Xen vs VMWare Performance

Posted: Fri Aug 31, 2018 3:24 pm
by citymesh

We are running several CHR instances on our virtual environment but lately we have seen some peculiarities.

For example, we were running one CHR on our VMWare environment. This VMWare environment uses hosts with the following CPUs: Intel Xeon E5-2660 v3 2.6GHz

The CHR had 2 sockets of 1 core, 2GB RAM and 1GB hard disk. This CHR had one network interface (VMXNET3). There was about 400Mpbs throughput on this CHR and the CHR was running around ±60% load.

We tried migrating this CHR to our new VMware environment which is running on AMD EPYC 7551P 32-Core Processor. The migration was executed by shutting down the VM, migrating to other host and then powering on the VM.

We then had a lot of packet loss as well as messages there was a loop (while there was definitely no loop; the same setup/configuration had been running on VMWare for over a year.).

After a while we decided to rebuild the VM on our old Xen environment (which uses the same Intel Xeon E5-2660 v3 2.6GHz CPU architecture as our old VMWare environment).

The packet loss messages were gone and the CHR was running smoothly again. There was again around ±400Mpbs on the CHR but this time the CHR was running at around ±6% CPU load.

So my question is 2-fold:
  • Why is the difference in CPU load so big between Xen and VMWare? Whilst the VM has the same resources and same throughput.
  • What could be the reason for the loop problems on the AMD environment? Whilst the network and configuration remains exactly the same.

Kind regards
Frédéric Saelens

Re: CHR Xen vs VMWare Performance

Posted: Tue Sep 04, 2018 9:11 pm
by armandfumal

try Hyper-V a lot faster than Xen with CHR.

performance order: Hyper-V, Xen, the moment...



Re: CHR Xen vs VMWare Performance

Posted: Tue Sep 04, 2018 9:32 pm
by armandfumal
check video in attach, less than 5 secs...

Re: CHR Xen vs VMWare Performance

Posted: Thu Sep 06, 2018 2:54 pm
by Kindis
On regards related to hardware choice. Now performance would come down to the choice of testing. AMD CPU has more core and if they are added to CHR it should be able to hold more load but Intel is still king of single threaded performance. Also AMD has more intra core latency and this could also result in lower then expected results. So it comes down to what you want.
When it comes to hypervisor I think VMware is the best when it comes to throughput of the CHR but Hyper-V is much better when it comes to BGP calculations etc. Saw this on a MUM session online regarding CHR BGP performance.