Page 1 of 1

CHR, LACP, and VMware

Posted: Tue Jan 08, 2019 9:05 pm
by j2sw
I have a vmware setup where we are trying to bond multiple 10 Gig SFP+ with a Cisco Nexus. The Cisco says the port members are Individual (I). The Mikrotik bond is set on 802.3ad and this setup works on CCRs. Should I do the bonding in VMWare? I have not done this before. Thoughts?

Re: CHR, LACP, and VMware

Posted: Fri Jan 18, 2019 1:56 pm
by Cha0s
You cannot bond at the CHR level.
Right now you are bonding two virtual NICs that connect to a Virtual Switch. Not Nexus.

You should do the bonding at the ESXi level.

But from there I don't know how you could get more that 10Gbps on the CHR.
I've read some posts that the VMXNET3 driver doesn't really limit the bandwidth at 10Gbps. I don't know how CHR will handle it.

Re: CHR, LACP, and VMware

Posted: Fri Jan 18, 2019 4:16 pm
by cdiedrich
If your license allows, do the bonding in ESX.
If not, you'll need to dedicate NICs to your CHR instance and then follow these steps:

Create a vSwitch per NIC, allow promiscuous mode for vSwitch.
Add each dedicated NIC to the corresponding vSwitch as single uplink only.
Create port groups on that vSwitch (ideally as trunk ports - vlan 4095 in ESX)., enable promiscuous mode, mac changes and forged transmits.
Connect these vSwitches to your CHR instance.
Now you can bond from your CHR to the nexus.