Hello.
Maybe this bug or feature.
I use 6.42rc56 CRS317-1G-16S+ for build bonding (LAG+LACP+HW Offload) with HP G8 server with Ubuntu 16.04.3 LTS
I use Mikrotik as DHCP Server, Linux work as client. DHCP, ICMP work good. But from Linux over bonding interface in schem one i can't connect to Mikrotik SSH. Firewall empty. I use Mikrotik as DNS server, but from Linux name not resolve. In tcpdumps all look good, but not work.
Network card type same at all servers.
09:00.0 Ethernet controller: Emulex Corporation OneConnect 10Gb NIC (be3) (rev 01)
09:00.1 Ethernet controller: Emulex Corporation OneConnect 10Gb NIC (be3) (rev 01)
Linux servers bonding configurations.
# Bond
auto ens2f0
allow-hotplug ens2f0
iface ens2f0 inet manual
bond-master bond0
auto ens2f1
allow-hotplug ens2f1
iface ens2f1 inet manual
pre-up sleep 5
bond-master bond0
auto bond0
iface bond0 inet dhcp
bond-mode 802.3ad
bond-miimon 100
bond-lacp-rate 1
bond-slaves ens2f0 ens2f1
bond_xmit_hash_policy layer2+3
Mikrotik configuration.
/interface bridge
add fast-forward=no name=bridge_servers priority=0x1000
/interface bonding
add lacp-rate=1sec min-links=1 mode=802.3ad name=bond_S1 slaves=sfp-sfpplus1,sfp-sfpplus2
add lacp-rate=1sec min-links=1 mode=802.3ad name=bond_H1 slaves=sfp-sfpplus3,sfp-sfpplus4
add lacp-rate=1sec min-links=1 mode=802.3ad name=bond_H2 slaves=sfp-sfpplus5,sfp-sfpplus6
/interface bridge port
add bridge=bridge_servers interface=bond_S1
add bridge=bridge_servers interface=bond_H1
add bridge=bridge_servers interface=bond_H2
When i change configuration to active-backup mode at one server. I can ssh/resolve to Mikrotik from any servers.
# Bond
auto ens2f0
allow-hotplug ens2f0
iface ens2f0 inet manual
bond-master bond0
auto ens2f1
allow-hotplug ens2f1
iface ens2f1 inet manual
pre-up sleep 5
bond-master bond0
auto bond0
iface bond0 inet dhcp
bond-mode active-backup
bond-arp-interval 100
bond-arp-ip-target 192.168.112.1
bond-primary ens2f0
/interface bridge port
add bridge=bridge_servers interface=bond_H1
add bridge=bridge_servers interface=bond_H2
add bridge=bridge_servers interface=sfp-sfpplus1
add bridge=bridge_servers interface=sfp-sfpplus2
All other configuration at Mikrotik same. I attache support.rif in Ticket#2018041122005401
Can you help resolve this problem?
12.04.2018
When i disable hw-offload on 802.3ad bond interface all start work. When hw-offload enabled i can't connect to servers from Mikrotik.
I found workaround. Add empty EoIP interface to servers bridge and now all look working. Later i understand that this not solve problem.
14.04.2018
After some tests i found that communication randomly stop from H1 to S1, for example after one hour more or less. Up/Down bridge interface fix problem but only for some time. I check fault tolerance by logicaly shut one interface of bond, all traffic go one interface. After unshut interface traffic no comeback. This results not for production use. I move to active-backup with ARP monitoring. This without load balance but work. I not try downgrade software. If somebody have information about problem like this write it here.
19.04.2018
Mikrotik confirm this problem in ticket #018041122005401. I change schem and add VLAN because need seporate INET from MGMT. Still want use hw-offload for VLAN. But now i have another problem. I can't ping CSS326-24G-2S+ from CRS317-1G-16S+. If i disable hw-offload on port SFP16 all start work. If i shut/unshut bridge all start work.
Maybe this other problem.
Sorry English no my native language.
Thank you.