Page 1 of 1

CHR and x553 has combability issues with VLAN tagging

Posted: Sun Jul 14, 2024 6:21 pm
by hooyao
I brought a DELL vep 1445, it has intel i350 and x553 eth controllers, x553 extends 2 sfp+ ports. I intended to install esxi8.0u3 and CHR on it to serve as my home router. I have run the same configuration on a N100 box for over a year.

To simply the issue I'm facing, I can reproduce this issue in a simple setup

Passthrough the sfp+ ports of x553 to CHR(v7.14.2), connect one of the sfp+ to my desktop(x520) via Mellanox 10G DAC.
vep1445_chr_vlan.drawio.png
It works as expected without VLAN.

However, when I started to configure VLAN tagging, this sfp+ port was going crazy.

Setting VLAN tagging on this sfp+ port(ether5)
Screenshot 2024-07-14 231225.png
Enable VLAN filtering
Screenshot 2024-07-14 231340.png
Then the x520 nic on my desktop started flopping, every 20-30s

Even restarting CHR doesn't help, and it's even worse, the ports on x553 are gone
Before restarting CHR
Screenshot 2024-07-14 231653.png
After restarting CHR
Screenshot 2024-07-14 231751.png
The only way to recover from this mess is restarting Esxi.

Please help.

Re: CHR and x553 has combability issues with VLAN tagging

Posted: Sun Jul 14, 2024 6:57 pm
by jaclaz
Maybe related, maybe not:
viewtopic.php?t=208061
TLDR; Don't use VLAN 1

Re: CHR and x553 has combability issues with VLAN tagging

Posted: Tue Jul 16, 2024 6:22 pm
by hooyao
Maybe related, maybe not:
viewtopic.php?t=208061
TLDR; Don't use VLAN 1
Thanks for your reply. I guess the issue is with the NIC.

Now I get this workaround, instead of pass-through the x553 nic, I did the following

CHR(VMXNET3)<--> port group(VLAN ID:4095) <--> vswitch(uplink x553 sfp+)

I have ran btest on this setup for hours, and it looks stable. The CPU usage is better than I expected, VMXNET3 won't eat all the CPU even on 10Gbps.