Before[*] starting from scratch, have a look at this tutorial to get an idea about how VLANs are properly done in ROS.
[*] I wrote “before” not because you shouldn’t tear your config apart but to learn how to do it properly from scratch. Have no doubts: diagnisis of your current setup by @anav is spot on.