Hello,
My old Cisco SG350 died this week and I decided to replace my whole physical network (fortunately I had been planning to do that so I had gear already in-house). I just finished rebuilding my network with an RB5009, CRS328, and a pair of CRS312s for 10gb networking. My physical connections are:
RB5009-1---sfp-sffplus1--------sfp-sfpplus1--CRS328-1
CRS-328-1--sfp-sfpplus3------combo4--CRS312-1
CRS-328-1--sfp-sfpplus4------combo4--CRS312-2
Each switch is running RouterOS 7.8 and I was able to regenerate the (albeit crazy) configuration that I had in my old setup. I have about 10 VLANs established (which I created earlier in the week during the initial bring-up) and everything has been working well for the past 3 - 4 days. Traffic is passing normally between all devices/VLANs and all my home and lab services are running without error. I am allowing all traffic between all VLANs right now (plan to change that in the future) using the RB5009 as the main router for the network.
In order to restore NSX-T to my home lab (the last thing on my list), I need to get BGP going again. To get started, I created a new (not part of the original setup) VLAN 31 to connect the switches together with BGP. I believe I followed the same configuration as I have for all the other VLANs, but I cannot get the two switches to ping to each other. In both switches, I have the VLAN interfaces defined to the bridge, on the bridge I have the VLAN tagged on the appropriate port for that switch and the bridge, and I have created local TCP/IP addresses on the VLAN (just like all my other working VLANs).
When I ping from RB5009->CRS328 using the interfaces I defined to VLAN31 I see the arp entry on both sides, but it is in "D" and never "DC". When I ping from CRS32->RB5009 I don't see any entries added to either ARP table. I have deleted the stale ARP entries and tried pinging from both directions, I deleted the interfaces and VLAN on both sides and started again, I tried changing the VLAN numbers (originally I tried using VLAN 2711, then 27, then 31), but no change. Just to ensure I wasn't completely crazy I created interfaces in 328 on all the existing VLANs and I can ping from them to the corresponding RB5009 interfaces with no issue.
This seems so utterly basic to me, so I'm assuming I just forgetting a step or something equally noobish. I have rewatched about 40 videos on setting up VLANs and reading the docs and forums but I just can't figure out what I'm doing wrong.
Can someone spot what I'm doing wrong here?