I got it working. I don't know why it is working.
On the primary router I removed the WiFi, WLAN1 and WLAN2, from the CAP under wireless. Not sure why I'd want to remove it to make it work but that is what I needed to do. If there is a better way please let me know.