Hi
I'm new to the forum. I am reaching out for help with a problem I have getting a Mikrotik to function the way I hope.
The topology I am working with is simple. On the datacenter side is a single VyOS instance with a single IP address.
On the remote office side we have a Mikrotik which has two public IP's routed through different paths. So two default gateways, therefore Dual WAN setup.
So in this example lets use 103.49.151.X as the public IP for the VyOS and the Mikrotik has 103.22.19.A and 103.24.19.B.
The issue is I cannot reliably form two GRE tunnels between the Mikrotik and VyOS.
I have setup on both devices two tunnel configs.
So on Mikrotik I have configured two GRE tunnels as follows:
/interface gre add disabled=no local-address=103.22.19.A Name=Cloud3 remote-address=103.49.151.X
/interface gre add disabled=no local-address=103.24.19.B Name=Cloud4 remote-address=103.49.151.X
On the VyOS side I have two GRE tunnels defined just like above but with the endpoints changed so local-ip=103.49.151.X and remote-ip=A or B
After creating the tunnels I add IP addresses to both ends of each tunnel.
So on Mikrotik I configure:
For tunnel A /ip address add address=10.10.10.10/30 interface=Cloud3 network=10.10.10.8
For tunnel B /ip address add address=10.10.10.14/30 interface=Cloud4 network=10.10.10.12
On the VyOS side I give it IP's of 10.10.10.9 and 10.10.10.13 respectively.
What I am finding with this basic configuration is that the Mikrotik attempts to send outbound GRE packets from the interface which is currently the default route. If public IP A is the default gateway, then tunnel A will send and receive as expected over that interface but tunnel B will only receive traffic over public IP B and send traffic over public IP A.
I then tried to fix this by creating some mangle rules and route marks to mark the traffic for tunnel B so that it will send the traffic back out of public IP B once it receives traffic from the VyOS over public IP B. This only works temporarily.
If the Mikrotik is restarted then the mangle rules and route marks do not work. If I try to ping the tunnel interfaces after a reboot. One of them will be fine but the other one will just time out. In Winbox it states that only one of the tunnels is reachable in the routing table.
If I do a few pings from the VyOS side it will activate the other tunnel but traffic will still not pass. On the Mikrotik pings return "packet rejected" messages.
Strangely though I have found that opening the torch tool in winbox and pressing start makes both tunnels magically work at this point.
Can anyone please point me to either
1) Somehow bind gre tunnel B so that it will only send and receive over public IP B?
or failing that
2) show me how I can configure the mikrotik so that I can achieve the same effect?
or failing that
3) show me how I should setup the mangle rules so that it fixes the packet rejected messages after a reboot? There must be something happening here because starting the torch tool somehow fixes it.
Thanks for your responses in advance.