I am using RoundRobin from the DNS and only restart the peer to have the next IP address to be resolved.
The retry itself was a longtime and many times requested feature and I am pleased that Mikrotik implemented this now.
http://forum.mikrotik.com/t/wireguard-peer-not-functioning-after-a-router-restart/155286/44
http://forum.mikrotik.com/t/wireguard-dynamic-enpoint-address/158243/2
http://forum.mikrotik.com/t/if-wireguard-fails-to-connect-it-wont-ever-try-again/157574/36