Ping Probleam When I use two WAN connection at a time

Hello Every One !! My issue is wan1 cant ping remotely . so I am unable to connected VPN . Both are connected on RB711UA-2HnD Mikrotik Router by Ether Port 1 & 2 . and there is two Group for Local User Group A is using Wan 1 if Wan 1 fail then they use Wan2 Port as backup basis . Group B local us using Wan 2 the don’t need use wan port 1 . Everything is working well .
But my issue is when I ping to WAN2 port remotely wan port not responding. If I disconnect WAN2 from router then WAN1 port respond by ping . for this reason I am unable to connected VPN by WAN1 port. Please help me to find out the solution.
Network Details , Here I using two WAN gateway and two User Group .
WAN 1 IP :202.164.208.180 /28
WAN2 IP : 180.234.6.106 /32 – 192.168.3.1
LAN IP : 192.168.1.0/26 FOR Group A user
LAN IP : 192.168.1.64/26 For Group User
Thanks , waiting for some one help
Network.jpg
Network.jpg