S2S connection via NAT'ed static Public address

Hello

I got a problem, I am trying to set up a Site to Site connection using IPSec between two locations that have multiple public IP addresses.
The static Public IP addresses (5 for each site) come via another dynamic address through which each of the static addresses are routed.

I have also routed certain subnets to different static public IP addresses and when I check through on site PCs then they report the correct public IPs.
Also I can make VPN connections to the public IPs as well.

Problem starts with S2S connections. When I connect via the dynamic public IPs then everything works great but as soon as I try to go to the static public ones then I start getting no suitable proposal found, failed to get valid propsal and failed to pre-process ph1 packet errors.
Right now I am just trying to establish a connection via a single static Public address one site to another single static Public address at another site.
They both have routed subnets via the respectful static Public addresses which need to communicate.

BUMP;

Still faced with the same problem;
I can add configurations when needed.