That hash is already there and it PCC dst-address only. You mark the connection once and connection tracking does the job for you. When mix ports then there a new connection but the hash will be the same…the dst-address.
You will get a uneven distribution. If you want an even distribution then use both addesses+ports or NTH. Then you have keep track of sites that do not support multiple src-addresses.