It is possible, but you can only tie it to the originating IP of the connection.
So set up 2 PEER’s under ipsec. Both should have a non-overlapping address range. One can have one secret and the other another. Whichever peer is triggered based on the originating ip of the connection, that secret will be used.