L2TP - Multiple Clients from Same IP

Have L2TP Server working fine for one user, at another site I have three users all behind the same IP address and using L2TP and for those users the sessions keep disconnecting.

Is there a solution for multiple L2TP users behind one IP address? (if that is the issue)