Do you have pptp or ipsec enabled on the router itself? Perhaps data is getting caught by that instead of forwarded away properly.
What kind of VPN are they using? IPSec? PPTP?
How have you done that? 47, 50, and 51 are IP protocols, not ports.I have tried allowing 47/50/51/500/4500/1780/1723/49000 ports