Cannot connect freeradius server over a l2tp softether vpn.

Hello ,
After i setup l2tp server in linux vps with freeradius server. All is configured and working ok. Now if router is using the public ip than its no problwm. Router can see the freeradius server.

But the problem is when router want to use the l2tp address its getting timeout. Now i can ping both to router and from router , and ssh to router from vps using private ip.
But failed to get when using 1812 or 1813 ports.

Notes: I don’t have any firewall rules set for this server.

Using NtRadPing test utility but still having same issue .

Do i need to add ip forwording or something ? Please share the code also.

Ok so here is some addition to my post.

Here is my ifconfig

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:16178 errors:0 dropped:0 overruns:0 frame:0
          TX packets:16178 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:2928433 (2.9 MB)  TX bytes:2928433 (2.9 MB)

tap_vpn1  Link encap:Ethernet  HWaddr 00:ac:45:cd:63:bf
          inet addr:10.10.1.1  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::2ac:45ff:fecd:63bf/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2457 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2434 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:175297 (175.2 KB)  TX bytes:188608 (188.6 KB)

venet0    Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
          inet addr:127.0.0.2  P-t-P:127.0.0.2  Bcast:0.0.0.0  Mask:255.255.255.255
          UP BROADCAST POINTOPOINT RUNNING NOARP  MTU:1500  Metric:1
          RX packets:1158681 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1341645 errors:0 dropped:29338 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:187601950 (187.6 MB)  TX bytes:335142838 (335.1 MB)

venet0:0  Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
          inet addr:xx.xx.xx.xx  P-t-P:xx.xx.xx.xx  Bcast:xx.xx.xx.xx Mask:255.255.255.255
          UP BROADCAST POINTOPOINT RUNNING NOARP  MTU:1500  Metric:1

The problem is I can freeradius on port 1812 onxx.xx.xx.xx:1812 but could not access from the ip 10.10.1.1:1812

Any idea?
Here is route

10.10.1.0/24 dev tap_vpn1  scope link
10.0.0.0/8 dev tap_vpn1  proto kernel  scope link  src 10.10.1.1
default dev venet0  scope link