Allocating /31 on distributed PPPoE infrastructure

Hi There,

I am in the planning stages of a wireless ISP in the Pacific Islands and it would be great to get some advice.

My idea was for each base station site to run it’s own PPPoE concentrator, with MPLS/BGP used over the backhaul. I would allocate all clients with real world IP’s on a /31 subnet via PPPoE then route these via RFC1918 addresses on the base stations using BGP over the MPLS so all the other base stations on the network know how to reach the /31. In theory (inside my head) this should work.

My thoughts are that this should provide much more efficient use of the backhaul bandwidth as inter-customer traffic will go direct between the relevant base stations rather than via a central PPPoE concentrator.

What are your opinions of this design ? Pros/Cons and if you were to set up a wisp from scratch how would you design it?

My network works almost the same. Each base station has own PPPoE concentrator, all base stations are bridged with ospf. There are 2 separate gateways which serves internet connection and everything works like a charm :slight_smile:

Thanks ayufan,

That is great to hear. We are waiting to see what the RB616 is, and then we are going to build up a couple of base station setups to do some testing with. We are hoping to use MPLS from the start so I will let you know how we get on.

we have the same type of config, however we allocate a /32 to the customer, all customers point to the same gateway since PPP does not require the gateway to be on the same subnet.

we assign the local address in the ppp profile (becomes the clients gateway when they connect), and the remote address (aka the client’s public IP) is assigned via a ip pool using the radius framed pool attribute to determine which ip pool to use.

additionally each access point radio is bridged to a unique vlan, and we run the PPPoE server on the matching VLAN. this allows you to see which client is connected to which AP by way of the matching vlan, and keeps any broadcast traffic that gets through at a minimum…

or you can use /32 along side interface routing, and ospf.

Thanks for the responses guys, very helpful.

I have just ordered about $10k worth of aerials for the “proof of concept” and will be using the /32 method mentioned by Forepoint. The main ADSL provider here does exactly this over their PPPoA connections, I have seen this cause issues with numerous routers as they will not accept a default route outside their interface’s subnet but we know how to work around this so it should be fine.

I am really excited about having a play with MPLS on something other than JunOS.


Regards,



Andrew

Brian, a quick question

You mention your use of a VLAN per AP. This confused me a little, are you terminating the PPPoE on the AP closest to the client, or are you bridging the wireless interface they are connected to onto a VLAN that is terminated at a central concentrator ?

Also, are you using MPLS/BGP or OSPF for your backbone routing ?


Thanks.




Andrew

wlan1 on AP bridged to a VLAN on ether1, goes into a switch along with many other APs each bridged to their own VLAN. then a MikroTik router (usually a x86 box) has an interface on that switch, and VLAN interfaces to match each AP. PPPoE is ran on the VLAN interface on the x86 box plugged into the switch.

routes are distributed via OSPF.

Ahh very nice.

We are rather limited space wise at the high sites. I may just run the small repeaters (30 users) in bridge mode and then terminate the PPPoE on the distribution nodes as there is no point on the smaller ones if they only have one uplink.

I am looking forward to all the equipment arriving so I can start having an in-depth play with it.

I got the same configuration as Forepoint explained, but instead of VLANs i use EoIPs
Going to replace them with VPLS as soon as it’s production ready

that works great for smaller sites (I’ve done the same in some areas). just remember to use station-psudobridge on the CPE, and disable forwarding at the AP. Also make sure you aren’t bridgeing that AP and another upstream where the PPPoE is terminated (use VLANs at the upstream location in the same config as I described for the regular AP) as this will prevent users from communicating with each other via layer 2 or layer 3 within in the realm of your bridge.

This got my attention forepoint.

So for example;

If I enable PPPoE server on Wlan1,
than in the profile I give the local address 10.1.1.1 (eth1 address)
than in the remote ip pool I give real IPs of 212.1xx.x.x

Will it work ? Real IPs will be routed through local addresses ?

yes, that will work.

Hello doush,

In which interface have you assigned the 212.1xx.x.x range?
Can you assign LAN PPPoE users a public IP of your WAN network?

For example, if I have:
WAN: 212.1xx.x.1/24
LAN: 10.1.1.1/24

Can I give PPPoE users local address 10.1.1.1 and remote address 212.1xx.x.100? Should it route OK?

Thanks

Ibenzo, you are asking the same question as Doush that forepoint answered.

Yes you can do this, it is pretty comon AFAIK.

But it’s not working for me.
What I ask is if I can give my PPPoE user a public IP in the same address range as my WAN IP address.
For example:
WAN IP: 62.111.111.1/24
PPPoE user remote address (in LAN): 62.111.111.2

Should this work? Do I need a especial nat rule?

Thanks

Hi Ibenzo,

No that will definately not work.

You will need a block of public IP’s that are routed to your Mikrotik router via your upstream provider to be able to do this. If you have a single IP from your upstream provider, or the IP’s are not routed to the external IP of your router you will not be able to do this.


e.g. for this to work you would need:

Stub (aka /30) between you and upstream provider 203.75.30.4/30, you are 203.75.30.5 upstream provider is 203.75.30.6
Block of public IP’s 203.75.34.0/24 routed to 203.75.30.5 by upstream provider
Default Route to upstream providers router (203.75.30.6)

You will now be able to allocate IP’s in the 203.75.34.0/24 range to your PPPoE clients, with a RFC1918 gateway address e.g. 10.1.1.1

I hope this makes a bit more sense now.


Regards,




Andrew

Hi, can you describe your OSPF (or MPLS/VLPS) configuration

TNX