Hello everyone,
I need some feedback for a new network design I have in mind, since I’m not that experienced with networks of that size/complexity.
The setup is for a small local ISP, the basic idea is to use wireless radio links to transport fast internet connections you can get here in the cities to the countryside, where normal telephone ISPs only offer pretty darn slow internet connections. Now we need to reorganize our infrastructure, because there are more requests for fast connections than we currently can handle 
(which is a good thing in terms of business - a bad thing for me, since I’m supposed to help out on the technical infrastructure)
Here is what I have in mind:
We have several upstream locations where we have fast connections (usually 100mbit down, 10mbit up; one 100mbit down, 100mbit up is comming soon). These are at location A, location B, location C and location D. On each location we have several customers, who use one of the gateways of the location (at A and B we have more than one upstream connection, at C and D currently only one).
My idea is to seperate these locations on network level, so location A is 10.0.1.0/24, location B is 10.0.2.0/24, location C is 10.0.3.0/24, location D is 10.0.4.0/24). The networks should be connected for failover scenarios and for maintenance reasons.
For each customer we have a antenna pair working in bridge mode. So it’s like this: UPSTREAM ROUTER → ANTENNA Customer 1 Sender → ANTENNA Customer 1 Receiver → Customer Router.
Between the UPSTREAM ROUTER and the sender antenna are currently sometimes some switches, because we have more antennas at the location than the upstream router has ports. The speeds are limited in the bridge settings of the antennas.
In future I want each antenna to have a port on the UPSTREAM ROUTER, because for monitoring reasons that just feels better.
Private customers are supposed to use PPPOE, business customers will work with static IPs.
Now I’m thinking of getting RB1100 as my UPSTREAM ROUTERs. The PPPOE part shouldn’t be a problem, right?
What I’m not sure of: If the RB1100 of location A has a 800mbit wireless radio to the RB1100 of location B, I need to set up a layer 3 routing (IP based), since the networks of A and B are different, right? Can the RB1100 handle 800mbit for IP routing?
There are also some special cases where a business customer needs a public IP. I solved that once with a EoIP bridge between two RB750G, bridging and tunneling the DHCP signal of the cable modem at the upstream location. That worked pretty well. I think I’ll stick with RB750GL for these special cases, since I don’t want the EoIP etc running on the RB1100, not sure yet though.
The Rb1100 has 13 ports and two switch chips. I still don’t get how to use the switch chips properly, perhabs someone can explain me the features in short.
Here is what I have in mind for each RB1100:
Port 1-10 for connections to customer antennas. Port 11 for the WAN upstream, Port 12 for backbone connection, Port 13 for local maintenance.
Since I think my boss wants more than 10 antennas to be connected to one RB1100, I might need to use some simple 5-Port switches on one of the Ports, preferably on those set to PPPoE connections for private customers. (I think I already tested it: Port 1 can listen for several PPPoE connections at the same time, right? I think I eaven tested it with a normal static IP and PPPOE, having a 5-port switch connected…that’s why it is called “over Ethernet” stands for, right?)
Any feedback appreciated