Community discussions

MUM Europe 2020
 
fiberhaus
just joined
Topic Author
Posts: 12
Joined: Tue May 27, 2008 5:14 am

Longest Multihop Link

Tue May 27, 2008 5:30 am

We are investigating using mikrotik hardware to provide a seamless backhaul link for bandwidth across a low density population area. We are investigating a 400 mile multihop link. Are we crazy in thinking that we can accomplish such a feat? We are looking at a link with 10 - 15 towers...possibly less, if you think we can get a way with it. We will deploy a solution with antennas for both send and receive and use diversity. The link will be accomplished mainly over desert and we will be deploying voice(VOIP) and data services over it. I am mainly concerned with latency for the link and curious of what we should be expecting. We are wanting to pass around 40mbs sustained each way. We may deploy multiple down links for 80mbs down and 40mbs up.

Doable??? Anyone achieved something similar?


TGF
 
Tanker
Member Candidate
Member Candidate
Posts: 131
Joined: Fri Nov 24, 2006 10:46 am

Re: Longest Multihop Link

Tue May 27, 2008 11:29 am

Fiber

What desert is this??? - We have done some experiments - maybe I can help.

T
 
fiberhaus
just joined
Topic Author
Posts: 12
Joined: Tue May 27, 2008 5:14 am

Re: Longest Multihop Link

Wed May 28, 2008 1:30 am

Sub Sahel
 
andreacoppini
Trainer
Trainer
Posts: 486
Joined: Wed Apr 13, 2005 11:51 pm
Location: Malta, Europe

Re: Longest Multihop Link

Wed May 28, 2008 2:09 am

We will deploy a solution with antennas for both send and receive and use diversity.
TGF
Just keep in mind that Mikrotik RouterOS does not support antenna diversity. Your best bet is to use nStreme2 with 2 wireless interfaces, one interface to send, another interface to receive. this way you will achieve full duplex.
- No strings attached -

<< Please give good Karma if this post helped you. Press the + button above the Location entry
 
WirelessRudy
Forum Guru
Forum Guru
Posts: 3089
Joined: Tue Aug 08, 2006 5:54 pm
Location: Spain

Re: Longest Multihop Link

Wed May 28, 2008 2:24 am

10-15 antenna's = hops should be no problem. In a properly setup network speeds in a 10-15 hob network will still be faster from head to toe then on the real internet.
In my network a ping from my most distant (measured in hops) client to my border gateway is still only 5 to 6 ms while a ping from my border gateway into a given server on the internet is 40-80ms.

If your network is just a long serial line of antenna's which further more are not serving networks in between it would be interesting to see what the opinion of the more experienced on this forum are going to advice: fully routed with each link its own network, or all hobs in one big network (with WDS).

And yes, if the the link has to carry an average high load of traffic, dual nstreme (with both a receiving and separate transmitting station for each link in each tower) is the best option.

If your routers in the towers have to work hard to get all the traffic processed (specially if compression is also used) keep an eye on the heat factor. See other threads in this forum. Some have serious doubts about some boards under ´hot´ conditions with several radio's in them.
 
User avatar
jwcn
Forum Guru
Forum Guru
Posts: 1501
Joined: Sun Aug 27, 2006 6:49 am
Location: Maryland, USA
Contact:

Re: Longest Multihop Link

Wed May 28, 2008 6:21 am

10-15 routed hops will create problems...
 
WirelessRudy
Forum Guru
Forum Guru
Posts: 3089
Joined: Tue Aug 08, 2006 5:54 pm
Location: Spain

Re: Longest Multihop Link

Wed May 28, 2008 11:24 am

10-15 routed hops will create problems...
I loose 1ms per hop, that would be 15 for 15 hops. My network counts 10 hops max. and the ping time from the far end is 10-11ms to my main gateway, even when plenty of traffic goes around.
I loose 50ms going to my ISP's internet gateway seen from my network gateway, google give me >95ms.
I have 3 different gateways to the internet, with two different ISP's, they all have the same results.

Clients in my network have 3Mb and even if they use that fully the time of a ping hardly rises.

15-20ms loss (15-20 hops) in a routed network should be not a single problem.
 
User avatar
hulk-bd
Member Candidate
Member Candidate
Posts: 227
Joined: Mon Sep 03, 2007 7:19 pm
Location: Uttara, Dhaka, Bangladesh

Re: Longest Multihop Link

Wed May 28, 2008 9:56 pm

WirelessRudy you are very much right about it. And BTW your ping latency to google is 95ms? We use SEA-ME-WE 4 link to our country but never heard that kind of little ping latency to the web, here we get 250-350 ms to most of the web sites.

Thanks
Don't worry, be happy :) .......
 
WirelessRudy
Forum Guru
Forum Guru
Posts: 3089
Joined: Tue Aug 08, 2006 5:54 pm
Location: Spain

Re: Longest Multihop Link

Wed May 28, 2008 10:30 pm

WirelessRudy you are very much right about it. And BTW your ping latency to google is 95ms? We use SEA-ME-WE 4 link to our country but never heard that kind of little ping latency to the web, here we get 250-350 ms to most of the web sites.

Thanks
Well, it was when I checked this morning. Now it is a bit slower. But I have also seen above 300ms. It fluctuates pretty much. It is prime time now here in Spain. So internet backbone might be a bit slower then during the day.

[img]
googleping.jpg
[/img]
 
User avatar
ghmorris
Member Candidate
Member Candidate
Posts: 284
Joined: Fri May 28, 2004 12:14 pm
Location: Minden, Ontario, Canada
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 1:07 am

10-15 routed hops will create problems...
What are you basing this gem of advanced network design information on?

George
 
User avatar
Equis
Forum Veteran
Forum Veteran
Posts: 888
Joined: Mon Jun 06, 2005 6:48 am

Re: Longest Multihop Link

Thu May 29, 2008 3:16 am

10-15 routed hops will create problems...
What are you basing this gem of advanced network design information on?

George
I would also like to know about these problems I must be having and don't know about....
 
User avatar
nz_monkey
Forum Guru
Forum Guru
Posts: 1825
Joined: Mon Jan 14, 2008 1:53 pm
Location: Straya
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 5:19 am

Loving the topic, and the sarcasm... ;)
http://thebrotherswisp.com/ | Mikrotik MTCNA, MTCRE, MTCINE | Fortinet FTCNA, FCNSP, FCT | Extreme Networks ENA
 
User avatar
nz_monkey
Forum Guru
Forum Guru
Posts: 1825
Joined: Mon Jan 14, 2008 1:53 pm
Location: Straya
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 5:25 am

Option 1:

Create a mesh of backhaul links between towers, use OSPF for routing and run EOIP from the edge back to core where PPPoE is terminated. This will provide for easier management and failover, but will use more bandwidth on your inter-tower links as all traffic has to pass over these and via the core PPPoE concentrator.

Option 2:

Create a mesh of backhaul links between towers, use OSPF for routing and have a PPPoE concentrator on each tower. This will be harder to manage, but will use less bandwidth on your backhaul links as traffic does not necessarily have to pass via the core.

There are probably more solutions, but these are the ones that popped into my head immediately.
http://thebrotherswisp.com/ | Mikrotik MTCNA, MTCRE, MTCINE | Fortinet FTCNA, FCNSP, FCT | Extreme Networks ENA
 
User avatar
roc-noc.com
Forum Veteran
Forum Veteran
Posts: 869
Joined: Sun Dec 02, 2007 3:27 am
Location: Rockford, IL USA
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 6:09 am

10-15 routed hops will create problems...
What are you basing this gem of advanced network design information on?

George
I would also like to know about these problems I must be having and don't know about....
I'll come to his aid on this one. I don't see any point in routing a 15 hop PtP link. And what if he is using RIP.

RIP and Hop Counts

RIP uses a hop count as the metric for the route stored in the IP routing table. The hop count is the number of routers that must be crossed to reach the desired network. RIP has a maximum hop count of 15; therefore, there can only be 15 routers between any two hosts. Networks 16 hops and greater away are considered unreachable. Hop counts can be customized so that slow links are set to multiple hops; however, the accumulated hop count between any two networks must not exceed 15.

I would certainly bridge a 15 hop PtPtPtP... rather than route it. If not I would at least tunnel through it to remove the hops.

Now if there was a reason to split some of the hops off to multipoint or creat a ring or other healing topology then routing would make some sense.

Tom
-----------------------------------------------
http://www.roc-noc.com
Tom, CCNA, ISP, USA Mikrotik Distributor
888-762-5662
-----------------------------------------------
 
User avatar
nz_monkey
Forum Guru
Forum Guru
Posts: 1825
Joined: Mon Jan 14, 2008 1:53 pm
Location: Straya
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 7:18 am

Surely you would not have 15 hops in a row! I would think there would be 15 towers in a geographic area, with each tower probably having LOS to 2 others, hence why I suggested OSPF. This would provide redundant paths.
http://thebrotherswisp.com/ | Mikrotik MTCNA, MTCRE, MTCINE | Fortinet FTCNA, FCNSP, FCT | Extreme Networks ENA
 
User avatar
Equis
Forum Veteran
Forum Veteran
Posts: 888
Joined: Mon Jun 06, 2005 6:48 am

Re: Longest Multihop Link

Thu May 29, 2008 7:34 am

Loving the topic, and the sarcasm... ;)
I meant no disrespect :-)
 
User avatar
Equis
Forum Veteran
Forum Veteran
Posts: 888
Joined: Mon Jun 06, 2005 6:48 am

Re: Longest Multihop Link

Thu May 29, 2008 7:39 am

Just did a traceroute.

One end of my network to the other is 18 hops.
Routed with OSPF

30ms average under load.

:-)
 
User avatar
ghmorris
Member Candidate
Member Candidate
Posts: 284
Joined: Fri May 28, 2004 12:14 pm
Location: Minden, Ontario, Canada
Contact:

Re: Longest Multihop Link

Thu May 29, 2008 1:06 pm


I'll come to his aid on this one. I don't see any point in routing a 15 hop PtP link. And what if he is using RIP.

<snip>
Tom
Who said RIP Tom?

We're 22 hops from edge to edge and it works great. There is absolutely NO REASON for not running 15 hops on a backbone.

Route it with OSPF or bridge it, it matter not except you are going to have to watch broadcast traffic control much more closely on a bridge, and a bridge of that size can be unhappy about reconverging quickly when you make changes to it. OSPF would be better.

But the OP wanted to know about 10-15 hops. The answer, using MT, is no problem. I'm more concerned about his bandwidth requirement being too high for a desert environment with only 15 hops across 400 miles. Long hops in the desert may be a kicker as we don't have spatial diversity in our toolbox yet...

George
 
User avatar
jwcn
Forum Guru
Forum Guru
Posts: 1501
Joined: Sun Aug 27, 2006 6:49 am
Location: Maryland, USA
Contact:

Re: Longest Multihop Link

Fri May 30, 2008 7:23 am

My understanding is you can only have 30 hops total to any given site on the Internet without having timeout problems. If I am wrong on that I stand corrected. At 15 hops on your internal network the likelihood of exceeding 30 hops total is extremely high.
 
changeip
Forum Guru
Forum Guru
Posts: 3804
Joined: Fri May 28, 2004 5:22 pm

Re: Longest Multihop Link

Fri May 30, 2008 7:34 am

traceroute typically only goes 30 hops, however the internet will route up to the TTL. TTL on many boxes is 64 or 128 or 255. You could be extra safe and change the TTL to a higher one on the way out, but probably not necessary really.

Sam
Colo and Wholesale Bandwidth Available! Sales at SanDiegoBroadband dot com
 
User avatar
jwcn
Forum Guru
Forum Guru
Posts: 1501
Joined: Sun Aug 27, 2006 6:49 am
Location: Maryland, USA
Contact:

Re: Longest Multihop Link

Sat May 31, 2008 3:23 am

Thanks for the clarification.
 
WirelessRudy
Forum Guru
Forum Guru
Posts: 3089
Joined: Tue Aug 08, 2006 5:54 pm
Location: Spain

Re: Longest Multihop Link

Sat May 31, 2008 3:44 am

traceroute typically only goes 30 hops, however the internet will route up to the TTL. TTL on many boxes is 64 or 128 or 255. You could be extra safe and change the TTL to a higher one on the way out, but probably not necessary really.

Sam
Hi guys,
We could make a contest out of it! :D Who can produce a tracert with the highest amount of hops in a ´live´ (not labaratorium) network! With default timeout settings. I just did one from a border router back into a server on the internet and already reached 23 hops. 8) If I would have done the same from the client's PC it would have been 2 more...
But I´ll bet it can be many more.... anyone? :shock:

Who is online

Users browsing this forum: No registered users and 27 guests