Firmware downloads are slow and often fail

Here are some hosted domains, provided by ipinfo.io

Domains on AS5518 - SIA Tet
IP Address		Domain
78.28.227.12	pilseta24.lv
195.10.216.188	di.lv
80.233.148.188	teobroker.lv
78.28.250.100	mailingsdatemyage.com
62.63.162.194	trimek.lv
195.10.216.194	mammadaba.lv
213.175.126.235	r7ps.lv
195.10.216.186	nti.lv
78.28.242.50	mazsalaca.lv
213.175.75.23	moove.lv
80.233.232.94	audzetsbezantibiotikam.lv
213.175.125.46	eglufestivals.lv
78.28.215.8		rezpvsk.lv
213.175.74.38	electrumviedamaja.eu
213.175.74.10	ideabits.com
213.175.75.2	draugiem.lv
80.233.232.234	xn--urnals-2pb.lv
194.19.245.137	nsr.lv
80.233.235.236	dobelesslimnica.lv
194.19.236.10	sonora.mn
80.233.140.41	backscreen.tv
194.19.244.95	trava.lv
194.19.245.189	apmacibasizaugsme.lv
213.175.75.1	draugiem.lv
213.175.74.1	otaku.lv
194.19.240.52	kemperuserviss.lv
80.233.182.162	alksn.is
213.175.117.138	mamma.lv
78.28.252.133	718.lv
80.233.239.98	lettonia.lv
80.233.232.28	konstruktors.com
78.28.252.124	bonda.lv
80.233.141.154	raduraksti.lv
80.233.232.8	press.lv
195.10.216.210	vaults.lv
213.175.74.120	1work.com
80.233.232.139	kreiss-logistik.de
80.233.165.129	fnconsult.com
78.28.252.127	manaslecas.eu
78.28.209.215	balcia.pl
80.233.232.79	abmteam.lv
80.233.181.69	bolbatenko.pro
80.233.148.253	latekss.com
80.233.232.44	mindlink.lv
213.175.65.35	ininfo.tv
80.233.232.121	beautyexperts.lv
194.19.245.194	turbodieselracing.lv
80.233.139.26	mlblv.lv
80.233.170.130	global-assistance.lt
78.28.223.34	fundist.dev

My winbox was failing to download so I did a netstat -b with a admin command prompt.. The data was coming straight from riga to the US and it looks like a New York - London link is the slowdown:

C:\Windows\System32>tracert 159.148.147.251

Tracing route to 159.148.147.251 over a maximum of 30 hops

  1     6 ms     3 ms     2 ms  10.0.54.1
  2    10 ms     9 ms    10 ms  71.181.84.1
  3    10 ms     9 ms    13 ms  7.l.burlvtma97w.vt.consolidated.net [64.222.213.131]
  4    15 ms    73 ms    14 ms  38.104.52.78
  5     *        *        *     Request timed out.
  6    13 ms   106 ms    15 ms  be3255.ccr31.bos01.atlas.cogentco.com [66.28.4.29]
  7    14 ms    57 ms    13 ms  telia.bos01.atlas.cogentco.com [154.54.9.26]
  8    16 ms    70 ms    98 ms  bost-b5-link.ip.twelve99.net [62.115.140.180]
  9    21 ms    18 ms    19 ms  nyk-bb5-link.ip.twelve99.net [62.115.122.202]
 10   150 ms   206 ms   203 ms  ldn-bb1-link.ip.twelve99.net [62.115.139.245]
 11   178 ms   190 ms   206 ms  hbg-bb3-link.ip.twelve99.net [62.115.137.215]
 12   215 ms   297 ms   208 ms  war-b3-link.ip.twelve99.net [62.115.120.69]
 13   220 ms   207 ms   202 ms  riga-b6-link.ip.twelve99.net [62.115.139.55]
 14   219 ms   214 ms   191 ms  riga-b8-link.ip.twelve99.net [62.115.143.92]
 15   199 ms   205 ms   203 ms  riga-b4-link.ip.twelve99.net [62.115.142.89]
 16   214 ms   203 ms   203 ms  riga-b5-link.ip.twelve99.net [62.115.138.111]
 17   211 ms   203 ms   203 ms  siatet-ic-332270.ip.twelve99-cust.net [213.248.84.33]
 18     *        *        *     Request timed out.
 19     *        *        *     Request timed out.
 20     *        *        *     Request timed out.
 21   176 ms   203 ms   203 ms  159.148.147.251

Trace complete.

https://lg.twelve99.net/?type=traceroute&router=bost-b5&address=159.148.147.251

in case anyone wants to poke around from the perspective of the ISP being slow.

I don't think it's quite as easy as "slow ping = crap downloads". If I get a VPN to exit at Riga, it still has to get there from the otherside of the world, so suffers ping.

Even when downloading from Western Europe I found the performance quite average, however from Latvia it is wicked fast.

I'm fairly sure the issue is in those first few hops, just trying to nail it down is pretty hard.

@normis are you guys at HQ are aware of AS traverse/peering problems yet? it has been a while now and it did not really got any better for customers.

i mean you surely have AS-PATH monitoring in place ?

Like other users said, I have to find a VPN with Latvia exit node to "fix" my download speed issue.

:~$ curl -4 -L -o /dev/null https://download.mikrotik.com/routeros/7.24.1/chr-7.24.1.vhd.zip
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 43.1M 100 43.1M 0 0 3250k 0 0:00:13 0:00:13 --:--:-- 3872k

:~$ traceroute download.mikrotik.com
traceroute to download.mikrotik.com (159.148.147.251), 30 hops max, 60 byte packets
1 _gateway (192.168.88.1) 0.211 ms 0.175 ms 0.245 ms
2 10.2.0.1 (10.2.0.1) 220.048 ms 220.026 ms 220.244 ms
3 196.196.51.73 (196.196.51.73) 220.993 ms 227.400 ms 227.473 ms
4 te0-3-1-15.rcr51.rix01.atlas.cogentco.com (149.14.74.120) 221.173 ms 221.560 ms 221.693 ms
5 be5388.ccr21.sto03.atlas.cogentco.com (154.54.63.226) 228.054 ms 228.167 ms 228.126 ms
6 be4593.ccr21.sto01.atlas.cogentco.com (154.54.75.85) 228.482 ms be4649.ccr21.sto01.atlas.cogentco.com (130.117.3.129) 228.015 ms 227.965 ms
7 vodafone.ams05.atlas.cogentco.com (130.117.14.174) 228.584 ms 228.884 ms 228.858 ms
8 sto-bb1-link.ip.twelve99.net (62.115.139.180) 244.095 ms 243.970 ms sto-bb2-link.ip.twelve99.net (62.115.139.186) 241.840 ms
9 riga-b5-link.ip.twelve99.net (62.115.140.1) 230.587 ms 230.860 ms 230.717 ms
10 siatet-ic-332270.ip.twelve99-cust.net (213.248.84.33) 229.948 ms 229.474 ms 232.084 ms
11 * * *
12 * * *
13 * * *
14 * * *
15 * * *

Some months ago, via lattetecom was fast. Via twelve99 is slow. Today test about 60kbs. PL, not so far away.

Downloading firmware updates one file at a time prevents them from failing.

No, not quite. I does improve the situation a lot however.
I did some updates this morning and ho lee sheet it was running slow and a few attempts timed out.

Just did ROS ARM 7.23.7, 7.24.5, and 7.24rc1, nothing took more than 60 seconds or failed from the north central US.

FWIW . . .

I have similar issues as OP.

Downloads (firmware updates, image downloads via Router or browser, etc) the last few months or so have been significantly slower than in the past. And its erratic where either the download starts fast and slows down or starts slow and speeds up. It will also sometimes fail.

Downloads used to take 5-10 secs, now ill wait over 1-2 mins for the tiny lil 12M file.

From western Europe I never saw slow or failed downloads from download.mikrotik.com in the last weeks or months. With traceroute, I see ping times climbing from ~5ms to ~40ms once reaching ip.twelve99.net (62.115.0.0/16) hops, but download speed is stable around 10MB/s

$ wget https://download.mikrotik.com/routeros/7.24.5/routeros-7.24.5-arm64.npk
Resolving download.mikrotik.com (download.mikrotik.com)... 159.148.147.251
Connecting to download.mikrotik.com (download.mikrotik.com)|159.148.147.251|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 13922637 (13M) [application/octet-stream]
Saving to: ‘routeros-7.24.5-arm64.npk’

routeros-7.24.5-arm64.npk     100%[=================================================>]  13.28M
10.8MB/s    in 1.2s

The OP edited the very first post as resolved and whole thread lost it's sense - frankly it was done in other topics too - and I wonder if the original text should be restored.

@Md26sGs8F5HN2VEU9LBw

Please do not do that ... if you want to close the topic, it could be done without loosing the history.
Now we have kind of a discussion about "who knows what it was about?".

I don't always agree with your moderation, but I think that what you are proposing is reasonable. Deleting an opening post after other people have put in their thoughts is anti social.

You were even more tactful than I would have been in explaining it.
It certainly isn't respectful towards others.
I agree with restoring both the title and the OP.

Done.