[SOLVED] Site to Site VPN (2 Mikrotik) Wireguard (Download Fast, Upload Really Slow)

RouterOS
1

Hi. I have a Site A that has 400Mbps download, and 50mbps upload from the ISP.
Site B is 400 Download, 100Mbps upload.

Site A has Mikrotk R5009 running Router OS 7.19.1
Site B has Hex Refresh running Router OS 7.19.1

Site A needs to access Site B.
When I run a speed test from site Site A speed.cloudflare.com I get 57.4Mbps Download and 262kbps upload, this is consistent between my speed tests and the web browsing, file transfers are slow.

The sites are about 2000 miles from each other, geographically speaking.

I did the usual MSS Clamping tricks and disabled fast track on both ends. Tried lowering the MTU to 1280 as a trial.

When I run the speed test or do a file transfer the CPU on the RB5009 peaks out at 2% and the Hex Refresh is at 40%.

What am I missing? It's a very simple site to site wireguard setup.

2

Can you please try iPerf to perform the speedtest?
https://iperf.fr/iperf-download.php

3

on hex refresh try firmware 7.20beta

4

I don't have a machine or server on Site B to test iperf on. I have set up Site B to fully tunnel all the traffic from Site A to Site B for 2 clients and browsing the web is sluggish and uploading files is slow on the clients that have the traffic fully tunneled to Site B. Can I use the built in bandwidth server on the hex and rb5009?

5

If I have to I will install beta but I prefer not to on production equipment. Is there something between Router OS 7.19.1 to 7.20 Beta 7 versions that affects the hex refresh wireguard throughput?

6

I encountered a problem with wireguard on hex refresh(Strange wireguard speed on ax lite), problematic versions from 7.15.3 to 7.19.4,
i don't know if this will help in your case,

but version 7.20 does contain fixes for port #1 hex refresh, so you'll have to update anyway

7

Gotcha. I saw that issue as well as I was browsing the forums before purchasing and I'm using ether2 as the WAN port on the hex. I suppose I can upgrade to the beta version to give it a shot.

I'm wondering though since Site A is on CGNAT if that makes a difference.

8

I updated to 7.20 Beta 7 and issues gone. Transfer speeds are what I expect now. Hex is much more responsive.

Thanks for that.

9

glad it helped you.

unfortunately, the same problem is present on AX Light and there is no fix for it, I tried to create a ticket in support, but they first closed it, and then simply ignored it.