I was pinging from the router itself to 18.104.22.168, and the delay was same way measurable on WAN port. Upstream then? My ISP? What I could try is to connect out on VPN and see if the issue persists over that.
Flow control is set to off on all interfaces.