Setup:
server2 - ISP - ether1-wan - hAP ac2 - ether2-vlan10 - server1
With hardware offload turned off on all interfaces iperf3 speed between server1 and server2 is around 800-900 Mbps in both directions.
If I turn hardware offload on, iperf3 speed server1 → server2 drops to 280 Mbps. Server2 → server1 speed is OK (800-900 Mbps).
What’s wrong?
HW offload ON:
user@server2:~$ iperf3 -c nemo.pp.ua
Connecting to host nemo.pp.ua, port 5201
[ 4] local 10.0.91.2 port 37288 connected to 176.38.50.112 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 108 MBytes 902 Mbits/sec 31 1.26 MBytes
[ 4] 1.00-2.00 sec 105 MBytes 878 Mbits/sec 131 356 KBytes
[ 4] 2.00-3.00 sec 106 MBytes 888 Mbits/sec 0 542 KBytes
[ 4] 3.00-4.00 sec 106 MBytes 891 Mbits/sec 11 375 KBytes
[ 4] 4.00-5.00 sec 107 MBytes 897 Mbits/sec 11 390 KBytes
[ 4] 5.00-6.00 sec 105 MBytes 881 Mbits/sec 13 403 KBytes
[ 4] 6.00-7.00 sec 98.6 MBytes 827 Mbits/sec 0 559 KBytes
[ 4] 7.00-8.00 sec 100 MBytes 843 Mbits/sec 9 520 KBytes
[ 4] 8.00-9.00 sec 107 MBytes 900 Mbits/sec 3 544 KBytes
[ 4] 9.00-10.00 sec 105 MBytes 877 Mbits/sec 2 373 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.02 GBytes 878 Mbits/sec 211 sender
[ 4] 0.00-10.00 sec 1.02 GBytes 875 Mbits/sec receiver
iperf Done.
user@server2:~$ iperf3 -c nemo.pp.ua -R
Connecting to host nemo.pp.ua, port 5201
Reverse mode, remote host nemo.pp.ua is sending
[ 4] local 10.0.91.2 port 37292 connected to 176.38.50.112 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 25.3 MBytes 212 Mbits/sec
[ 4] 1.00-2.00 sec 31.9 MBytes 268 Mbits/sec
[ 4] 2.00-3.00 sec 33.9 MBytes 284 Mbits/sec
[ 4] 3.00-4.00 sec 33.6 MBytes 282 Mbits/sec
[ 4] 4.00-5.00 sec 34.0 MBytes 285 Mbits/sec
[ 4] 5.00-6.00 sec 33.9 MBytes 284 Mbits/sec
[ 4] 6.00-7.00 sec 33.7 MBytes 282 Mbits/sec
[ 4] 7.00-8.00 sec 33.9 MBytes 284 Mbits/sec
[ 4] 8.00-9.00 sec 33.5 MBytes 281 Mbits/sec
[ 4] 9.00-10.00 sec 33.0 MBytes 277 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 327 MBytes 274 Mbits/sec 76758 sender
[ 4] 0.00-10.00 sec 327 MBytes 274 Mbits/sec receiver
iperf Done.
HW offload OFF:
user@server2:~$ iperf3 -c nemo.pp.ua
Connecting to host nemo.pp.ua, port 5201
[ 4] local 10.0.91.2 port 37296 connected to 176.38.50.112 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 107 MBytes 897 Mbits/sec 35 796 KBytes
[ 4] 1.00-2.00 sec 106 MBytes 891 Mbits/sec 12 510 KBytes
[ 4] 2.00-3.00 sec 106 MBytes 890 Mbits/sec 0 652 KBytes
[ 4] 3.00-4.00 sec 105 MBytes 884 Mbits/sec 12 351 KBytes
[ 4] 4.00-5.00 sec 106 MBytes 886 Mbits/sec 0 535 KBytes
[ 4] 5.00-6.00 sec 106 MBytes 891 Mbits/sec 5 482 KBytes
[ 4] 6.00-7.00 sec 107 MBytes 895 Mbits/sec 2 440 KBytes
[ 4] 7.00-8.00 sec 106 MBytes 892 Mbits/sec 6 349 KBytes
[ 4] 8.00-9.00 sec 107 MBytes 898 Mbits/sec 0 535 KBytes
[ 4] 9.00-10.00 sec 95.7 MBytes 803 Mbits/sec 20 436 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.03 GBytes 883 Mbits/sec 92 sender
[ 4] 0.00-10.00 sec 1.02 GBytes 880 Mbits/sec receiver
iperf Done.
user@server2:~$ iperf3 -c nemo.pp.ua -R
Connecting to host nemo.pp.ua, port 5201
Reverse mode, remote host nemo.pp.ua is sending
[ 4] local 10.0.91.2 port 37300 connected to 176.38.50.112 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 97.1 MBytes 814 Mbits/sec
[ 4] 1.00-2.00 sec 108 MBytes 904 Mbits/sec
[ 4] 2.00-3.00 sec 106 MBytes 885 Mbits/sec
[ 4] 3.00-4.00 sec 107 MBytes 895 Mbits/sec
[ 4] 4.00-5.00 sec 107 MBytes 894 Mbits/sec
[ 4] 5.00-6.00 sec 104 MBytes 868 Mbits/sec
[ 4] 6.00-7.00 sec 108 MBytes 902 Mbits/sec
[ 4] 7.00-8.00 sec 108 MBytes 907 Mbits/sec
[ 4] 8.00-9.00 sec 108 MBytes 910 Mbits/sec
[ 4] 9.00-10.00 sec 107 MBytes 895 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.03 GBytes 888 Mbits/sec 3620 sender
[ 4] 0.00-10.00 sec 1.03 GBytes 888 Mbits/sec receiver
iperf Done.
supout.rif.zip (702 KB)
