I am trying to achieve expected large sequential read speeds over 10g from my FreeNAS to my Windows box (Mellanox ConnectX-3 NICs on both ends). My expectation with a 6x3TB WD Red RAID-Z2 pool is 350-500MB/s read speeds from the NAS to my windows box.
At the moment I have just about eliminated my network setup as the bottleneck but the "Actual MTU" and "L2MTU" settings under "Interfaces" in the RouterOS of my CRS305-1G-4S+ are confusing me.
My current settings
CRS305-1G-4S+: Actual MTU: 9014; L2MTU: 9014
Windows Box: MTU 9014
FreeNAS: MTU 9014
IPerf benchmarking results
Sender (server) = FreeNAS: 9.87 Gb/s
Receiver (client) = FreeNAS: 8.62 Gb/s
Windows SMB transfer speed testing
Whilst testing I create a RAM disk on my Windows machine. I also never use the same movie file (ca. 8GB) twice to avoid the FreeNAS machine from using what is cached in RAM. All testing was done on a FreeNAS dataset with compression turned off to get the most accurate results, that are not skewed in any way.
As far as I understand RAID-Z2 my write speeds are perfectly adequate seeing as the data has to be written to multiple drives due to the 2 disk parity.
The read speeds however should be SIGNIFICANTLY higher because the data can be read from multiple drives at the same time.
1.) The Windows MTU and FreeNAS MTU values should correspond to which MTU value (Actual or L2?) on the CRS305-1G-4S+ Interface?
2.) According to this website https://wiki.mikrotik.com/wiki/Manual:M ... uterBoards the max L2MTU is 10218.
What does this mean for the MTU values on all the aforementioned devices?
Thanks in advance for any help!