Gauging interest here…
I have two projects going on.
-
I am using a TrueNAS VM on a Proxmox host to import the NVMe drives from my RDS2216 via nvme-over-tcp and share those via NFS/SMB. This allows me to run ZFS over the drives.
-
I was successful tonight in getting a test version of TrueNAS Scale ARM64 working on my RDS2216 in a container using qemu-arm. I’ll document it later in this thread. Throughput still leaves a lot to be desired (2Gbps only) because I haven’t figured out how to improve upon qemu’s networking to the RDS2216. But local small-block R/W IOPS in the VM are far better than with the remote TrueNAS via nvme-over-tcp from the RDS2216. That, and it would be nice to have all the compute done on the same box.
I plan to share /app YAML and other configs for the container method later in this thread, as well as nvme-over-tcp setup for those interested.
(Update: iperf3 tests show 7Gbps into the VM, 2Gbps out, regardless of remote host type and NICs. It’s similar to the numbers I’m getting to a vanilla container running iperf3, so the RouterOS veth interface may be the bottleneck.)