Community discussions

MikroTik App
 
User avatar
cfikes
Member Candidate
Member Candidate
Topic Author
Posts: 106
Joined: Mon Dec 08, 2014 9:14 pm
Location: Texas
Contact:

CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Thu Apr 21, 2022 7:34 pm

I think I already know the answer to this, but will ask anyway. CCR2004-1G-2XS-PCIe is a really affordable 25Gig "NIC" coming in at around half the cost of some others. Would be awesome to include in a system for hyper convergence, but does it support any form of RDMA? I cannot find any information on this.

Thanks!
 
User avatar
nz_monkey
Forum Guru
Forum Guru
Posts: 2095
Joined: Mon Jan 14, 2008 1:53 pm
Location: Over the Rainbow
Contact:

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Fri Apr 22, 2022 9:19 am

It does not support any kind of RDMA.

I think the best use case for the CCR2004-1G-2XS-PCIe in a hyperconverged infrastructure is to form a network fabric between nodes and offload the VXLAN/eVPN functionality. Or to provide a L3 firewall in front of the Hypervisor node.
 
User avatar
Larsa
Forum Guru
Forum Guru
Posts: 1025
Joined: Sat Aug 29, 2015 7:40 pm
Location: The North Pole, Santa's Workshop

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Fri Apr 22, 2022 9:43 am

Not with L2 (IB/RoCE) but L3 (iWARP) would probably work fine.
 
mada3k
Long time Member
Long time Member
Posts: 682
Joined: Mon Jul 13, 2015 10:53 am
Location: Sweden

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Fri Apr 22, 2022 4:52 pm

Probably the wrong choise for general storage network and such things.
 
User avatar
StubArea51
Trainer
Trainer
Posts: 1739
Joined: Fri Aug 10, 2012 6:46 am
Location: stubarea51.net
Contact:

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Fri Apr 22, 2022 6:51 pm

It does not support any kind of RDMA.

I think the best use case for the CCR2004-1G-2XS-PCIe in a hyperconverged infrastructure is to form a network fabric between nodes and offload the VXLAN/eVPN functionality. Or to provide a L3 firewall in front of the Hypervisor node.

All of this right here ^^^^^

EVPN all the things :)
 
User avatar
Larsa
Forum Guru
Forum Guru
Posts: 1025
Joined: Sat Aug 29, 2015 7:40 pm
Location: The North Pole, Santa's Workshop

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Sat Apr 23, 2022 1:01 am

When it comes to combined compute and storage nodes which is the most common implementation of hyper convergence it will work fine using L3. Hyper convergence of pure storage networks usually requires tailor made L2 switches using asics for minimum latency and maximum throughput and to achieve full wire speed through all ports simultaneously.
 
User avatar
Larsa
Forum Guru
Forum Guru
Posts: 1025
Joined: Sat Aug 29, 2015 7:40 pm
Location: The North Pole, Santa's Workshop

Re: CCR2004-1G-2XS-PCIe In Hyper Converged Infrastructure

Sat Apr 23, 2022 12:40 pm

Forgot to mention that besides to iWARP (TCP), RoCEv2 (UDP) works just as well on L3. If CCR2004-1G-2XS-PCIe is able to perform L3 HW offloading for RoCEv2, it would be suitable also for a storage cluster.

Not sure what adjustments it takes to get L2 RoCEv1 (type 0x8915) get routed using 9K jumbo frames. I'll send an inquiry to the guys at STH if they might investigate the matter.

https://en.wikipedia.org/wiki/RDMA_over ... d_Ethernet

Who is online

Users browsing this forum: No registered users and 6 guests