Community discussions

MikroTik App
 
glueck05
newbie
Topic Author
Posts: 37
Joined: Fri Jan 26, 2018 12:49 pm

100 G Network Cards // Driver

Thu Nov 26, 2020 9:58 pm

Hello,
is there a list of compatible drivers for 40G and 100G cards?
In detail i searching for:

1. Mellanox ConnectX®-5 EN or
2. Mallenox ConnectX-4 or
3. Intel E810-CAM2

Does anyone knows if drivers are included for one of these cards in ROS v7 or maybe in latest Ros 6?

Thanks,
Glueck
 
thekrzos
newbie
Posts: 28
Joined: Tue Aug 02, 2016 10:39 am

Re: 100 G Network Cards // Driver

Sat Nov 28, 2020 11:51 am

It's working with Mellanox CX515A 40Gbps
viewtopic.php?f=1&t=157596#p775319
 
User avatar
internetolog
just joined
Posts: 20
Joined: Wed Jan 31, 2007 5:40 pm
Location: Wilmington, DE
Contact:

Re: 100 G Network Cards // Driver

Mon Mar 21, 2022 7:01 am

Connectx-4 40G or 100G not working.
Will there be any update for these drivers?
 
User avatar
internetolog
just joined
Posts: 20
Joined: Wed Jan 31, 2007 5:40 pm
Location: Wilmington, DE
Contact:

Re: 100 G Network Cards // Driver

Sun Mar 27, 2022 10:12 pm

Do you know what is the Series number for that?
I am having issues with called "MT27700 Series driver"
It's working with Mellanox CX515A 40Gbps
viewtopic.php?f=1&t=157596#p775319
 
PortalNET
Member Candidate
Member Candidate
Posts: 126
Joined: Sun Apr 02, 2017 7:24 pm

Re: 100 G Network Cards // Driver

Wed Apr 12, 2023 4:36 am

hi guys

any updates on NIC cards with 40G and 100G support in RoS v7 ?

i am planning on testing this model Qsfp28 Pci 3.0 X16 0n64d3 Omni Path on a Dell R730 but not sure if its worth spending $$ buying for testing without support.
You do not have the required permissions to view the files attached to this post.
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: 100 G Network Cards // Driver

Wed Apr 12, 2023 4:48 pm

If this is Intel 100HFA016LS or other similar Intel OmniPath - this card supports OmniPath only - no support for Ethernet at all. This card will not be supported in RouterOS.
 
ib254254
just joined
Posts: 23
Joined: Sat Nov 21, 2020 10:15 pm

Re: 100 G Network Cards // Driver

Wed Apr 12, 2023 4:52 pm

hello anton,

The problem with the header is the need for 100G NIC.

Is there a product that supports this issue, or is it in your plans?
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: 100 G Network Cards // Driver

Wed Apr 12, 2023 5:05 pm

Mellanox and Chelsio adapters work with v7.
I have personally tested Mellanox CX516A and CX515A as well as Chelsio T62100-SO-CR
others should work as well. Keep in mind that only Ethernet mode is supported, if adapter is in Infiband mode, it has to be "switched" to Ethernet mode beforehand.
 
User avatar
internetolog
just joined
Posts: 20
Joined: Wed Jan 31, 2007 5:40 pm
Location: Wilmington, DE
Contact:

Re: 100 G Network Cards // Driver

Wed Apr 12, 2023 5:26 pm

I still cannot make it work with Connectx-4 and Connectx-5 cards. Passthrough or SR-IOV not working. Any update will be helpful.
But I can run with CCR2004-1G-2XS-PCIe 10G
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: 100 G Network Cards // Driver

Thu Apr 13, 2023 10:36 am

previously mentioned cards were tested on bare x86 installation, if you can send exact hypervisor used and steps taken to support@mikrotik.com i can take a look.
 
PortalNET
Member Candidate
Member Candidate
Posts: 126
Joined: Sun Apr 02, 2017 7:24 pm

Re: 100 G Network Cards // Driver

Thu Jun 22, 2023 7:07 am

Mellanox and Chelsio adapters work with v7.
I have personally tested Mellanox CX516A and CX515A as well as Chelsio T62100-SO-CR
others should work as well. Keep in mind that only Ethernet mode is supported, if adapter is in Infiband mode, it has to be "switched" to Ethernet mode beforehand.
hi thanks for the input.. tje T62100-SO-CR is a 100G card right?
 
McKajVah
just joined
Posts: 23
Joined: Sun Jun 05, 2022 10:43 pm

Re: 100 G Network Cards // Driver

Sat Jun 24, 2023 1:35 am

I still cannot make it work with Connectx-4 and Connectx-5 cards. Passthrough or SR-IOV not working. Any update will be helpful.
But I can run with CCR2004-1G-2XS-PCIe 10G
I just tried with a ConnectX-5 MCX556A-EDAT, RouterOS X86 V7.10 in a Proxmox VM with PCI-passthrough, no problems. Links came right up.
 
User avatar
internetolog
just joined
Posts: 20
Joined: Wed Jan 31, 2007 5:40 pm
Location: Wilmington, DE
Contact:

Re: 100 G Network Cards // Driver

Sat Jun 24, 2023 6:52 am

Wow! Hopping in for a test. Thanks for the info
 
PortalNET
Member Candidate
Member Candidate
Posts: 126
Joined: Sun Apr 02, 2017 7:24 pm

Re: 100 G Network Cards // Driver

Fri Sep 01, 2023 3:26 pm

Connectx-4 40G or 100G not working.
Will there be any update for these drivers?
Hi aparently it will work but you need to switch Card driver mode to Ethernet..

i Can confirm that RouterOS v7 is also working 100% with Mellanox ConnectX-3 cx354a at first when the card arrived, after inserting on the RouterOS pc server, installed version 7.11 and it did not recognized the card was not showing at all.

Só after reading and searching on the internet i found that in order to possibly work with mikrotik it was required to change working mode from VPI to eth mode.. as described on the blog website link below, this mode also applies to all the other Mellanox ConnecX family versions just need to have the correct flash firmware drivers for your specific network card.
https://blog.swineson.me/en/mellanox-co ... d-in-2021/

so i found a website showing the steps to download latest firmware version from mellanox nvidia site for all versions connecx3, 4,5,7 after downloading the windows firmware flash tool, and the correct firmware for my card version. followed all the steps and made a full backup first.

after that i made a firmware flash upgrade to the card, running on a windows 10 machine. after finally flashing the firmware sucessfully i have rebooted the pc windows with the card, and after reboot i checked that the card was on mode 3 which is auto to work vpi and eth, so i removed the card and inserted on mikrotik server, but still the card was not showing up the ethernet ports... so i shutdown the routerOS server, and rebooted the card inside the windows machine, and went to the firmware tools configuration mode and set the card to mode 2 Ethernet only. saved config and rebooted the machine .

After checking that the card was ok only with ethernet mode setup, i have removed the card and placed it back in routerOS server , switch the server back online and the 2 new ethernet ports 40G showed up, tested connection on both of them with a 40G dac cable i had, and both came online with autonegotiation showing 40Gbps..

So i wen online myself and ordered a cheap MCX455A-ECAT 100GB network card, and will follow the same procedure when the card arrives, i have already downloaded the correct firmware from nvidia website... i will keep the topic updated if it works.. in theory it should also work, as long as its set only in ethernet mode.

BTW i am running the RouterOS v7 on bare metal on a R630 with 2 E5-2697v2 for troughput testing purposes.. waiting on new toy R630 with 2 E5-2699v4 to arrive for real testing.
You do not have the required permissions to view the files attached to this post.

Who is online

Users browsing this forum: DigitalOcean [Bot] and 25 guests