Community discussions

MikroTik App
 
Kraklol
just joined
Topic Author
Posts: 13
Joined: Thu Mar 29, 2012 4:11 pm

CCR2004-1G-2XS-PCIe network chip

Sat Feb 19, 2022 5:38 pm

Hi,

I am interested by the CCR2004-1G-2XS-PCIe.
I see there a pass-through mode. What is the network chip used ? Which driver is used on the Linux side ? Will it be usable with another OS ?

Thank you in advance.
 
mada3k
Long time Member
Long time Member
Posts: 682
Joined: Mon Jul 13, 2015 10:53 am
Location: Sweden

Re: CCR2004-1G-2XS-PCIe network chip

Sat Feb 19, 2022 6:04 pm

Since it's Marvell-based, I guess that will be some Marvell NIC?

Very cool product.
 
User avatar
Hominidae
Member
Member
Posts: 309
Joined: Thu Oct 19, 2017 12:50 am

Re: CCR2004-1G-2XS-PCIe network chip

Sun Feb 20, 2022 1:38 pm

...but there is a switch with SFP28 ports misssing in the asssembly/line-up, isn't it?

No use buying, when the only switches available are non-MT :roll:
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Sun Feb 20, 2022 3:04 pm

https://www.youtube.com/watch?app=deskt ... e=emb_logo

Yep I expect it with big interests as well (also the price :) )

Mikrotik team, please be sure at leas https://help.mikrotik.com/docs/display/ ... t+Extender work with this PCIe cards

Why this is important .. I will not mention a company from San Francisco and Fabric Extenders for HP servers .. for example ... :D
I believe CCR2004-1G-2XS-PCIe is a good candidate for similar setups but on steroids \m/ :D
 
doof
just joined
Posts: 8
Joined: Wed May 27, 2020 4:37 am

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 10:18 am

Recent Linux patches suggest it will use the Atheros atl1c driver on the host side:

https://git.kernel.org/pub/scm/linux/ke ... eros/atl1c
 
User avatar
woland
Member Candidate
Member Candidate
Posts: 258
Joined: Mon Aug 16, 2021 4:49 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 11:23 am

...but there is a switch with SFP28 ports misssing in the asssembly/line-up, isn't it?

No use buying, when the only switches available are non-MT :roll:
If it is going to work well with Linux and Open/FreeBSD it would give us more flexibility and a lower price point than some Intel 10G!
I don´t yet really have a need for 25G, but the cheapest Intel 10G X520-DA2 would cost me around 120EUR.

W
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 12:20 pm

Well, of course it is important that it works with VMware ESXi and other hypervisors, nobody would put such a card in a system running native Linux (or Windows)...
Fortunately, the startup delay would not be an issue then. This system boots so incredibly slowly that RouterOS has booted 10 times by then.
 
User avatar
Hominidae
Member
Member
Posts: 309
Joined: Thu Oct 19, 2017 12:50 am

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 12:31 pm

...but there is a switch with SFP28 ports misssing in the asssembly/line-up, isn't it?

No use buying, when the only switches available are non-MT :roll:
If it is going to work well with Linux and Open/FreeBSD it would give us more flexibility and a lower price point than some Intel 10G!
I don´t yet really have a need for 25G, but the cheapest Intel 10G X520-DA2 would cost me around 120EUR.
Agreed, but that is not my point.
Assuming you put one of these in a Linux box....how do you connect to the rest of your infrastructure (LAN / WAN). IMHO SFP28 is single-line...no way for a breakout cable
There is no MT switch out there with SFP28 ports.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 12:44 pm

If it is going to work well with Linux and Open/FreeBSD it would give us more flexibility and a lower price point than some Intel 10G!
I don´t yet really have a need for 25G, but the cheapest Intel 10G X520-DA2 would cost me around 120EUR.
My guess for the price point of this card would be more like $500... check the other CCR2004 devices.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 12:47 pm

Assuming you put one of these in a Linux box....how do you connect to the rest of your infrastructure (LAN / WAN). IMHO SFP28 is single-line...no way for a breakout cable
There is no MT switch out there with SFP28 ports.
But of course you can put in an SFP+ module or DAC.
And MikroTik have switches with QSFP+ so you could make an optical link with the appropriate modules.
 
User avatar
Hominidae
Member
Member
Posts: 309
Joined: Thu Oct 19, 2017 12:50 am

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 1:01 pm

My guess for the price point of this card would be more like $500... check the other CCR2004 devices.
...it's around a 180USD/170EUR...you can place pre-orders already for that price.

But of course you can put in an SFP+ module or DAC.
Although pinouts are matching, whether these will actually work needs to be seen.
With the recent problems on CRS models with ports flapping on v7 even more so, I'd say...

And MikroTik have switches with QSFP+ so you could make an optical link with the appropriate modules.
so I get 2x10G out of 2x25G ... bad trade....I'd rather invest in a proper switch
 
User avatar
woland
Member Candidate
Member Candidate
Posts: 258
Joined: Mon Aug 16, 2021 4:49 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 1:02 pm

If it is going to work well with Linux and Open/FreeBSD it would give us more flexibility and a lower price point than some Intel 10G!
I don´t yet really have a need for 25G, but the cheapest Intel 10G X520-DA2 would cost me around 120EUR.
My guess for the price point of this card would be more like $500... check the other CCR2004 devices.
Well, lets hope you're wrong :) :
https://www.ip-sa.com.pl/ccr2004-pcie-p-6525.html

Its price is 141,26EUR. Im not so sure if it stays at that price point, but I hope it wont get much more expensive.

Woland
 
User avatar
woland
Member Candidate
Member Candidate
Posts: 258
Joined: Mon Aug 16, 2021 4:49 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 1:10 pm

Well, of course it is important that it works with VMware ESXi and other hypervisors, nobody would put such a card in a system running native Linux (or Windows)...
Fortunately, the startup delay would not be an issue then. This system boots so incredibly slowly that RouterOS has booted 10 times by then.
Native Linux is interesting as a hypervisor itself (like for Proxmox or container, or just plain KVM). Native BSD is interesting by itself, as Opnsense or pfSense is running a BSD kernel. My plan is to put such a card into my Opnsense boxes.
That would be like a never dreamed of, best of both worlds, firewall/router combination.
Still agree, that ESXi support would also be important. Windows server ? Nah...

W
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 7:35 pm

Btw ESXi is not the only popular virt solution .. proxmox is 100% pure debian also vm windows do not care for hypervisor nic drivers ..
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Tue Feb 22, 2022 9:14 pm

My guess for the price point of this card would be more like $500... check the other CCR2004 devices.
...it's around a 180USD/170EUR...you can place pre-orders already for that price.
I am amazed by this price... let's see what we get (and if it becomes available instead of postponed due to "chip shortages")...
And MikroTik have switches with QSFP+ so you could make an optical link with the appropriate modules.
so I get 2x10G out of 2x25G ... bad trade....I'd rather invest in a proper switch
You can buy 25G optical transceivers both for SFP28 and QSFP+ so it should be possible to link at 25G.
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Thu Feb 24, 2022 9:01 am

 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Sun Feb 27, 2022 12:59 am

Any idea what this passthrough actually 'look"?

Phisical port and pcie port are 2 separate ports in ros?
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Sun Feb 27, 2022 11:49 am

What I understand is that RouterOS internally sees 7 different interfaces, 3 physical ports to the outside and 4 virtual interfaces towards the PCIe, and there by default are 3 bridges that bridge between the 3 physical ports and 3 of the virtual interfaces. Or maybe a new feature allows for an even faster bridge for that purpose.
But, unless I am mistaken, the admin can remove that bridge configuration and have the card function as a normal MikroTik router.
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Mon Feb 28, 2022 10:50 am

What I understand is that RouterOS internally sees 7 different interfaces, 3 physical ports to the outside and 4 virtual interfaces towards the PCIe, and there by default are 3 bridges that bridge between the 3 physical ports and 3 of the virtual interfaces. Or maybe a new feature allows for an even faster bridge for that purpose.
But, unless I am mistaken, the admin can remove that bridge configuration and have the card function as a normal MikroTik router.
I really hope this is the case 😃
 
cvbkf
just joined
Posts: 19
Joined: Tue Mar 28, 2017 11:21 am

Re: CCR2004-1G-2XS-PCIe network chip

Tue Mar 01, 2022 11:40 pm

I really hope that the card does not consume 22W of power (without attachments) - that would be way to much.
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Wed Mar 02, 2022 12:56 am

I really hope that the card does not consume 22W of power (without attachments) - that would be way to much.
in fact 22watt is very litte, is expected because includes 4 GB of RAM, 128 MB of NAND storage, and quad-core A57 ARMv8 64-bit CPU

but

maybe MikroTik find a way to put some elements to sleep at the time when not needed to save power under certain circunstances
 
ns88ns
newbie
Posts: 30
Joined: Mon Sep 07, 2020 12:42 pm

Re: CCR2004-1G-2XS-PCIe network chip

Thu May 26, 2022 12:13 pm

How the device is represented on PCIe bus? I.e. does the card provide 4 independent PCIe network adapters or one multifunction PCIe network adapter? Does the device require PCIe bifurcation? The first PCIe network adapter looks quite different from 3 other adapters.

ESXi 5/6 have VMKLinux stack, so there is a way to use side drivers. With ESXi 7 - isn't possible anymore, only native drivers. So this device doesn't work with ESXi 7. Under Windows this device is recognized but doesn't work (code 10). So, this device is usable neither with ESXi nor with HYPER-V. FreeBSD has all required functionality to build a powerful router/firewall without this toy. Linux/KVM-based small virtualization farm? Possible. At the moment, the device looks like a toy for enthusiasts.
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Thu May 26, 2022 7:02 pm

Proxmox ? I can say is not only for enthusiast
Also I hope they will be able to be used somehow as bridge extenders for mikrotik switches ...
 
ns88ns
newbie
Posts: 30
Joined: Mon Sep 07, 2020 12:42 pm

Re: CCR2004-1G-2XS-PCIe network chip

Thu May 26, 2022 7:42 pm

Isn't Proxmox based on Linux/KVM? Also, I don't see the Proxmox being used widely in Enterprise.
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Sun May 29, 2022 9:52 am

Isn't Proxmox based on Linux/KVM? Also, I don't see the Proxmox being used widely in Enterprise.
I belive this topic is for other place, and yes proxmox is used .. probably not widely but same statmet apply and for other products
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe ki network chip

Sun May 29, 2022 9:54 am

Actually is someone was able to test CCR2004-1G-2XS-PCIe ? Here in BG probably will be aveilable at September acrding my local distributor
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe ki network chip

Fri Jun 10, 2022 9:36 am

Actually is someone was able to test CCR2004-1G-2XS-PCIe ? Here in BG probably will be aveilable at September acrding my local distributor
I have received my PCIe router, in Canada, from American ISP supplier. I'm in the process of setting up to be my server room's new core router.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 10:34 am

What OS are you going to run? It would be very interesting to see report on which OSes it actually works on (aside from "newest Linux kernel versions").
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 11:04 am

What OS are you going to run? It would be very interesting to see report on which OSes it actually works on (aside from "newest Linux kernel versions").
The destined host-system at this time will almost certainly be a Windows system, where the interfaces to appear under device manager, however they report as having a problem "The device could not be started."

I have a few TrueNAS boxes (FreeBSD based OS), that are all potential recipients of this new router, and they are updated to latest OS version regularly, however I'm waiting on the proper SFP modules to do further testing. The interfaces appear and don't report errors but I cannot assign any IP to them under TrueNAS at this time (probably my SFP problem). ** will update when they arrive.

There is a slight chance I'll deploy an entirely new server to utilize the passthrough capabilities of the card, but I'll need the right use case for that to happen; maybe I'll deploy a new Load Balancer for my server room, in which case this would be perfect for.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 11:20 am

Is there even support for Windows? I do not see a downloadable driver... or does it recognize it as another brand of network card, like Intel?
When Windows sees "a PCIe network device" it will create a device entry but unless there is a driver available for it you will not be able to do anything with it.
As I understand, MikroTik sent a driver to the Linux kernel developers and it got accepted, but I do not know about support of other OSes.
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 11:26 am

Is there even support for Windows? I do not see a downloadable driver... or does it recognize it as another brand of network card, like Intel?
When Windows sees "a PCIe network device" it will create a device entry but unless there is a driver available for it you will not be able to do anything with it.
As I understand, MikroTik sent a driver to the Linux kernel developers and it got accepted, but I do not know about support of other OSes.
I'm not at my test system to see at the moment but I believe it comes up as Qualcomm Atheros PCIe device (4 of them), when I clicked on properties and clicked to check for driver updates it says the latest driver is already installed. I'm fairly certain it's not a MikroTik driver, rather a generic driver, that's detecting it.

It does show up as 4 PCIe network devices but they show up with the exclamation mark and report as having an error and not being able to be started.
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 1:14 pm

@tensioncore @pe1chl
this card currently has drivers in Linux latest Linux kernels and BSD.

@ns88ns
no bifurcation required, Linux system will see 4 network devices
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 2:01 pm

@antonsb is there any planning for other OS/hypervisor support, e.g. VMware ESXi 7.x ?
 
User avatar
antonsb
MikroTik Support
MikroTik Support
Posts: 385
Joined: Sun Jul 24, 2016 3:12 pm
Location: Riga, Latvia

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jun 10, 2022 3:44 pm

@antonsb is there any planning for other OS/hypervisor support, e.g. VMware ESXi 7.x ?
we will look into it
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Sat Jun 11, 2022 9:16 am

MikroTikPCIe-Windows.jpg
Here's how it shows up in Windows
You do not have the required permissions to view the files attached to this post.
 
draatman
just joined
Posts: 2
Joined: Thu Mar 17, 2022 5:30 pm

Re: CCR2004-1G-2XS-PCIe network chip

Thu Jun 30, 2022 6:39 pm

any update on the drivers for windows ?
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 6:08 am

any update on the drivers for windows ?
I second this interest. If Windows drivers are ever developed, you can guarantee I'll be buying several more of these PCIe cards for use in my server room and datacenter locations!
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 9:57 am

Are people really still running Windows on bare hardware for plain server purposes? I thought that would have died off 10 years ago...
In some special circumstances, I can understand. But in the generic case I would expect the vast majority of datacenter servers to run hypervisors.
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 10:39 am

Most of my Windows infrastructure is run on hypervisors, but these days, you must understand there are many similarities to running Windows vs Linux, Unix, etc. on bare metal, too. Windows has containers, kubernetes, docker and the like, even support for linux terminal on Windows.

I can infact deploy Windows systems with Ubuntu MAAS, with linux subsystems, *nix VMs etc, etc. (crazy, right? haha)

Windows is not ideal for storage but I've run a Windows shop for web hosting and web services for over 14 years and at the end of the day it still fulfills the requirements I have. *nix still has a place in my infrastructure, and mostly for data storage, backup, load balancing, NVRs, firewalls, etc.
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 11:44 am

But then you would have to reboot the whole server including all its containers once or more a month just to install updates... that does not sound very convenient?
 
OliZi
just joined
Posts: 19
Joined: Sun Feb 06, 2022 3:53 am
Location: Austria

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 12:12 pm

Is there any news about support for esxi7?
It would be great to have one card in the esxi and have enough interfaces ;-)
The card looks great, and I have it already installed - but without Driver’s for esxi I miss something.....
 
technick
newbie
Posts: 29
Joined: Fri Jun 10, 2022 5:03 am
Location: Canada
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Jul 01, 2022 12:34 pm

... before we digress too far... it's not that bad, really.
Most of the rare times a reboot is required for updates, my systems go down for under a minute, staying well within my SLA, of 99.99%... and updates don't always require a reboot since Windows Server introduced hotpatching. Most updates get applied without any dowtime.

** I have a 10+ servers with 120+ days of uptime**
 
draatman
just joined
Posts: 2
Joined: Thu Mar 17, 2022 5:30 pm

Re: CCR2004-1G-2XS-PCIe network chip

Wed Nov 16, 2022 9:14 pm

Sou i takes that no update on the windows drives for the MikroTik CCR2004-1G-2XS-PCIe.

Even if it yest a driver for the server version of windows. How can i request a drivers for MikroTik CCR2004-1G-2XS-PCIe sou can start a getting name to get the drivers the more demand for it the faster the driver will be available. ?
 
dakobg
Member Candidate
Member Candidate
Posts: 120
Joined: Mon Nov 06, 2017 8:58 am

Re: CCR2004-1G-2XS-PCIe network chip

Thu Nov 17, 2022 11:55 pm

Is there any news about support for esxi7?
It would be great to have one card in the esxi and have enough interfaces ;-)
The card looks great, and I have it already installed - but without Driver’s for esxi I miss something.....
ESXi is almost very closed system which mean in most cases VMW must collaborate for drivers :)
For Windows .. there is a big chance(or I hope so ) Mikrotik to provide drivers in some point :)

For now I do not see anything wrong for
1. CCR2004-1G-2XS-PCIe + Proxmox PVE
2. CCR2004-1G-2XS-PCIe as a stand alone router with pcie-raiser extender card (and some DIY eforts : ) )
3. or any other open source OS/system
 
User avatar
chechito
Forum Guru
Forum Guru
Posts: 2989
Joined: Sun Aug 24, 2014 3:14 am
Location: Bogota Colombia
Contact:

Re: CCR2004-1G-2XS-PCIe network chip

Fri Nov 18, 2022 1:06 am

Esxi7 has some Linux underneat some time ago i had to add a chelsio nic driver to it manually
 
pe1chl
Forum Guru
Forum Guru
Posts: 10183
Joined: Mon Jun 08, 2015 12:09 pm

Re: CCR2004-1G-2XS-PCIe network chip

Fri Nov 18, 2022 10:53 am

ESXi is almost very closed system which mean in most cases VMW must collaborate for drivers :)
For Windows .. there is a big chance(or I hope so ) Mikrotik to provide drivers in some point :)
For Windows you need help from Microsoft to validate and sign the driver.
I don't think there is much demand for a Windows driver that requires you to enable "install unsigned drivers"...
(Is that even still possible on Server versions?)

Who is online

Users browsing this forum: No registered users and 12 guests