Community discussions

MikroTik App
 
User avatar
vinigas
just joined
Topic Author
Posts: 18
Joined: Thu Jun 18, 2020 8:48 pm
Location: Lithuania

CCR2004-1G-2XS-PCIe possible drivers Linux6.5.7 issue; PCI finds, but no eth interfaces

Thu Oct 19, 2023 7:18 pm

Just received the card and installed it into PC.

Network adapters from this card not appearing in ifconfig at all. Network card is put in gaming/workstation rig (to externalize firewall and easy familiar configing for dual-boot LinuxWindows PC).

Motherboard: ASUS TUF Gaming X570-Plus (Wi-Fi) third PCI slot.
CPU: AMD 5950X
Haven't managed to update MikroTikPCIe yet.

---

I find Mikrotik PCIe via lspci

and also tried running commands from brochure:

echo "1" > /sys/bus/pci/devices/0000\:03\:00.0/remove
sleep 2
echo "1" > /sys/bus/pci/rescan

MikroTik PCIe is readded as PCI device succesfully. But network interface are not added.

---

I tried running:
modprobe atl1c

---

Tried disabling and enabling PCIe UEFI ReBAR. No difference.

---
Some dmesg logs (PCI address is pci 0000:05:00.X ):

[root@shrekmobile v-ini]# uname -r
6.5.7-zen2-1-zen

[root@shrekmobile v-ini]# dmesg | grep "pci 0000:05:"
[ 0.862090] pci 0000:05:00.0: [1969:1083] type 00 class 0x020000
[ 0.862116] pci 0000:05:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 0.862185] pci 0000:05:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.862262] pci 0000:05:00.0: PME# supported from D0
[ 0.862348] pci 0000:05:00.0: 31.504 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:03:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 0.862470] pci 0000:05:00.1: [1969:1083] type 00 class 0x020000
[ 0.862497] pci 0000:05:00.1: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 0.862563] pci 0000:05:00.1: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.862634] pci 0000:05:00.1: PME# supported from D0
[ 0.862774] pci 0000:05:00.2: [1969:1083] type 00 class 0x020000
[ 0.862800] pci 0000:05:00.2: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 0.862865] pci 0000:05:00.2: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.862936] pci 0000:05:00.2: PME# supported from D0
[ 0.863075] pci 0000:05:00.3: [1969:1083] type 00 class 0x020000
[ 0.863101] pci 0000:05:00.3: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 0.863170] pci 0000:05:00.3: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.863242] pci 0000:05:00.3: PME# supported from D0
[ 0.893922] pci 0000:05:00.0: BAR 0: no space for [mem size 0x00010000 64bit]
[ 0.893923] pci 0000:05:00.0: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 0.893925] pci 0000:05:00.1: BAR 0: no space for [mem size 0x00010000 64bit]
[ 0.893926] pci 0000:05:00.1: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 0.893927] pci 0000:05:00.2: BAR 0: no space for [mem size 0x00010000 64bit]
[ 0.893929] pci 0000:05:00.2: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 0.893930] pci 0000:05:00.3: BAR 0: no space for [mem size 0x00010000 64bit]
[ 0.893932] pci 0000:05:00.3: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 0.896177] pci 0000:05:00.0: Adding to iommu group 25
[ 0.896254] pci 0000:05:00.1: Adding to iommu group 25
[ 0.896332] pci 0000:05:00.2: Adding to iommu group 25
[ 0.896410] pci 0000:05:00.3: Adding to iommu group 25

---

Manually removed PCI and rescanned PCI:

[root@shrekmobile v-ini]# dmesg
[ 3471.319294] pci 0000:05:00.0: [1969:1083] type 00 class 0x020000
[ 3471.319322] pci 0000:05:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3471.319390] pci 0000:05:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3471.319461] pci 0000:05:00.0: PME# supported from D0
[ 3471.319541] pci 0000:05:00.0: 31.504 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:03:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 3471.319762] pci 0000:05:00.0: Adding to iommu group 25
[ 3471.319951] pci 0000:05:00.1: [1969:1083] type 00 class 0x020000
[ 3471.319976] pci 0000:05:00.1: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3471.320045] pci 0000:05:00.1: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3471.320110] pci 0000:05:00.1: PME# supported from D0
[ 3471.320296] pci 0000:05:00.1: Adding to iommu group 25
[ 3471.320339] pci 0000:05:00.2: [1969:1083] type 00 class 0x020000
[ 3471.320363] pci 0000:05:00.2: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3471.320427] pci 0000:05:00.2: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3471.320495] pci 0000:05:00.2: PME# supported from D0
[ 3471.320721] pci 0000:05:00.2: Adding to iommu group 25
[ 3471.320767] pci 0000:05:00.3: [1969:1083] type 00 class 0x020000
[ 3471.320791] pci 0000:05:00.3: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3471.320852] pci 0000:05:00.3: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3471.320918] pci 0000:05:00.3: PME# supported from D0
[ 3471.321119] pci 0000:05:00.3: Adding to iommu group 25
[ 3471.321389] pcieport 0000:03:02.0: BAR 14: no space for [mem size 0x00100000]
[ 3471.321392] pcieport 0000:03:02.0: BAR 14: failed to assign [mem size 0x00100000]
[ 3471.321394] pci 0000:05:00.0: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3471.321396] pci 0000:05:00.0: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3471.321397] pci 0000:05:00.1: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3471.321399] pci 0000:05:00.1: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3471.321400] pci 0000:05:00.2: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3471.321401] pci 0000:05:00.2: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3471.321403] pci 0000:05:00.3: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3471.321404] pci 0000:05:00.3: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3471.321501] atl1c 0000:05:00.0: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3471.321504] atl1c 0000:05:00.0: cannot map device registers
[ 3471.321536] atl1c: probe of 0000:05:00.0 failed with error -5
[ 3471.321591] atl1c 0000:05:00.1: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3471.321593] atl1c 0000:05:00.1: cannot map device registers
[ 3471.321622] atl1c: probe of 0000:05:00.1 failed with error -5
[ 3471.321670] atl1c 0000:05:00.2: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3471.321672] atl1c 0000:05:00.2: cannot map device registers
[ 3471.321701] atl1c: probe of 0000:05:00.2 failed with error -5
[ 3471.321748] atl1c 0000:05:00.3: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3471.321750] atl1c 0000:05:00.3: cannot map device registers
[ 3471.321777] atl1c: probe of 0000:05:00.3 failed with error -5

Will append this post with more info as I go deeper in this rabbit hole.
 
User avatar
netravnen
Frequent Visitor
Frequent Visitor
Posts: 61
Joined: Sun Dec 31, 2017 2:48 am

Re: CCR2004-1G-2XS-PCIe possible drivers Linux6.5.7 issue; PCI finds, but no eth interfaces

Thu Oct 19, 2023 7:42 pm

You will lose this device under windows. No driver support.

Running stock kernel from upstream Debian or Ubuntu? (Can't see which linux based distribution you use.)

Have the card myself running under proxmox with latest upstream 6.4.x kernel from proxmox no-subscription repository.

To configure the card connect a machine to the cards external ethernet port and fire up winbox to find the card by its maxc address (or 192.168.88. 1).
 
User avatar
vinigas
just joined
Topic Author
Posts: 18
Joined: Thu Jun 18, 2020 8:48 pm
Location: Lithuania

Re: CCR2004-1G-2XS-PCIe possible drivers Linux6.5.7 issue; PCI finds, but no eth interfaces

Thu Oct 19, 2023 7:44 pm

EndeavourOS ArchLinux KDE Plasma Linux GRUB. Everything up-to-date, not very custom under hood.

Under Windows I planned to use slower MGMT Ethernet port it has (I don't need more than 1G on Windows anyways) which would be plugged back into itself (motherboard built-in ethernet). Also maybe someday real Windows support will be added.

Updated MikroTik PCIe ROS to v7.12rc2 with MGMT port and other PC.

~# echo "1" > /sys/bus/pci/devices/0000\:05\:00.0/remove
~# echo "1" > /sys/bus/pci/devices/0000\:05\:00.1/remove
~# echo "1" > /sys/bus/pci/devices/0000\:05\:00.2/remove
~# echo "1" > /sys/bus/pci/devices/0000\:05\:00.3/remove
~# echo "1" > /sys/bus/pci/rescan

~# dmesg
[ 3457.981686] pci 0000:05:00.0: [1969:1083] type 00 class 0x020000
[ 3457.981713] pci 0000:05:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3457.981782] pci 0000:05:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3457.981852] pci 0000:05:00.0: PME# supported from D0
[ 3457.981957] pci 0000:05:00.0: 31.504 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:03:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 3457.982179] pci 0000:05:00.0: Adding to iommu group 25
[ 3457.982359] pci 0000:05:00.1: [1969:1083] type 00 class 0x020000
[ 3457.982383] pci 0000:05:00.1: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3457.982455] pci 0000:05:00.1: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3457.982520] pci 0000:05:00.1: PME# supported from D0
[ 3457.982720] pci 0000:05:00.1: Adding to iommu group 25
[ 3457.982763] pci 0000:05:00.2: [1969:1083] type 00 class 0x020000
[ 3457.982787] pci 0000:05:00.2: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3457.982848] pci 0000:05:00.2: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3457.982912] pci 0000:05:00.2: PME# supported from D0
[ 3457.983106] pci 0000:05:00.2: Adding to iommu group 25
[ 3457.983147] pci 0000:05:00.3: [1969:1083] type 00 class 0x020000
[ 3457.983171] pci 0000:05:00.3: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[ 3457.983232] pci 0000:05:00.3: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 3457.983295] pci 0000:05:00.3: PME# supported from D0
[ 3457.983498] pci 0000:05:00.3: Adding to iommu group 25
[ 3457.983765] pcieport 0000:03:02.0: BAR 14: no space for [mem size 0x00100000]
[ 3457.983767] pcieport 0000:03:02.0: BAR 14: failed to assign [mem size 0x00100000]
[ 3457.983770] pci 0000:05:00.0: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3457.983771] pci 0000:05:00.0: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3457.983773] pci 0000:05:00.1: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3457.983774] pci 0000:05:00.1: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3457.983776] pci 0000:05:00.2: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3457.983777] pci 0000:05:00.2: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3457.983779] pci 0000:05:00.3: BAR 0: no space for [mem size 0x00010000 64bit]
[ 3457.983780] pci 0000:05:00.3: BAR 0: failed to assign [mem size 0x00010000 64bit]
[ 3457.983879] atl1c 0000:05:00.0: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3457.983882] atl1c 0000:05:00.0: cannot map device registers
[ 3457.983912] atl1c: probe of 0000:05:00.0 failed with error -5
[ 3457.983973] atl1c 0000:05:00.1: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3457.983975] atl1c 0000:05:00.1: cannot map device registers
[ 3457.984003] atl1c: probe of 0000:05:00.1 failed with error -5
[ 3457.984054] atl1c 0000:05:00.2: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3457.984056] atl1c 0000:05:00.2: cannot map device registers
[ 3457.984085] atl1c: probe of 0000:05:00.2 failed with error -5
[ 3457.984131] atl1c 0000:05:00.3: can't ioremap BAR 0: [??? 0x00000000 flags 0x0]
[ 3457.984133] atl1c 0000:05:00.3: cannot map device registers
[ 3457.984161] atl1c: probe of 0000:05:00.3 failed with error -5

~# ifconfig -a
doesn't show new interfaces

~# lspci
...
05:00.0 Ethernet controller: Qualcomm Atheros AR8151 v2.0 Gigabit Ethernet
05:00.1 Ethernet controller: Qualcomm Atheros AR8151 v2.0 Gigabit Ethernet
05:00.2 Ethernet controller: Qualcomm Atheros AR8151 v2.0 Gigabit Ethernet
05:00.3 Ethernet controller: Qualcomm Atheros AR8151 v2.0 Gigabit Ethernet
 
User avatar
vinigas
just joined
Topic Author
Posts: 18
Joined: Thu Jun 18, 2020 8:48 pm
Location: Lithuania

Re: CCR2004-1G-2XS-PCIe possible drivers Linux6.5.7 issue; PCI finds, but no eth interfaces  [SOLVED]

Thu Oct 19, 2023 10:04 pm

Ran

~# grub-mkconfig -o /boot/grub/grub.cfg

and rebooted. And now interfaces shows up. No idea why it helped. Maybe this script added some needed dependency or kernel module on boot.


Also I don't need boot delay, because of LUKS full-disk encryption takes time on boot to unlock the drive anyways.

dmesg now shows:
[ 0.857419] pci 0000:05:00.0: [1969:1083] type 00 class 0x020000
[ 0.857445] pci 0000:05:00.0: reg 0x10: [mem 0xfbc30000-0xfbc3ffff 64bit]
[ 0.857514] pci 0000:05:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.857591] pci 0000:05:00.0: PME# supported from D0
[ 0.857702] pci 0000:05:00.0: 31.504 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:03:02.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 0.857827] pci 0000:05:00.1: [1969:1083] type 00 class 0x020000
[ 0.857853] pci 0000:05:00.1: reg 0x10: [mem 0xfbc20000-0xfbc2ffff 64bit]
[ 0.857919] pci 0000:05:00.1: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.857990] pci 0000:05:00.1: PME# supported from D0
[ 0.858130] pci 0000:05:00.2: [1969:1083] type 00 class 0x020000
[ 0.858156] pci 0000:05:00.2: reg 0x10: [mem 0xfbc10000-0xfbc1ffff 64bit]
[ 0.858221] pci 0000:05:00.2: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.858292] pci 0000:05:00.2: PME# supported from D0
[ 0.858431] pci 0000:05:00.3: [1969:1083] type 00 class 0x020000
[ 0.858456] pci 0000:05:00.3: reg 0x10: [mem 0xfbc00000-0xfbc0ffff 64bit]
[ 0.858523] pci 0000:05:00.3: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[ 0.858594] pci 0000:05:00.3: PME# supported from D0
[ 0.901319] pci_bus 0000:05: resource 1 [mem 0xfbc00000-0xfbcfffff]
[ 0.903342] pci 0000:05:00.0: Adding to iommu group 25
[ 0.903423] pci 0000:05:00.1: Adding to iommu group 25
[ 0.903500] pci 0000:05:00.2: Adding to iommu group 25
[ 0.903577] pci 0000:05:00.3: Adding to iommu group 25
[ 8.440286] atl1c 0000:05:00.0: enabling device (0000 -> 0002)
[ 8.469111] atl1c 0000:05:00.1: enabling device (0000 -> 0002)
[ 8.491681] atl1c 0000:05:00.2: enabling device (0000 -> 0002)
[ 8.514572] atl1c 0000:05:00.3: enabling device (0000 -> 0002)
[ 8.558397] atl1c 0000:05:00.0 enp5s0f0: renamed from eth0
[ 8.593637] atl1c 0000:05:00.3 enp5s0f3: renamed from eth4
[ 8.615640] atl1c 0000:05:00.2 enp5s0f2: renamed from eth2
[ 8.653639] atl1c 0000:05:00.1 enp5s0f1: renamed from eth1
[ 9.804967] atl1c 0000:05:00.0: atl1c: enp5s0f0 NIC Link is Up<25000 Mbps Full Duplex>
[ 9.807602] atl1c 0000:05:00.1: atl1c: enp5s0f1 NIC Link is Up<25000 Mbps Full Duplex>
[ 9.810326] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 9.813011] atl1c 0000:05:00.3: atl1c: enp5s0f3 NIC Link is Up<25000 Mbps Full Duplex>
[ 10.236680] atl1c 0000:05:00.0: atl1c: enp5s0f0 NIC Link is Up<25000 Mbps Full Duplex>
[ 10.255583] atl1c 0000:05:00.1: atl1c: enp5s0f1 NIC Link is Up<25000 Mbps Full Duplex>
[ 10.273523] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 10.292235] atl1c 0000:05:00.3: atl1c: enp5s0f3 NIC Link is Up<25000 Mbps Full Duplex>
[ 51.852663] atl1c 0000:05:00.0: atl1c: enp5s0f0 NIC Link is Up<25000 Mbps Full Duplex>
[ 53.292860] atl1c 0000:05:00.3: atl1c: enp5s0f3 NIC Link is Up<25000 Mbps Full Duplex>
[ 55.345722] atl1c 0000:05:00.1: atl1c: enp5s0f1 NIC Link is Up<25000 Mbps Full Duplex>
[ 55.377604] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 55.397543] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 100.561669] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 100.580438] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 145.553771] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 145.572575] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>
[ 190.554697] atl1c 0000:05:00.2: atl1c: enp5s0f2 NIC Link is Up<25000 Mbps Full Duplex>

If anyone knows what happened that it started to work, would be interesting to know...

Who is online

Users browsing this forum: No registered users and 10 guests