Hello, i found a few old topics about the Intel XL 710 Driver (10G/40G). Maybe someone could give me an actual status:
Background of my questions is:
Kind regards,
glueck
ROS v6 (up to latest releases) is based on same old linux kernel. ROS v7 will be based on modern linux kernels.
Whatever that means re support for XL710 NICs.
..
If you use a Mikrotik CHR on a virtual machine the virtual host will have the driver.
thank you very much for the information but i don’t use chr. I am just interessted in running ROS direct X86 Hardware.
regards,
glueck
The x86 release of RouterOS 6 is not really made for high performance workloads, more like single-boards computers and embedded stuff.
Use CHR release on top of KVM or whatever.
I can report:
System used:
With: Intel Xeon Silver 4215R:
https://www.landitec.com/products/x86-n … 20-detail/
10G Cards:
Revsion-A has 10G onboard
40G Cards (i am sure that Intel XL 710 is not supported by Ros 6.47.beta58):
https://www.lannerinc.com/products/netw … cs2-iqm201
10G: Ethernet Connection X722 for 10GbE SFP+ (rev: 4)
ROS 6.48.beta58: unknown device (=Device not found)
ROS v7.1.beta2: Ethernet Connection X722 for 10GbE SFP+ (rev: 4)
40G: Ethernet Controller XL710 for 40GbE QSFP+ (rev: 2)ROS 6.48.beta58: unknown device (=Device not found)
ROS v7.1.beta2: Ethernet Controller XL710 for 40GbE QSFP+ (rev: 2)
[admin@MikroTik] > system/resource/print
uptime: 2m33s
version: 7.1beta2 (development)
build-time: Aug/21/2020 12:29:19
free-memory: 30.6GiB
total-memory: 31.0GiB
cpu: Intel(R)
cpu-count: 16
cpu-frequency: 3200MHz
cpu-load: 0%
free-hdd-space: 221.7GiB
total-hdd-space: 221.7GiB
write-sect-since-reboot: 433
write-sect-total: 433
architecture-name: x86_64
board-name: x86
platform: MikroTik
[admin@MikroTik] > system/resource/pci/print
Columns: DEVICE, VENDOR, NAME, IRQ
# DEVICE VENDOR NAME IR
0 00:00.0 Intel Corporation Sky Lake-E DMI3 Registers (rev: 7) 0
1 00:04.0 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
2 00:04.1 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 10
3 00:04.2 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
4 00:04.3 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
5 00:04.4 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
6 00:04.5 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 10
7 00:04.6 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
8 00:04.7 Intel Corporation Sky Lake-E CBDMA Registers (rev: 7) 11
9 00:05.0 Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev: 7) 0
10 00:05.2 Intel Corporation Sky Lake-E RAS (rev: 7) 0
11 00:05.4 Intel Corporation Sky Lake-E IOAPIC (rev: 7) 0
12 00:08.0 Intel Corporation Sky Lake-E Ubox Registers (rev: 7) 0
13 00:08.1 Intel Corporation Sky Lake-E Ubox Registers (rev: 7) 0
14 00:08.2 Intel Corporation Sky Lake-E Ubox Registers (rev: 7) 0
15 00:11.0 Intel Corporation C620 Series Chipset Family MROM 0 (rev: 4) 0
16 00:14.0 Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev: 4) 11
17 00:16.0 Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev: 4) 11
18 00:16.4 Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev: 4) 11
19 00:17.0 Intel Corporation C620 Series Chipset Family SATA Controller [AHCI mode] (rev: 4) 11
20 00:1c.0 Intel Corporation C620 Series Chipset Family PCI Express Root Port #1 (rev: 244) 11
21 00:1c.2 Intel Corporation C620 Series Chipset Family PCI Express Root Port #3 (rev: 244) 11
22 00:1f.0 Intel Corporation C626 Series Chipset LPC/eSPI Controller (rev: 4) 0
23 00:1f.2 Intel Corporation C620 Series Chipset Family Power Management Controller (rev: 4) 0
24 00:1f.4 Intel Corporation C620 Series Chipset Family SMBus (rev: 4) 0
25 00:1f.5 Intel Corporation C620 Series Chipset Family SPI Controller (rev: 4) 0
26 01:00.0 Intel Corporation I210 Gigabit Network Connection (rev: 3) 11
27 02:00.0 ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev: 3) 0
28 03:00.0 ASPEED Technology, Inc. ASPEED Graphics Family (rev: 48) 11
29 16:01.0 Intel Corporation Sky Lake-E PCI Express Root Port B (rev: 7) 11
30 16:02.0 Intel Corporation Sky Lake-E PCI Express Root Port C (rev: 7) 11
31 16:05.0 Intel Corporation Sky Lake-E VT-d (rev: 7) 0
32 16:05.2 Intel Corporation Sky Lake-E RAS Configuration Registers (rev: 7) 0
33 16:05.4 Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev: 7) 0
34 16:08.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
35 16:08.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
36 16:08.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
37 16:08.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
38 16:08.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
39 16:08.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
40 16:08.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
41 16:08.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
42 16:09.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
43 16:09.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
44 16:09.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
45 16:09.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
46 16:09.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
47 16:09.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
48 16:09.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
49 16:09.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
50 16:0a.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
51 16:0a.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
52 16:0a.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
53 16:0a.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
54 16:0a.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
55 16:0a.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
56 16:0a.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
57 16:0a.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
58 16:0b.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
59 16:0b.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
60 16:0b.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
61 16:0b.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
62 16:0e.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
63 16:0e.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
64 16:0e.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
65 16:0e.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
66 16:0e.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
67 16:0e.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
68 16:0e.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
69 16:0e.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
70 16:0f.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
71 16:0f.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
72 16:0f.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
73 16:0f.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
74 16:0f.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
75 16:0f.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
76 16:0f.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
77 16:0f.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
78 16:10.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
79 16:10.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
80 16:10.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
81 16:10.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
82 16:10.4 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
83 16:10.5 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
84 16:10.6 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
85 16:10.7 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
86 16:11.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
87 16:11.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
88 16:11.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
89 16:11.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
90 16:1d.0 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
91 16:1d.1 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
92 16:1d.2 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
93 16:1d.3 Intel Corporation Sky Lake-E CHA Registers (rev: 7) 0
94 16:1e.0 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
95 16:1e.1 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
96 16:1e.2 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
97 16:1e.3 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
98 16:1e.4 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
99 16:1e.5 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
100 16:1e.6 Intel Corporation Sky Lake-E PCU Registers (rev: 7) 0
101 17:00.0 Intel Corporation I350 Gigabit Network Connection (rev: 1) 11
102 17:00.1 Intel Corporation I350 Gigabit Network Connection (rev: 1) 10
103 17:00.2 Intel Corporation I350 Gigabit Network Connection (rev: 1) 11
104 17:00.3 Intel Corporation I350 Gigabit Network Connection (rev: 1) 11
105 18:00.0 Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev: 2) 11
106 18:00.1 Intel Corporation Ethernet Controller XL710 for 40GbE QSFP+ (rev: 2) 11
107 64:02.0 Intel Corporation Sky Lake-E PCI Express Root Port C (rev: 7) 11
108 64:05.0 Intel Corporation Sky Lake-E VT-d (rev: 7) 0
109 64:05.2 Intel Corporation Sky Lake-E RAS Configuration Registers (rev: 7) 0
110 64:05.4 Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev: 7) 0
111 64:08.0 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
112 64:09.0 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
113 64:0a.0 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
114 64:0a.1 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
115 64:0a.2 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
116 64:0a.3 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
117 64:0a.4 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
118 64:0a.5 Intel Corporation Sky Lake-E LM Channel 1 (rev: 7) 0
119 64:0a.6 Intel Corporation Sky Lake-E LMS Channel 1 (rev: 7) 0
120 64:0a.7 Intel Corporation Sky Lake-E LMDP Channel 1 (rev: 7) 0
121 64:0b.0 Intel Corporation Sky Lake-E DECS Channel 2 (rev: 7) 0
122 64:0b.1 Intel Corporation Sky Lake-E LM Channel 2 (rev: 7) 0
123 64:0b.2 Intel Corporation Sky Lake-E LMS Channel 2 (rev: 7) 0
124 64:0b.3 Intel Corporation Sky Lake-E LMDP Channel 2 (rev: 7) 0
125 64:0c.0 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
126 64:0c.1 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
127 64:0c.2 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
128 64:0c.3 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
129 64:0c.4 Intel Corporation Sky Lake-E Integrated Memory Controller (rev: 7) 0
130 64:0c.5 Intel Corporation Sky Lake-E LM Channel 1 (rev: 7) 0
131 64:0c.6 Intel Corporation Sky Lake-E LMS Channel 1 (rev: 7) 0
132 64:0c.7 Intel Corporation Sky Lake-E LMDP Channel 1 (rev: 7) 0
133 64:0d.0 Intel Corporation Sky Lake-E DECS Channel 2 (rev: 7) 0
134 64:0d.1 Intel Corporation Sky Lake-E LM Channel 2 (rev: 7) 0
135 64:0d.2 Intel Corporation Sky Lake-E LMS Channel 2 (rev: 7) 0
136 64:0d.3 Intel Corporation Sky Lake-E LMDP Channel 2 (rev: 7) 0
137 65:00.0 Intel Corporation unknown device (rev: 4) 11
138 66:00.0 Intel Corporation unknown device (rev: 4) 11
139 66:02.0 Intel Corporation unknown device (rev: 4) 11
140 66:03.0 Intel Corporation unknown device (rev: 4) 11
141 67:00.0 Intel Corporation C62x Chipset QuickAssist Technology (rev: 4) 11
142 68:00.0 Intel Corporation C62x Chipset QuickAssist Technology (rev: 4) 11
143 69:00.0 Intel Corporation Ethernet Connection X722 for 10GbE SFP+ (rev: 4) 11
144 69:00.1 Intel Corporation Ethernet Connection X722 for 10GbE SFP+ (rev: 4) 11
145 69:00.2 Intel Corporation Ethernet Connection X722 for 10GbE SFP+ (rev: 4) 11
146 69:00.3 Intel Corporation Ethernet Connection X722 for 10GbE SFP+ (rev: 4) 11
147 b2:05.0 Intel Corporation Sky Lake-E VT-d (rev: 7) 0
148 b2:05.2 Intel Corporation Sky Lake-E RAS Configuration Registers (rev: 7) 0
149 b2:05.4 Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev: 7) 0
150 b2:0e.0 Intel Corporation Sky Lake-E KTI 0 (rev: 7) 0
151 b2:0e.1 Intel Corporation Sky Lake-E UPI Registers (rev: 7) 0
152 b2:0f.0 Intel Corporation Sky Lake-E KTI 0 (rev: 7) 0
153 b2:0f.1 Intel Corporation Sky Lake-E UPI Registers (rev: 7) 0
154 b2:10.0 Intel Corporation Sky Lake-E KTI 0 (rev: 7) 0
155 b2:10.1 Intel Corporation Sky Lake-E UPI Registers (rev: 7) 0
156 b2:12.0 Intel Corporation Sky Lake-E M3KTI Registers (rev: 7) 0
157 b2:12.1 Intel Corporation Sky Lake-E M3KTI Registers (rev: 7) 0
158 b2:12.2 Intel Corporation Sky Lake-E M3KTI Registers (rev: 7) 0
159 b2:12.4 Intel Corporation Sky Lake-E M3KTI Registers (rev: 7) 0
160 b2:12.5 Intel Corporation Sky Lake-E M3KTI Registers (rev: 7) 0
161 b2:15.0 Intel Corporation Sky Lake-E M2PCI Registers (rev: 7) 0
162 b2:15.1 Intel Corporation Sky Lake-E DDRIO Registers (rev: 7) 0
163 b2:16.0 Intel Corporation Sky Lake-E M2PCI Registers (rev: 7) 0
164 b2:16.1 Intel Corporation Sky Lake-E DDRIO Registers (rev: 7) 0
165 b2:16.4 Intel Corporation Sky Lake-E M2PCI Registers (rev: 7) 0
166 b2:16.5 Intel Corporation Sky Lake-E DDRIO Registers (rev: 7) 0
167 b2:17.0 Intel Corporation Sky Lake-E M2PCI Registers (rev: 7) 0
168 b2:17.1 Intel Corporation Sky Lake-E DDRIO Registers (rev: 7) 0
Short local test:
[admin@MikroTik] > tool/bandwidth-test address=1.1.1.1
;;; results can be limited by cpu, note that traffic generation/termination performance might not be representative of forwarding performance
status: running
duration: 16s
rx-current: 615.2Gbps
rx-10-second-average: 404.8Gbps
rx-total-average: 277.4Gbps
lost-packets: 0
random-data: no
direction: receive
rx-size: 65535
connection-count: 20
local-cpu-load: 92%
remote-cpu-load: 92%
Thx for the post. Was looking for more info on rosv7 driver support. Planning on upgrading my Lanner x86 machines to xeon scalable family. I see your using xeon silver. Your btest seems even abit more than I was anticipating. Thx again. Im more confident now..
Hi, we just installed ROS7.7 on x86 with the AOC-S40G-I2Q card and it works without any problems.
We just ran into the problem that the queues can’t be split into individual cores. All queues are hanging on one core.
Please, can you say about your x86 router status? How many traffic real time? BGP? OSPF? CGNat? Pppoe server?
Just change BIOS Configuration
We run 5x NCA-5520A (with 1 x Intel Xeon Silver 4215R and 3x NCS2-IXM405A) on ROS 6.84.6 as BRAS with max 8000 Session per System (average Users per System: ~ 4000). In case of maintance or failure i see 6000 Session without any Problem. On last Champins League Playday with ~ 13,6 Gb/s max per System.
Hiya.. can u please confirm to us what kind of server hardware beeing used? Dell? supermicro? xeon cpu family? memory? any chance of getting a 100G card running? on routerOS? i am planning to build up a BGP hardware server machine.. and retire our ccr1072 BGP.. i am looking into a good server hardware stable for the next couple of years.. and some BRAS powerfull for up to 5k to 10k pppoe-connections server side also.
You use NCA-5520A with 10g nic? You 8k pppoe sessions per device?
I want to know, does you use 40g nic?
We use the supermicro server. Can you please guide me what to change in the bios to make the card have more threads? Thank you
We use supermicro server with intel desktop processor W series. There is only BGP about 50 peers and a total of about 5mil rout. ipv4 and ipv6 and up to 30 firewall rules.
Hi
has anyone tried the MCX416A-CCAT ConnectX-4 on RouterOS V7? i have found some pretty good deal prices on this cards i was wondering if this would be supported on RouterOS x86_64 v7