x86 10g support

Hi Guys,

Has anyone had any experiences with with the Intel X520-SR1 on a x86 box and 10g performance? We mainly use MT for a load balancer (reverse PCC implementation) with loads of simple queues (currently well over 1500+ queues, but not all active at the same time).

The server will more than likely have 32G of ram, and either 8 or 16 cores. Anything else that should be given consideration? Does the X520 behave with MT? It is on the compatibility list and confirmed as “working well,” but I’d like to hear from some real world experiences if at all possible (graphs would be even nicer) :laughing:

I am curious to know the answer to this as well. we have been working on design projects to build large clusters of MikroTik routers to go beyond 100 Gig routing capacity for use in the data center.

This would be useful info to know if we decide to experiment outside of the CCR line…

Guys the x520 line of NIC’s work perfectly on RouterOS.

These use the same chipset as the Hotlava NIC’s

But the performance is dismal! :frowning:

I’m lucky if I get 1.6Gbps :confused: MT just say we don’t develop the driver so we can’t help…

What motherboard chipset and processor?

Dell R410
2 x Intel(R) Xeon(R) CPU L5630 @ 2.13GHz (16 Cores total)
12GB Memory (even though MT only sees 2)

RPS has been enabled/disabled - makes no difference
IRQ’s been forced to certain cores (one IRQ per core), or left on automatic settings - makes no difference

FYI…

[cknipe@RTM-CN01-CR01] /interface ethernet> /system resource print
uptime: 2d5h34m34s
version: 6.22
build-time: Nov/11/2014 14:46:47
free-memory: 1558.2MiB
total-memory: 1893.6MiB
cpu: Intel(R)
cpu-count: 16
cpu-frequency: 2127MHz
cpu-load: 18%
free-hdd-space: 145.5GiB
total-hdd-space: 146.7GiB
write-sect-since-reboot: 38634810
write-sect-total: 38634810
architecture-name: x86
board-name: x86
platform: MikroTik
[cknipe@RTM-CN01-CR01] /interface ethernet> /system resource irq print
Flags: ro - read-only

IRQ USERS CPU ACTIVE-CPU COUNT

0 1 i8042 auto 1 3
1 4 serial auto 2 10
2 9 acpi auto 6 0
3 12 i8042 auto 3 3
4 14 ide0 auto 4 0
5 15 ide1 auto 5 0
6 17 usb3 auto 14 0
7 18 usb4 auto 7 0
8 19 usb1 auto 8 23
9 20 usb8 auto 9 0
usb6
10 21 usb7 auto 10 388
usb5
usb2
11 22 ata_piix auto 11 7
12 23 ata_piix auto 12 610 630
13 72 eth2-TxRx-0 auto 13 877 769 113
14 73 eth2-TxRx-1 auto 14 3 215 124 173
15 74 eth2-TxRx-2 auto 15 787 868 054
16 75 eth2-TxRx-3 auto 1 836 364 594
17 76 eth2-TxRx-4 auto 2 860 458 855
18 77 eth2-TxRx-5 auto 3 1 748 978 790
19 78 eth2-TxRx-6 auto 4 2 849 563 162
20 79 eth2-TxRx-7 auto 5 1 859 964 557
21 80 eth2-TxRx-8 auto 6 1 814 535 472
22 81 eth2-TxRx-9 auto 7 3 250 454 852
23 82 eth2-TxRx-10 auto 8 1 774 586 130
24 83 eth2-TxRx-11 auto 9 2 867 588 479
25 84 eth2-TxRx-12 auto 10 1 616 650 590
26 85 eth2-TxRx-13 auto 11 822 177 095
27 86 eth2-TxRx-14 auto 12 842 081 542
28 87 eth2-TxRx-15 auto 13 3 941 668 682
29 88 Public LAN auto 0 290
30 89 eth1-0 auto 15 1
31 90 eth1-1 auto 1 0
32 91 eth1-2 auto 2 0
33 92 eth1-3 auto 3 0
34 93 eth1-4 auto 4 0
35 94 eth1-5 auto 5 0
36 95 eth1-6 auto 6 0
37 96 eth1-7 auto 7 0

This is pretty much what I am seeing…

We are virtually flat lining at about 1.4Gbps to 1.6Gbps. That download should be running very close to max speeds. And as can be seen in the interface graph, for a VERY brief period, the system bursts very nicely to 8.3Gbps, but it’s not sustaining it.

No load to speak of whatsoever. When I do that same download on a Linux box with a 10G nic, I get pretty consistent 8.5Gbps.

All servers, files, etc, are on the same LAN - there is not even a WAN involved here.

Well, after googling a bit, it seems the ibgxe (Intel 10G driver), has serious issues.

So then I suppose my original question remains.

Who can recommend a good working 10G network card for a x86 box - that actually CAN deliver on speed…

We simply CANNOT operate at 1.5Gbps… :confused:

Hi,

I have X520-SR1 card but it is not shown in interfaces list (latest MT 6.24).

[admin@MikroTik] > /driver print
Flags: I - invalid, D - dynamic 
 #   DRIVER                                   IRQ       IO   MEMORY ISDN-PROTOCOL
 0 D RealTek RTL8169 Gigabit Ethernet        
 1 D Intel 10 Gigabit PCI Express            
 2 D USB Keyboard/Mouse                      
[admin@MikroTik] >

Like you can see it is shown in console driver list but not shown in Interfaces list:

[admin@MikroTik] > /interface print 
Flags: D - dynamic, X - disabled, R - running, S - slave 
 #     NAME                                TYPE       ACTUAL-MTU L2MTU  MAX-L
 0  R  ether1                              ether            1500  4080
[admin@MikroTik] >

ether1 is RTL8169

Can anyone tell me what to do to get x520-sr1 working with MT x86?

Thanks,
Aleksandar