Cpu load problem

RouterOS General
1

Hi !

Have some problem on multicore x86 system (double XEON 5520, 400 mbit, 60kpps, routerOS 5rc4).
Here is the graph, CPU load cant increase over 33 %.

At the moments of the greatest loading, the one of core have 100% load, over cores from 0% to 20 %,icmp time goes from 1 ms to 60 ms.
Looks like RPS is working not correctly.
Help plz.

 /system resource> print
                   uptime: 6d2h51m54s
                  version: "5.0rc4"
              free-memory: 811376KiB
             total-memory: 1943128KiB
                      cpu: "Intel(R)"
                cpu-count: 8
            cpu-frequency: 2527MHz
                 cpu-load: 23%
           free-hdd-space: 240133380KiB
          total-hdd-space: 240348676KiB
  write-sect-since-reboot: 10875170
         write-sect-total: 10875170
        architecture-name: "x86"
               board-name: "x86"
                 platform: "MikroTik"

graph.jpg

2

One of 8 cores have 100 % load randomly.

/system resource cpu> print
CPU LOAD        IRQ         DISK       
0   11%         11%         0%         
1   2%          1%          0%         
2   6%          6%          0%         
3   100%        99%         0%         
4   8%          8%          0%         
5   15%         14%         0%         
6   14%         14%         0%         
7   16%         15%         0%




/system resource cpu> print
CPU LOAD        IRQ         DISK       
0   6%          6%          0%         
1   7%          7%          0%         
2   5%          5%          0%         
3   15%         14%         0%         
4   3%          3%          0%         
5   10%         10%         0%         
6   14%         14%         0%         
7   100%        99%         0%

any ideas ?

3

seems, that IRQs for the traffic are really taking the gut out of CPU.

actually, i’ve seen exactly the same on older (less multicore) systems. you could never get much more than one core loaded fully, and some other routine on other core(-s).

however, muliple cores/cpus really let MT get around while under heavy load - since migratied to multicore, the router has never locked up or got unaccessible, while under any load.

4

You consider that the only thing that it is possible to make it to update the hardware ?

5

try rc7…kernel is updated.

6

its rc7 now… no changes… :frowning:

I have established distribution IRQ on processors manually.

now :

/system resource irq> print
 # IRQ USERS                                                                                                                     CPU        ACTIVE-CPU COUNT     
 0 4   serial                                                                                                                    0          0          1         
 1 9   acpi                                                                                                                      0          0          1         
 2 14  ide0                                                                                                                      0          0          0         
 3 15  ide1                                                                                                                      0          0          0         
 4 16  usb8                                                                                                                      0          0          0         
       usb7                                                                                                                     
       usb6                                                                                                                     
       usb2                                                                                                                     
 5 18  ata_piix                                                                                                                  0          0          38800     
 6 19  usb5                                                                                                                      0          0          43        
       usb4                                                                                                                     
       usb3                                                                                                                     
       usb1                                                                                                                     
 7 21  ata_piix                                                                                                                  0          0          0         
 8 64  aerdrv                                                                                                                    0          0          0         
 9 65  aerdrv                                                                                                                    0          0          0         
10 66  aerdrv                                                                                                                    0          0          0         
11 67  aerdrv                                                                                                                    0          0          0         
12 68  aerdrv                                                                                                                    0          0          0         
13 72  ZSTTK                                                                                                                     5          5          1         
14 73  eth0-rx-0                                                                                                                 6          6          47650     
15 74  eth0-rx-1                                                                                                                 6          6          85001     
16 75  eth0-rx-2                                                                                                                 4          4          89491     
17 76  eth0-rx-3                                                                                                                 4          4          38383     
18 77  eth0-tx-0                                                                                                                 6          6          14761     
19 78  eth0-tx-1                                                                                                                 6          6          92847     
20 79  eth0-tx-2                                                                                                                 6          6          40306     
21 80  eth0-tx-3                                                                                                                 6          6          12898     
22 81  ether1                                                                                                                    0          0          1         
23 82  eth1-rx-0                                                                                                                 3          3          2703      
24 83  eth1-rx-1                                                                                                                 3          3          59958     
25 84  eth1-rx-2                                                                                                                 3          3          54213     
26 85  eth1-rx-3                                                                                                                 3          3          82855     
27 86  eth1-tx-0                                                                                                                 3          3          13310     
28 87  eth1-tx-1                                                                                                                 3          3          84819     
29 88  eth1-tx-2                                                                                                                 3          3          7723      
30 89  eth1-tx-3                                                                                                                 0          0          15200     
31 90  ether2                                                                                                                    7          7          1         
32 91  eth2-TxRx-0                                                                                                               5          5          62201     
33 92  eth2-TxRx-1                                                                                                               5          5          1033      
34 93  eth2-TxRx-2                                                                                                               2          2          53675     
35 94  eth2-TxRx-3                                                                                                               2          2          37372     
36 95  eth2-TxRx-4                                                                                                               7          7          13043     
37 96  eth2-TxRx-5                                                                                                               0          0          8368      
38 97  eth2-TxRx-6                                                                                                               1          1          33405     
39 98  eth2-TxRx-7                                                                                                               7          7          31029     
40 99  KES                                                                                                                       6          6          1         
41 100 eth3-TxRx-0                                                                                                               1          1          39321     
42 101 eth3-TxRx-1                                                                                                               1          1          95870     
43 102 eth3-TxRx-2                                                                                                               0          0          71221     
44 103 eth3-TxRx-3                                                                                                               1          1          57424     
45 104 eth3-TxRx-4                                                                                                               3          3          7635      
46 105 eth3-TxRx-5                                                                                                               3          3          52672

RPS is disabled on all int.

Kernels are loaded proportionally, until then while on the interface doesn’t appear more 50k pps.

7

I am stuck with the same problem . Posted another thread but no help. How do we improve the throughput on the router ? I am not running the latest 5.4 upgraded from using 5.0rc4 but that has not made a difference