Hello Guys,

I buyet an CRS354-48G-4S+2Q+ for the 2Q SFP+ and 4 SFP+ ports to use them on my new servers witch they have 10GB Card.

I use CRS354-48G-4S+2Q+ as Switch with RouterOS v6.48

The problems is the speed betwin servers is only 2.4 and not more :| , i set the mtu to servers and ports of the switch to 9000, full duplex, autoneg off
The servers have HP NC552SFP 10Gbe 2-port Flex-10 Server Adapter.

All the Cables ar DAC Mikrotik, all the servers they have SSD Kingston DC500R and Intel.

So this is funny :
I got Server7 , Server9 and Server1

Server7 Conected to 10GB SFP+ Port 3
Server9 Conected to 10GB SFP+ Port 2
Server1 Conected to 40GB QSFP Port 1 Using brakeout cable ( 40GB > 4 x 10 GB )

And this ar iperf results.
-----------------------------------
From Server7 or Server9 to Server1
Connecting to host server1, port 5201
[ 5] local xxxxxxxxxxx port 44534 connected to xxxxxxx port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 667 KBytes 5.47 Mbits/sec 21 1.41 KBytes
[ 5] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 25 1.41 KBytes
[ 5] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 7 2.83 KBytes
[ 5] 3.00-4.00 sec 178 KBytes 1.46 Mbits/sec 17 1.41 KBytes
[ 5] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec 2 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-5.00 sec 846 KBytes 1.39 Mbits/sec 72 sender
[ 5] 0.00-5.00 sec 444 KBytes 727 Kbits/sec receiver
-----------------------------------
From Server1 to Server7
[ 5] local xxxxxx port 48572 connected to xxxxxxx port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 1.08 GBytes 9.30 Gbits/sec 0 3.16 MBytes
[ 5] 1.00-2.00 sec 1.05 GBytes 9.00 Gbits/sec 0 3.16 MBytes
[ 5] 2.00-3.00 sec 1.09 GBytes 9.35 Gbits/sec 0 3.16 MBytes
[ 5] 3.00-4.00 sec 1.08 GBytes 9.29 Gbits/sec 6 2.24 MBytes
[ 5] 4.00-5.00 sec 1.07 GBytes 9.22 Gbits/sec 0 2.48 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-5.00 sec 5.37 GBytes 9.23 Gbits/sec 6 sender
[ 5] 0.00-5.00 sec 5.37 GBytes 9.23 Gbits/sec receiver
-----------------------------------
From Server7 to Server9 or Server9 to Server7
Connecting to host server9, port 5201
[ 5] local xxxx port 46238 connected to xxxxx port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 254 MBytes 2.13 Gbits/sec 119 639 KBytes
[ 5] 1.00-2.00 sec 252 MBytes 2.12 Gbits/sec 8 457 KBytes
[ 5] 2.00-3.00 sec 254 MBytes 2.13 Gbits/sec 9 356 KBytes
[ 5] 3.00-4.00 sec 251 MBytes 2.11 Gbits/sec 8 403 KBytes
[ 5] 4.00-5.00 sec 250 MBytes 2.10 Gbits/sec 12 455 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-5.00 sec 1.23 GBytes 2.12 Gbits/sec 156 sender
[ 5] 0.00-5.00 sec 1.23 GBytes 2.11 Gbits/sec receiver
---------------------------------------
From server1 to server9
Connecting to host server9, port 5201
[ 5] local xxxxxx port 46732 connected to xxxxx port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 266 MBytes 2.23 Gbits/sec 8 355 KBytes
[ 5] 1.00-2.00 sec 258 MBytes 2.16 Gbits/sec 11 293 KBytes
[ 5] 2.00-3.00 sec 260 MBytes 2.18 Gbits/sec 9 451 KBytes
[ 5] 3.00-4.00 sec 256 MBytes 2.15 Gbits/sec 11 385 KBytes
[ 5] 4.00-5.00 sec 256 MBytes 2.15 Gbits/sec 9 246 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-5.00 sec 1.27 GBytes 2.17 Gbits/sec 48 sender
[ 5] 0.00-5.00 sec 1.26 GBytes 2.17 Gbits/sec receiver



Is there sompting i have to do special ?

Thank you

interesting, i have the same problem

Accepted connection from 10.10.0.133, port 59491
[ 5] local 10.10.0.132 port 5201 connected to 10.10.0.133 port 59492
[ ID] Interval Transfer Bandwidth
[ 5] 0.00-1.00 sec 289 MBytes 2.43 Gbits/sec
[ 5] 1.00-2.00 sec 273 MBytes 2.29 Gbits/sec
[ 5] 2.00-3.00 sec 266 MBytes 2.23 Gbits/sec
[ 5] 3.00-4.00 sec 283 MBytes 2.37 Gbits/sec
[ 5] 4.00-5.00 sec 279 MBytes 2.34 Gbits/sec
[ 5] 5.00-6.00 sec 296 MBytes 2.48 Gbits/sec
[ 5] 6.00-7.00 sec 270 MBytes 2.26 Gbits/sec
[ 5] 7.00-8.00 sec 253 MBytes 2.12 Gbits/sec
[ 5] 8.00-9.00 sec 241 MBytes 2.02 Gbits/sec
[ 5] 9.00-10.00 sec 267 MBytes 2.24 Gbits/sec