I recently managed to get my hands on Intel X710-DA4, CRS317 and CCR1009. However unfortunately... Performance is quite disappointing and I don't know who to blame. When I enable multiple tunnels in iperf then everything is cool - full 10G. However with single tunnel... not so much.
If I use UDP for iperf then again I get full 10G, even on single "connection", but TCP caps between 3.5 - 4gbps (with 9k jumbo ofc). While I expected CCR to struggle with single tcp tunnel (because Tile-Gx is superscalar/megascalar CPU type) I must say that I rather expected something around... idk 6-8 gbps. Not 3.5. I'm not really sure who to blame now. CCR is first shot but on the other hand... why would UDP work fine then? Firewall processing is exactly the same, jumbo frames the same, features the same, only difference in TCP stack itself. Also tests didn't really scale well - 2 connections achieved only ~4.5 gbps, not 7. If it was CCR issue I think I'd expect more linear scaling.
On the other hand workstation uses i7-2600k and pci-e 2.0 (Intel x710 is 3.0 card) so it's relatively dated and could be an issue as well. Plus I performed test on single machine, 2 interfaces (using dstnat+masquerade hack on CCR to force push packets via router rather than loopback). When I used UDP in iperf I got giant wall of "out of order" warnings so there's probably sh*tton of packets reordering in tcp so it sounds to me like root of issues but I don't really know what it means in realms of this problem nor what can I do to reduce it. Connection is really simple: workstation -> CRS317 -> CCR1009.
Using 3m DACs. CRS with CCR connected via tagged trunk. NAT rule 6.6.6.6 -> second interface address of workstation + masquerade so that iperf to 6.6.6.6 resulted in looping traffic from first interface, through router back to workstation to different interface.
Both machines didn't indicate much load. None of cores utilization or ipc exceeded 30% yet performance was crap.
So my question is - could someone confirm that CCR1009 indeed bottlenecks around ~3.7 gbps with single tcp connection? Otherwise I'll continue investigation on workstation side. Right now im puzzled, disappointed and demotivated