Is the switch doing anything else at the time?
What ports are you using on the CRS?
I ask because anything that goes up to Layer3 presumably involves the CPU, and the CPU only has a single 1gbps link back to the internal switch.
Check the block diagram (PDF).