Speeds drop way off

I’ve been running into this issue for a while now and trying to isolate where the problem is. I have configured simple queues and they are working well at the tower sites, however, from time to time, traffic will slow to a crawl (speed tests 0.1 to 0.2) and yet none of the connected client queues show maxed out. I’ve tried to torch my gateway to see if I could find the culprit but have not been successful. Am I missing something in Torch or is this some other kind of traffic I’m missing such as broadcast, etc.?