Simple Queue not applied to Upload

I have a simple queue setup so that I can throttle data traffic the is marked “non-voip” in my firewall mangle rules. I have the Max limit Upload set to 3MB and the Max limit download set to 512Kb. All of the burst settings are Unlimited. The interface is ether1-gateway that the ISP is connected to.

When I run a speedtest, this rule will throttle the “Target Upload” (max limit setting in queue at 3Mb) while the speedtest is measuring my “Download” speed but it will not throttle the “Target Download” (max limit setting in queue at 512kb) while the speedtest is testing my “upload” speed. When I view the Traffic graph in the simple queue I dont see anything hitting the “download” portion of the queue at all.

What am I missing. We need to get this configured since we are a VOIP company that throttles BW in order to preserve telephone quality.

Another thing is that I have the “non-voip” mangle rule set to mark with nothing specified in order to catch everything. We also have a mangle rule that marks packets to and from our servers IP address as “voip”.
simple_advanced.JPG
Simple_general.JPG

I can see one thing that could be an issue.
If you are specifying your WAN port upload and download will be reversed.

That is something that we can deal with; however. I’m just trying to get the Download setting to actually take affect at this time regardless of actual direction.