Why are the two queues in the attached picture showing red when they are both well below their max rate? I see this quite often. Also, why does queued bytes show 4095MB?

Are you using burst on your queues?
No burst in use.
Could you paste the queue list from your CLI?
/queue tree
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=yes limit-at=0 max-limit=0 name=“CACHE-HITS” packet-mark=cache-hits parent=ether2 priority=8 queue=default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=yes limit-at=0 max-limit=1536000 name=“up” packet-mark=all parent=pppoe-out1 priority=8 queue=pfifo-large
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=16000000 name=“Download” packet-mark=“” parent=ether2 priority=1 queue=pfifo-large
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=10000000 name=“Control” packet-mark=“Control Traffic” parent=Download priority=2 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=10000000 name=“Admin” packet-mark=“Admin Traffic” parent=Download priority=2 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=10000000 name=“Games” packet-mark=“Games Traffic” parent=Download priority=3 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=1500000 name=“Voice” packet-mark=“VoIP Traffic” parent=Download priority=1 queue=pcq-download
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=2000000 name=“Video” packet-mark=“Video Traffic” parent=Download priority=4 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=0 name=“Web, Etc…” packet-mark=“Regular Traffic” parent=Download priority=5 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=2000000 name=“p2p” packet-mark=“p2p Traffic” parent=Download priority=8 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=3000000 name=“All Other” packet-mark=“All Other Traffic” parent=Download priority=7 queue=wireless-default
add burst-limit=0 burst-threshold=0 burst-time=0s disabled=no limit-at=0 max-limit=0 name=“Internal Traffic” packet-mark=“Internal Traffic” parent=ether2 priority=4 queue=default