Allocate bandwidth over two ip ranges with simple queues

I have two ip ranges on the same network netwrork1 192.168.1.0/24 and network2 192.168.2.0/24
I want to restrict internet bandwidth by ip address. Ie each users get 256k ea other get 586k ea managers get 1m ea
They all connect to the same switch and then the switch is connected to the MK on the lan eth port which has two ip addresses allocated to it 192.168.1.1 and 192.168.2.1.The wan ip is 10.0.0.1. Gateways for the users are 192.168.1.1. and 192.168.2.1
I created simple queues for each ip address
add comment=user1 max-limit=256k/256k name=queue55 target=192.168.1.85/32
add comment=user2 max-limit=256k/256k name=queue56 target=192.168.2.75/32
add comment=manager1 max-limit=1M/1M name=queue57 target=192.168.1.10/32
add comment=manager2 max-limit=1M /1M name=queue58 target=192.168.2.20/32
All internal servers are in the 192.168.1.0 range
My problem comes in when a user in the 192.168.1.0/24 connects to the internal server which is 192.168.1.0/24 range the queue is not active which is correct but when a user on 192.168.2.0/24 range connects to the same server his queue activates. This is the problem. How do I get the MK to allow no queues on the lan irrespective of ip address but only activate when the breakout on the Wan.