need help with speed limit by port

hi every one i wanna use queue to limit speed of upload and download per client and port

example : the client downloading file xxx.yyy.zzz.rrr:5050 so i wanna make speed 1MB
but if the clinet download form xxx.yyy.zzz.rrr:80 i wanna make speed 500KB

how can i do it !!

thanks