Are the Mikrotik bandwidth queue applied sequentially? And is there a way of prioritizing ICMP for the entire network?

yes, queues are matched in order and you can prioritise the traffic.

you can check out our wiki:
http://wiki.mikrotik.com/wiki/Main_Page

for examples and queues manual.