How RB800 compares against Cisco ASA5500?

How RB800 compares against Cisco ASA5500 10-user license?

Depends on what you’re comparing. What does this device need to do for you?

Not for me, but anyways - office router/firewall.

Yes.

I meant advantages/disadvantages of having one or the other

The RB800 is a great QoS router with some firewall and VPN capabilities (it’s a fine basic firewall but application inspection is lacking, VPN support is so-so).
The ASA is a great firewall and VPN head end with some routing and QoS capabilities.

The RB800 is similarly priced to a 5505 with a basic license, but comes with a level 6 license so you are not artificially limited and could easily run a lot more than 10 users. The ASA has the option of SmartNet, which buys you 4 hour replacement service and the ability to ask TAC any question and have them solve it for you, guaranteed.

The official documentation for the ASA is much, much better. The community support for both is probably roughly equal.