It should be possible to have fastpath working even with firewall rules as long as thoes rules are not in the forward or nat. It would be nice as it enables the possibility to protect the router and still having the high performance for the forwarded traffic.