Without seeing your full config, you are essentially correct. Allow what you specifically want, then drop everything. You can even be more selective. For example, only certain devices on one VLAN can access another VLAN. I have a bunch of that on mine.
But the devil is in the details. As Anav requested, post a complete comfig:
To export and paste your configuration (and I’m assuming you are using WebFig or Winbox), open a terminal window, and type (without the quotes) “/export hide-sensitive file=any-filename-you-wish”. Then open the files section and right click on the filename you created and select download in order to download the file to your computer. It will be a text file with whatever name you saved to with an extension of .rsc. Then in your message here, click the code display icon in the toolbar above the text entry (the code display icon is the 7th one from the left and looks like a square with a blob in the middle). Then paste the text from the file in between the two code words in brackets.
Your configuration is very confusing and probably all wrong.
Why not use one bridge.
Assign all ports to it (except for the wan port of course)
Assign vlans to the bridge
and follow this guide…