Yes, the reset button should be pushed after power is applied and released when some of the LED starts to blink (~around 5 seconds).
However, there might be some modified default configuraiton on your router.
For such case bulletproof solution is Netinstall,
https://wiki.mikrotik.com/wiki/Manual:Netinstall#How_to_use_Netinstall