Mikrotik Wireless Wire with ping loss from remote site

I have a Mikrotik Wireless Wire 60 GHz kit between two buidlings (35 meters). The signal is good and the connection is stable from main building to remote building, but from remote buidling there is 5 - 10% loss when testing ping. Have attached a quick diagram over the network here. The WiFi accesspoints are Ubiquiti AC Lite/LR. Have tried switching accesspoints without any improvment.
NettverkHjemme.JPG
Client1 → Switch2 = 0% loss
Client2 → Switch2 = 0% loss
Client2 → Switch1 = 10% loss
Client3 → Switch1 = 5% loss

What can be the problem here?

sw1