You have to solve Puzzle 7 first. I was in the same boat and trying with 2 Master Builders which of course was not enough. I did get close though, just needed 1 more lightening strike to get those heathens away! Unfortunately I also ran out of energy. I did eventually manage to get the job done with 3 builders though.

If your tribe can support a larger population then start baby-making. More villagers will raise your energy faster.

Here's how I managed: Wait until you have the max energy that you're allowed. Is it more than 436 now? Set all of your Master Villagers on the totem. Once all of the red and orange heathens approach them, pause the game, place your builders at the mausoleum for safe keeping, unpause and zap the heathens with the lightening. As the heathens run away, immediately place all the master builders back to the totem. If they stand and do nothing even for a second, pick them up and drop them back on the totem as there is no time to spare.

Each time the heathens come close to the totem again, move your builders to the mausoleum and zap the heathens with the lightening. Do not let any of the heathens start to repair the totem.

See how far you can get with this strategy. There were a few additional things I did as I ran out of energy but since you have a 4th builder you might not need to do the other things I did.

I had all four of my villagers unblock the Mausoleum before I broke any of the totems at that time their were only three blue mask witch I trained a devotee on them and then sent them running after their light bulb came on. p.s. the forth one started to work at the Mausoleum after the food bin was finished.

lightining struck

Finish the statue and increase your population until you get the earthquake power, which will allow you to convert all the heathens. Then there will be nothing to stop you.

After you finish the statue, polishing the statue will increase building ability, so it's never too late to get Master Builders.

Use the oldest villagers to distract the yellow masks, the heathens will take longer to chase them as they basically walk at a crawling pace.