As has been surmised already, there are different ways to solve this puzzle. The intended method is to use something that shows up after the clothing hut is built.

To answer your question Morskow, the ponds provide a place for your villagers to relax.