I had this problem too, but with VV2, mind you I kept the game on pause most of the time looking for collectibles. I'm also having that same problem with my VV3 tribe.

The 1st seed is matured, the fire has been going 4hrs and hut 1 us finished and I have 3 children running around (because of an event )