Sometimes a villager can get stuck in a hut or behind a larger object. If you can see part of their focus ellipse after returning to the main screen from the Details screen, you can usually grab them. If not, quitting and restarting the game usually puts them in a different place.