Houses should be able to create villagers.

Think about it, humans are raised in houses, not town centers. This will also mean you can research and advance through the ages without halting villager production.