On Black Forest, how many villagers to send out to wall up in the start of the game?

I always send two out and my scout. But I feel like that makes me fall behind on food. What is the right move?