When do you guys start collecting stone?

Just curious about how you all go collecting your stone. What age and about how many vills? I'm assuming for a castle drop it's a bit earlier than a monk or knight rush.