How do you not overcommit to Feudal age?

Just lost a game where I had a decent force in Feudal knocking on his door.

Then he upped before me and built a castle on my face.