I cant win vs hard DE

1vs1 I lost some games in a row on black forest vs hard. In the early game I kill some villagers and am off to a better start (and better economy) but then the ai comes back with lots of skirmishers which I dont have an answer to. I create mangonels as fast as possible and keep producing army but I can't back it up economically vs his numbers. He gets in imperial age where I cant cuz I'm spending my gold on my army. If I resign he always got 20+ more the army than I have. I'm not sure how he owns me so hard min20