How to counter hoang celt rush?

I guess that's the question.
1500 ELO lost 2 times in a row against the same guy using celts and doing hoang rush. I was vikings both times.

1st game I tried to play meta, drush to defend, feudal age with 23/24 vills, then forward tower in his gold and archers to try to break in... -> He was fully double walled and he counter tower the tower that I put in his gold, then castle age, knights, etc.
2nd game I tried offensive drush but I forgot loom and we trade vills in both bases, similar castle time, tried some tower next to tc to defend and pikes -> Same outcome, knights kills everything with siege.

Is there any "recipe" to counter this strat?

I was thinking something like, dark age fully walled before mill even (to avoid those 4 fast annoying militias) and the FC with no military at all, then siege, monks and guard tower to defend.