More damage inside or outside the castle?

Yesterday I had a group of Paladins attack my Cav Archers. Nearby was a castle. I put them inside to protect of course but prompted this question in my mind