Is it worth to get dlc's?

I've been playing a lot aoe with a couple friends and I was in the mood to buy dlc's to test new civs.

I'd I do that will I be able to play with them anyway? Or I can only use those new civs with the ones who have it too?

Thanks