Tower of castle?

I feel like I’ve played 500 games and lost do to rushing. Is towers a more defensive of is castle mere defensive?

1 castle = 5 towers