Units cant go through broken wall?

I was playing a ranked game, and my opponent was playing defensive. After a few failed raids I finally break a hole in their wall, and want to send my 120 unit army through. Even though it was 2 units wide, they all pathed in a random direction and not through the hole. I decided to try one unit in case there was blocking going on, but the same thing happened. I am new (my second ranked game), so it was really frustrating to lose when I could see their TC. Is this a normal thing or some fluke bug? When I looked at the map there was not other opening other than a gap for a tree if you count it.