Scouts don’t try to attack villager I clicked

Hey all, I’m sure this has been asked before, but I don’t know how to find it. When I’m scout rushing is when I most notice this problem. I’ll be running around his eco with my scouts, find a weak vill, right click that weak vill, and for some reason my scouts will often try to go for other nearby villagers instead while ignoring the vill I clicked. I’ll keep on reclicking the vill I wanted them to attack but they still choose other ones 🤷‍♂️👎

Is it because of the poor pathing? Is it because of the stance I have them set on? I just want my military to attack the unit I asked them to attack, but it doesn’t always work out. Thanks in advance!