How do you scout rush when the enemy scouts your stable and has spears by the time you reach him?

90% of my scout rushes end in less than 30 seconds. No matter how much I try to micro my scouts I can't do enough damage if I have 4 scouts vs 2 groups of spears on gold and wood. My winrate with archers or m@a is MUCH higher than scouts, I just can't make them work.

Some questions

1. If my enemy sees my stable, should I stop the scout rush and do something else? Is the only good thing about scouts the surprise factor?
2. Should I stop the scout rush and transition into a defensive counter to his strat? Like skirms vs archers, or archers vs m@a or whatever
3. Is the only way to scout rush to do it so quick that I reach him before spears come out? I've been doing 22pop feudal, and if I'm playing vs 24pop up archers he can make a few spears in the time it takes me to produce 3/4 scouts.
4. I usually try to hit castle after scouts, should I try to transition into archers/skirms instead if my scout rush is unsuccessful? Is it enough to cause some idle time? Any tips/help would be appreciated.