Except most of those people aren't hardcore fanatics. They need their long tail of followers, and those followers are prone to give up if they get sufficient pushback. And once the hardcore group gets a setback, they are really prone to infighting.
We could see that with the Sad and Rabid Puppies with the Hugo awards. Earlier the alt-right had run roughshod all over the video game industry, but once they hit a real mass movement with a semblance of organisation, they were shut down hard, and started to move to other areas, like comics.
Frankly, Alan Horn handled the Gunn-complainers all backwards. By giving in to them, he simply gave them more confidence and influence.