Either you're remembering the XVerse through rose colored nostalgia or creating a false narrative. sure there were X-Groups and self styled Evil extremist and those were the 2main groups but it's not as if the reader had a choice which story they followed. can you think of a book that followed a group of 'evil' Mutants? (other than the brotherhood) X-Men, X-Force, X-Factor, eXcalibur, New Mutants, Generation X, etc all fall under the 'Protecting a world that hates and Fears them' ideology
Maybe you should try and change your group? see if you enjoy the stories from that perspective