Yeah you see here's the thing a lot of people seem to be forgetting, without Xavier around to help them a lot of the X-Men's lives would be drastically different than they are now. Cyclops & Jean would never have gotten to where they are right now if Charles hadn't come and fetched them, Storm would probably be a vessel for the Shadow King or at the very least remained in Africa, Wolverine might still be part of Department H if he wasn't just shuffled off to another government program or went rogue entirely, etc.
I do not believe for a moment that Scott would have risen to any position of leadership within the mutant community without Xavier there to guide him or Jean's influence to push him, especially with Sinister keeping tabs on him from behind the scenes. Jean would have never developed the level of control she has over her powers without Xavier giving her the necessary training to do so. Without Scott & Jean getting together in any capacity there would be no Rachel or Cable. Logan would probably still psychologically be a mess from years of mind control and tampering.
This is pretty much my point, in every alternate reality that Xavier and/or Magneto aren't around Marvel acts like things would spiral out to the worst possible outcome vs life going on as normal. Too many variables exist to make me believe that any one individual would be able to swoop in and just take over. Even without Xavier the X-Men were always going to pop up, it was always just going to be a matter of when and who.