That's the thing, X-Men victories were based on the status quo not getting worse, not improving it. They weren't enough. They had the power to improve the world so they had a responsibility to do it.
That should be the difference between Avengers and X-Men. The Avengers must want to save the world, the X-Men change it to something better. If not, they are redundant.