The book won't last very long without crossovers. It was already handicapped by retailers under ordering at the start. And, the series is still dropping over 600 readers an issue from issue #4 to #5 to #6 and so far hasn't hit bottom yet. What held true for the last iteration of X-Factor rock solid sales that wouldn't drop much below the mid 25K range until the very end isn't necessarily going to happen with this title.
There is a reason why the book will be a part of a crossover in November and PAD laid it out in an audio interview a few month back. The market isn't what it was even mid last decade and titles that are completely separate from everything else have a tendency to disappear as he said.
Though I certainly agree with you a crossover with the Magneto title would be a very good idea given the ANXF cast.