Right? If travel really is so instantaneous with a portal, what's the big deal with him just planting one out in the garden somewhere and dropping in as and when he wants/needs? Mutants might be united but that doesn't mean everyone needs to pull away and gather in the same place; you can be united in a cause and live on two different coast-lines.