I remember Kevin Feige himself saying that their schedule is too full for the X-Men earlier this year. X-Men is very different from Spider-Man because its just one character and his aunt. With the X-Men you have to established mutants first and that is going to take some time.