Well, time travel is a slippery slope. He's still from Clark's future at a time before the imp intervened so I'm not seeing why that'd matter yet. But agree to disagree, I interpret it very differently. And frankly its really the first time I've ever seen it suggested that it could have erased the Legion entirely from his life. That its only coming up now after this book is even more an indicator that its an alteration to the original material to support what was just written.
But I mean, if others don't find it a big deal to each their own of course. This is just one guy's opinion, I respect that others love the issue and the message.