Who says it cant? You can just focus on his WWII history with Cap and say he has been traveling around the world or something. Wolverine's the character you can get away with not associating him with the X-Men since he already had a colorful history before he met them. The only ones that will be tricky is Cyclops, Jean, etc