I'd keep magic around but it shouldn't be anymore a weakness to Superman than getting set on fire or deprived of oxygen is a "weakness" to regular humans.