The biggest issue with SR seems to be that it wasn't what the fans/audience wanted, and this is the danger with entrusting the film to a proven director like Singer. I mean sure, he's done successful films in the past, but that doesn't guarantee results does it?
I actually do remember the film quite fondly and did watch it without reading/finding out much about what to expect. I watched a story of a man seeking his past who instead finds his future. Does this type of story need to be told as part of the Superman mythos? No. But I appreciated that it attempted a mature type of story in this setting, albeit one that had to change the status quo of the Clark-Lois-Superman dynamic to do so. I accept that with the type of budget needed to do a Superman movie and have top-notch effects, it needs some sort of action/fighting, and maybe this is why Singer didn't get to do another one. It may not be perfect, but its hardly one of the worst of the 'genre', and it is better than maybe what most people remember it as.