He doesn't spend most of his time "beating the hell out of people who are employed by active criminals" unless those people are also threatening violence somehow against somebody or something. If they aren't a possible threat, he doesn't go out of his way to beat them up (unless maybe somebody like Frank Miller is writing the story).