I have to disagree with you on the origin of the phrase. It's probably difficult to find out for sure, but it doesn't sound like something who knows how much words can hurt would say. It sounds more like an excuse somebody who uses words to hurt people would use.
The "I'm not touching you" of hate speech.