You must also say that this with STAR Labs happened BEFORE he was on Gemworld.
On Gemworld he lived his life as farmer and father and seemed to enjoy the peaceful live.
So I think rather Jon as the harsh character, because Conner seems to have found his peace.
It would also make NO sense if you look at TT and Conner in Smallville.