Yeah, I think that was mainly established in Tom Baker's era. I think in part it was to explain why the other Time Lords didn't kind of recognize him despite giving him missions during the Pertwee era,Genesis of the Daleks and possibly Brain Of Morbius-those were actions by the agency and not the main Time Lord aristocrats.