That was what he claimed then but as I posted months ago , a new article detailed Chappelle almost returned to do the show. In fact it was Comedy Central who when they aired the short 3rd season against his wishes it killed him ever returning then.
This also details that yes the above is true but a bigger factor was ...Chappelle was starting to hate the insane fame he had gained. That he'd go do stand up and people would scream out lines from the show (which he called them stupid) . That he felt trapped by the shows success and he couldn't live a normal existence anymore.
https://***********/vulnerable-man/w...n-2f39d8b5a466
In fact from one mid 2000's comedy special Chappelle joked about the whole deal where people would yell lines from his show at him. How it irked him and one was detailing how he took his children to Disney World. There a guy dressed as Mickey Mouse would repeatedly go...'I'm Rick James , B-tch !" Dave was like...dude come on ! Not now with this sh-t Mickey !
So both reasons was a big factor on his leaving the show. The fact he hated people laughing at something like this (and his not happy with 3rd season material) and the insane fame he got from it.