It's called "guilty by association." Even if Lee isn't part of that group, him working with them associates him with them.
If Lee had vetted who he was working with properly, he would not have worked with them. If King had done his research better, he would have seen Lee already give his explanation for working with them.
Both made a mistake.