Hank probably has a special hidden closet where he keeps the Yellowjacket costume. Can't even remember that he has one until the right mood strikes.
But it would be fun to see how other Avengers would react if he did mix them up. Like show up in an Ant-Man costume with the Yellowjacket mask on. Cap: "Hank... are you feeling okay?"