Don't worry, most people don't. Even those who care can't decide if real life and fictional romani can or not have white skin.
And let's not forget jewish writers. Jewish people with light skin are shrödinger pocs. They are either white people or poc, depending of who is talkling about them and what argument they want to make.