Extraodinary claims require extraordinary evidence. My default is to not accept imaginary things for which there is no evidence.
And while we are talking about "harm", I do not recall a single folktale, story or urban myth where a ghost did anything more than scare people.