That is simply not true. Atheist fully understand the full spectrum of religious belief. But as I said, believers usually think at least part of the Bible is literally true.
Some believe in Adam and Eve, Noah and the Flood. Some believe in Moses and the Exodus. Others believe Jesus was born from a virgin, performed miracles and his actual words are written in the Bible.
All those beliefs are questioned by atheists.