The other reality is, when you talk about racial discrimination, people typically view it as exclusively a Southern problem what with the documented records of Jim Crow and everything, and that's because in the South, there wasn't an obvious presence of a wealth gap between the rich and the poor, so laws had to be made. In the North, there was an obvious gap between the haves and have nots (to which many blacks wound up as due to a lack of access to good paying jobs or quality education), so you did not need to institutionalize discrimination because there was a systematic form of discrimination in place when it came to wealth. And the ones that did break through that had to contend with the uncomfortable reality that people in the North weren't as open minded as they expected.
During Reconstruction, Freemen actually were able to make progress in business ownership and politics (in other words, now that they were off the plantations, they were ready and willing to start new lives and contribute for themselves and the community, not just for the betterment exclusively to the sharecropper), but some people who were irate at the change in the social system succeeded in putting Jim Crow laws in place and made public opinions on African Americans lessen by creating the illusion that they were crazed hooligans, and that shaped the opinions of the North even further. Like I said; it wasn't as if the whole South was exclusive to bigotry, they were just blatant about it.
It shows us that, whenever we make progress towards human decency, there are always those who fight back and want to revoke that progress, and this shows what happens when they win.