Imagine playing monopoly for 400 years with someone, and they got to go around the board for the first 300 years without you making a move, buying up all the property. Then for the next 50 they allowed you to start to make moves, but every time you started to gain just about any money they would push you over and rob you (see: sundown towns, lynching, the tulsa massacre, segregation, jim crow, redlining, police brutality, poor neighborhoods and absolutely awful schools).
There's been no penance. There's been no justice. And people aren't even asking for that, they're asking for a seat at the table and a chance to play the game, which is STILL constantly being denied. Its not scapegoating, its fighting against systematic oppression that you yourself continue to support.