If these models spit out the data they were trained on and the training data isn’t representative of reality, then they won’t spit out content that’s representative of reality either.
So people shouldn’t say ‘these concerns are just woke people doing dumb woke stuff, but the model is just reflecting reality.’