The problem of the dataset is not just that AI will pick shortcuts and naive heuristics, because humans will too.
The problem of the dataset is that you're not in control of who populates the dataset and what their intentions are. There's no understanding of an adversarial model and threat handling.