I guess why is there an expectation that GPT must be not trickable by bad actors to produce whatever content.
What matters is that it would give good content to honest customers.
For the same reasons forging a contract is different from getting an idiot to sign one.
So a ChatBot that can't intentionally lie or hide things could actually be an improvement in such cases.