They are working on it. And current large language models via eg transformers aren't the only way to do AI with neural networks nor are they the only way to do AI with statistical approaches in general.
Cyc also has the equivalent of hallucinations, when their definitions don't cleanly apply to the real world.