This is giving ML models, more credit than they are due. They are unable to be imagine, they might convincingly seem to produce novel outputs, but their outputs are ultimately proscribed by their inputs and datasets and programming. They're machines. Humans can learn like machines, but humans are also able to imagine as agents. "AI" "art" is just neither of its namesakes. That doesn't mean it isn't impressive, but implying they are the same is granting ML more powers and abilities than it is capable of.
But if you say "humans are programmed" in a metaphorical sense, then yeah sure that's an interesting thought experiment. But it's still a thought experiment.