(I kept a copy of original wordle, and it seems to have 2,315 words that are possible answers.)
In particular, you have to consider the equilibrium. If you only allow a subset of words in Scrabble, this replaces the competitive advantage from knowing lots of words that no one uses in real life, with a competitive advantage from knowing the exact contours of the border between acceptable and unacceptable words. I would argue that this is even worse; at least if you learn lots of Scrabble words you're learning something about the real world.
By contrast, Wordle can self-impose whatever constraints they want on solutions, and people don't have to know what those constraints are in order to solve the puzzle. (It can help a little on the margin, which in a perfect world would not be the case, but it's much less of a problem for the puzzle-solving experience than the Scrabble equivalent would be.)
It's obviously an impossible challenge to draw those contours in language. Wordle did pretty well though! And going the other direction, just allowing everything that could possibly a word, just starts getting ridiculous.