But this forces one into the position that whatever a LLM is doing is not real language, just an imitation of language.
If you take the fact that LLMs are emitting "real language" at face value, then you need to adopt a more structuralist view of language, in which "meaning" is part of the system of language itself and does not need to be grounded biologically.
I don't think holding a structuralist view of language precludes believing that humans have a biological facility for language, or even that language is shaped and ultimately a result of that biological facility. Its more an argument over what language IS -- a symbolic system, or an extension of the human brain.
If you believe in esoteric stuff such as "qualia", then LLMs also tell you nothing. You can continue to believe that true experience requires a human brain and all that a computer does is imitation. But this has no observable consequences that can be used to falsify these ideas, so is not a scientific concept in the first place.