I'm not sure how we should treat LLMs with respect to publicly accessible but copyrighted material, but it seems clear to me that "profiting" from copyrighted material isn't a sufficient criteria to cause me to "owe something to the owner".
A computer isn't a human, and we already have laws that have a different effect depending on if it's a computer doing it or a human. LLMs are no different, no matter how catchy hyping them up as being == Humans may be.
It seems obvious to me that, despite what current law says, there is something not right about what large companies are doing when they create LLMs.
If they are going to build off of humanity's collective work, their product should benefit all of humanity, and not just shareholders.