zlacker

“We’ve already agreed what you are, now we’re just haggling about the price.”

As with angels on the head of a pin, the interesting argument is whether the amount of compute is finite or not, not how finite it is.

>>addaon+(OP)
Well, the amount of compute is certainly finite in this era. 250 million GPUs in a year is a big number, but clearly insufficient even for current demand from LLM companies, who are also buying up all available memory chips increasing general prices rapidly, so the current situation is definitely finite and even limited in very practical ways.

And, considering the visible universe is also finite, with finite amounts of matter and energy, it would follow ultimate compute quantity is also finite, unless there is an argument for compute without energy or matter, and/or unlimited compute being made available from outside the visible universe or our light cone. I don't know of any such valid arguments, but perhaps you can point to some?