zlacker

>>g-mork+(OP)
Whenever computer chips go into space, they have to be hardened against radiation, because there is no atmosphere to protect them. Otherwise you get random bit flips.

This process takes a while, which is partly why all the computers in space seem out of date. Because they are.

No one is going to want to use chips that are a many years out of date or subject to random bit flips.

(Although now it got me thinking, do random bit flips matter when training a trillion parameter model?)

>>jedber+9g
LLMs specifically are fine with random bits flipped for the results to be 'creative'.

>>fooker+lY
That's not exactly how LLM temperature works. :). Also that's on inference, not training. Presumably these would be used for training, the latency would be too high for inference.