Whenever computer chips go into space, they have to be hardened against radiation, because there is no atmosphere to protect them. Otherwise you get random bit flips.
This process takes a while, which is partly why all the computers in space seem out of date. Because they are.
No one is going to want to use chips that are a many years out of date or subject to random bit flips.
(Although now it got me thinking, do random bit flips matter when training a trillion parameter model?)
That's not exactly how LLM temperature works. :). Also that's on inference, not training. Presumably these would be used for training, the latency would be too high for inference.
Latency would be fine for inference, this is low earth orbit, that is about 25ms optimistically. Well within what we expect from our current crop of non local LLMs.
This process takes a while, which is partly why all the computers in space seem out of date. Because they are.
No one is going to want to use chips that are a many years out of date or subject to random bit flips.
(Although now it got me thinking, do random bit flips matter when training a trillion parameter model?)