1. Getting things to space is incredibly expensive
2. Ingress/egress are almost always a major bottleneck - how is bandwidth cheaper in space?
3. Chips must be “Rad-hard” - that is do more error correcting from ionizing radiation - there were entire teams at NASA dedicated to special hardware for this.
4. Gravity and atmospheric pressure actually do wonders for easy cooling. Heat is not dissipated in space like we are all used to and you must burn additional energy trying to move the heat generated away from source.
5. Energy production will be cheaper from earth due to mass manufacturing of necessary components in energy systems - space energy systems need novel technology where economies of scale are lost.
Would love for someone to make the case for why it actually makes total sense, because it’s really hard to see for me!
1. Solving cost of launching mass has been the entire premise of SpaceX since day one and they have the track record.
2. Ingress/egress aren't at all bottlenecks for inferencing. The bytes you get before you max out a context window are trivial, especially after compression. If you're thinking about latency, chat latencies are already quite high and there's going to be plenty of non-latency sensitive workloads in future (think coding agents left running for hours on their own inside sandboxes).
3. This could be an issue, but inferencing can be tolerant to errors as it's already non-deterministic and models can 'recover' from bad tokens if there aren't too many of them. If you do immersion cooling then the coolant will protect the chips from radiation as well.
4. There is probably plenty of scope to optimize space radiators. It was never a priority until now and is "just" an engineering problem.
5. What mass manufacture? Energy production for AI datacenters is currently bottlenecked on Siemens and others refusing to ramp up production of combined cycle gas turbines. They're converting old jet engines into power plants to work around this bottleneck. Ground solar is simply not being considered by anyone in the industry because even at AI spending levels they can't store enough power in batteries to ride out the night or low power cloudy days. That's not an issue in space where the huge amount of Chinese PV overproduction can be used 24/7.
Well, it's a physics problem. The engineering solution is possibly not cost efficient. I'd put a lot of money that it isn't.
[1] https://lilibots.blogspot.com/2020/04/starlink-satellite-dim...
Fair point that in SSO you'd need 2-3x the radiator area (and half the solar panels, and minimal/no batteries). I don't think that invalidates my point though.