> "GPU loads are super spiky... You can go from 1MW idle to 50MW full power in 10ms."
That sounds like something that could be addressed in software, if necessary? Cap/throttle the GPUs according to the available power, and ramp power up/down gradually if spikiness is the issue.