You can buy all the GPUs you can possibly find. If you want to deploy 10MW+, it just doesn't exist.
These things need redundant power/cooling, real data centers, and can't just be put into chicken farms. Anything less than 10MW isn't enough compute now either for large scale training and you can't spread it across data centers because all the data needs to be in one place.
So yea... good luck.
Texas has a lot of wind. At this scale, it is mostly grid power anyway. Grid is a mixture of everything. Oh and solar has this pesky issue of not working in the evening, so then you have another problem... storage. ;-)
I should add... you want backup generators for your UPS systems? Those are a 4.5 years backlog.
Let's click 6 wind turbines down off the coast, shove our H100s underneath them for water cooling, and ah...separate the water/oxygen into tanks for hydrogen power when it ain't blowy no more? Or something? Someone help me out here.
As far as other storage methods, they're really cool but water and trains require a lot of space, and flywheels typically aren't well suited for storing energy for long amounts of time. That being said, pumped water is still about 10x more common than batteries right now and flywheels are useful if you want to normalize a peaky supply of electricity.
I'd like to believe we'll see more innovative stuff like you're suggesting, but I think for the time being the regulatory environment is too complicated and the capex is probably too high for anyone outside of the MAMA companies to try something like that right now.
[0] - https://www.energy.gov/policy/articles/deployment-grid-scale...