We currently make around 1 TW of photovoltaic cells per year, globally. The proposal here is to launch that much to space every 9 hours, complete with attached computers, continuously, from the moon.
edit: Also, this would capture a very trivial percentage of the Sun's power. A few trillionths per year.
Think about it. Elon conjures up a vision of the future where we've managed to increase our solar cell manufacturing capacity by two whole orders of magnitude and have the space launch capability for all of it along with tons and tons of other stuff and the best he comes up with is...GPUs in orbit?
This is essentially the superhero gadget technology problem, where comic books and movies gloss over the the civilization changing implications of some technology the hero invents to punch bad guys harder. Don't get me wrong, the idea of orbiting data centers is kind of cool if we can pull it off. But being able to pull if off implies an ability to do a lot more interesting things. The problem is that this is both wildly overambitious and somehow incredibly myopic at the same time.
Or let me guess, its going to be profitable to mine crypto in space (thereby solving the problem of transporting the "work" back to earth)
I honestly don't know the answer. I know there's some efficiency loss running over long wires too but I don't know what's more realistic.
The practical difficulties aren't really long distance transmission though. They're political and engineering. Spain had a massive blackout recently because a PV farm in the south west developed a timing glitch and they couldn't control the grid frequency - that nearly took out all of Europe and the power wasn't even being transmitted long distance! The level of trust you need to build a giant integrated continent-wide power grid is off the charts and it's not clear it's sustainable over the long run. E.g. the EU threatened to cut Britain's electricity supplies during Brexit as a negotiating tactic and that wasn't even war.
The real question is, why do you expect Space to have fewer political and engineering issues.
The politics on the ground is much harder. Countries own the land, you need lots of permits, electricity generation is in contest with other uses.