You have to worry about changing the ground temperature even on earth FYI. When designing district heating/cooling systems with borehole fields, one of the things that you check for is to make sure that you don’t inject too much heat (or extract too much) seasonally - ideally it’s roughly balanced so any drift year over year is small.
Obviously things like the diffusivity (so conductivity, mass, density etc) of the ground matter a lot, as does the rate of heat exchange at the surface for it to reject (or absorb) heat to the environment.