The most optimistic hope is that the government mandate will force enough demand that manufacturers can enjoy some economies of scale and actually try to compete on price. I don't think this will happen anytime soon.
If you have a poorly insulated house then the fix is to insulate it, which is what a lot of people are doing around here, with very hold houses. My house is less than 60 years old and very well insulated for the time, and it holds up even today - it's always warm, with the heat pump not even close to its max power.