Exactly. This cannot work without forcing a whole range of products a LOT more expensive than they are.
That's a feature, not a bug.
But yes, the rest of society will become a LOT "poorer" (but still comfortable) for no more than a decent increase in the living standard of the working poor.