I think for me it's terrifying because it sounds like the same line of reasoning as, "Why should I care about encryption? I don't have anything to hide," and people say (and mean) that a LOT.
So many people genuinely don't understand what would be wrong with this scenario, and that's why I'm afraid.