I'm still unconvinced. And I'll note that plenty of people get the feeling of presence from novels, from comic books, from movies, from games. Getting lost in a world isn't a property of technology. It's something humans have been doing since we were telling stories around a campfire.
When we want that, that is. As you say, we just as often want distance from our experiences. And quite often we're indifferent to immersion; it's not material to the experience we seek. Movie tickets sales are down 25% since 2000. That might be in part because some people have fancy home theaters that are nearly as good, the at-home 100" screen with 7.1 sound. But I think it's mostly because people are happy watching things on laptops and tablets and phones. They mostly don't want to "be there", however much that horrifies the Martin Scorseses of the world.
People always had TV. Obviously home viewing is winning because it's getting better and it's much cheaper and more convenient.
It's true that home viewing is winning because it's more convenient. But my point is that it's obviously worse in terms of viewer experience and the technical qualities that VR proponents believe will finally lead to VR success.