People do that all of the time and gladly pay the extra $10 for a smaller “phone” - the cellular Apple Watch.
I will leave my phone in a heartbeat when I’m going to the gym, the pool, or anywhere else where a large phone isn’t convenient and I still want to be able to keep in touch with people