Actually, I'm one of those people. For over 20 years, I struggled with playing piano because I would have to memorize a different fingering pattern for the major scale in 12 different keys. I knew the mechanical process of it, but it was hard to develop the muscle memory and play songs by ear based on intuition alone. So I was most comfortable playing in C major (white keys only) and using mechanical/electronic transposition.
In the year 2024, I stumbled upon the Janko piano layout ( https://en.wikipedia.org/wiki/Jank%C3%B3_keyboard ), which turns out to be the smallest modification to standard piano that results in an isomorphic keyboard. I kid you not, I was up and running in less than 5 minutes - I just treated the layout as if it was a pattern to learn on standard piano, except that it was the only pattern I ever had to learn. On Janko, I found it much easier to play songs by ear, in any key. I wish I discovered Janko earlier, as standard piano was never a good fit for my brain.
For anyone who is curious to try, here's a software Janko piano keyboard that you can play right in the web browser: https://novayashkola.org/janko/
As a side note, the traditional keyboard size is not representative of the average pianist's hand size. David Steinbuhler [3] has been making modified traditional keyboard layouts by varying the width of the keys slightly, and people rave about it. I've had the chance to visit his shop in Titusville, Pennsylvania, where he designs them. It's a totally enhanced playing experience, even for someone like me who can play a 10th without difficulty.
[0] https://en.wikipedia.org/wiki/Harpejji [1] https://dodekamusic.com/ [2] https://www.lumatone.io/ [3] http://dsstandardfoundation.org/the-standards/