I usually prefer 2x scaling on a 4k screen, and then pictures and text are unscaled. I like being able to put a 1080p movie in the upper left corner and a reference webpage below that, then a big text editor to the right and 'work'.
Why would you be looking up and down?