I think largely these days people just plug less stuff in, printers, scanners, other odd gadgets are less common so its really just USB mass storage devices and video outputs getting physically plugged in. Otherwise everything else is controlled over wifi with a phone app.
Linux users don't have to either. (Linux devs do.) Another thing they don't have to do is searching vendor site for drivers which may not even be installed correctly.