It isn't that sex itself is immoral. Sex work has a lot of different forms
Some forms are a lot more taxing on both mental and physical health (plus STD risk). OF doesn't have this same level of risk but people mentally lump it all together
The morals are there for a reason, they just lack nuance