I agree with the sibling advice to insist on PSA labs. You are your own advocate. The primary job of a doctor is actually to be a bureaucrat, the first line of offense for the health management companies whose whole function is to deny healthcare. They can easily rubber stamp a few labs once you change their risk calculus of not doing it, by explicitly laying out your risk factors.
Despite all that, as you say, you won't be sued for saying that stuff.