Same here. When I see police, I just think, don't go near them or bother them at all. I actively avoid police if I can unless there are a bunch of other people around (concert, sporting event etc.).
The fear I think is more along the lines that police can detain you, arrest you and so on. So I just figure, why chance it? I optimize for lowest risk and I view police as an unnecessary risk.