Not to put too fine a point on it and with all due respect, but are you black? Have you asked your black neighbors about it?
I am half-black and was raised in California. I have lived in SF for the last 10 years.
While I have not directly been troubled by police in SF, I put myself on notice every. Single. Time. I go outside.
Similarly I've been pulled out of cell sites at gunpoint and bent over the hood of my car, and patted down several times also for "looking out of place".
Part of it is also social effect. When multiple people encounter a similar problem they have a shared experience they can talk about and that social experience can seem to magnify the importance of the problem. When nobody is having the problem and almost nobody is talking about it the concern is much lower.
Police are generally highly biased in favor of military personnel regardless of their skin color outside of military base communities. For example if a person is pulled over, regardless of the validity of the stop or whether racial profiling is at play, the person is likely to drive away with only a warning if the officer happens to see a military ID and the person remains calm and polite. Military people have been sharing these stories for years.
Until I started working at the big bank the military is by far the most diverse group I have ever worked with.