What you described might just be a self-fulfilling prophecy. If the moderate right routinely gets bundled with the far right extremists (and often anti-vac, conspiracy theory and whatever) for voicing out their right leaning (but moderate) opinions, then they might just choose to censor themselves instead.