This depends on how your aggregation function is weighted.
If your measure is "how many people in the US are white supremacists?" then, yes, it's definitely a minority view (though still more widely held than it should be!).
But if you scale it by each person's power/wealth, you get a very different view. If your question is "what is the total power held by white supremacists?" you'll end up with a larger number.
And if you really want to get an accurate measure where you treat each person's white supremacy value as a number that ranges smoothly from positive (actual white supremacist) to zero (not interested in putting effort into race relations one way or another) to negative (anti-white supremacist), your function may produce a number that explains a hell of a lot of US history.