Every major dictionary specifically uses terms like "prejudice", "discrimination against", "stereotype". There is obviously a consensus that it is referring to negative/unequal treatment.