You figure out a way to crowdsource certain decisions and establish who you can trust. Ask them questions with right and wrong answers. You start to tackle it one product category at a time. Instead of pagerank, which was a web of who linked to who" you start figuring which voters you have who consistently turn in good feedback.
This is some form of metamoderation that slashdot tried to implement.
If you are going to be a tastemaker, stop hiding behind "the algorithm" having some mind of its own that cant be controlled.