I feel that a lot of people simply don't like Elon because of political reasons which are often also based on misinformed opinions. It also can't be denied that he is an intelligent person. You can hear it when he talks in interviews.
Now I think ultimately any ultra wealthy person is going to have some flaws that people can find and latch onto in order to hate someone.
While I certainly won't deny that I do strongly disagree with all of Elon's politics, I'm being as fair and unbiased as I can when I say - we must be listening to different interviews. The man sounds like a caricature of a bumbling college stoner philosophy student most of the time.