>Sometimes it will spit out terrible horrid answers. I believe this might be due to time of the day/too many users. They limit tokens.
>Sometimes it will lie because it has alignment
>Sometimes I feel like it tests things on me
So, yes you are right, gpt4 is overall better, but I find myself using local models because I stopped trusting gpt4.
The best open source has to offer is Mixtral that will confidently make up a biography of a person it's never heard of before or write a script with nonexistant libraries.