Adding more parameters tends to make the model better. With OpenAI having access to huge capital they can afford 'brute forcing' a better model. AFAIK right now OpenAI has the most compute power, which would partially explain why GPT4 yields better results than most of the competition.
Just having the hardware is not the whole story of course, there is absolutely a lot of innovation and expertise coming from oAI as well.