zlacker

I am at lost. Not fear, just lost.

Don't know what to do. Is my investment into their API still worth it? It feels very unstable at this moment.

>>karmas+(OP)
Microsoft owns it. I honestly can not imagine trying to build a business on an API owned by Microsoft of all companies.

>>Throwa+V
Would like to elaborate a bit?

Though my investment will be still tiny at the moment, but not other multi-modal model on the market right is as good.

>>karmas+(OP)
If you're just using their completions/chat API, you're gonna be ok. As an ultimate fallback you can spin up H100s in the cloud and run VLLM atop a high param open model like Llama 70B. Such models will catch up and their param counts will increase.. eventually. But initially expect gpt-3.5-esque performance. VLLM will give you an OpenAI-like REST API atop a range of models. Keep making things :))

>>padols+72
Thx. I will. My current interests mainly lies in benchmarking their vision model.

That being said, I might not go further relying on their APIs for something more serious

>>Throwa+V
What makes you say that?

Microsoft seems like one of the more reliable partners to build on compared to Google etc. just for the simple reason that their customers are large businesses and not breaking things for them is in their blood. Just like Windows backwards compatibility.

>>karmas+A1
I actually wouldn't be worried in the short term for exactly this reason. Microsoft has legal access to GPT-4 and is allowed to host and serve it via Azure. If OpenAI somehow tanks its API in the near term, MS is sitting on a gold mine and will make use of that by continuing to serve it. In the long term I am worried, but less worried if Sam and Greg form a competing co to continue to build.

>>Throwa+V
People have been successfully building on MS APIs for four decades now. I've been for nearly three.

What exactly are you saying?

>>Throwa+V
Isn't Microsoft famous for their insane API stability and backwards compatibility?

>>karmas+(OP)
By that logic you could never use a third party API.

>>karmas+(OP)
If you are building something that is end-user facing that relies on ChatGPT then that was always a huge and risky bet on the future of OpenAI.

In addition, it would likely be some time, possibly years, before it would be ready for production.

Perhaps recent events have just brought that more clearly into focus for you.

>>ahepp+c4
While I think the sentiment is overblown, if you compare Azure to AWS, Azure's stability is like Google's.

>>ahepp+c4
Microsoft Azure is famous for its insanely bad security: https://karl-voit.at/cloud/

>>ahepp+c4
Microsoft is famous for a lack of adoption DESPITE backwards compatibility.

>>jeswin+64
Why would you build a business that Microsoft could sherlock in a second?

>>ahepp+c4
No I would not say that at all. Microsoft has gone through how many Desktop APIs for Windows at this point? At least a dozen I'd think.

>>Throwa+V
Do you use github?