zlacker

>>tikkun+(OP)
Great work! I've been thinking how helpful it would be if you could provide an API to access those results. That way, in our application, we can easily determine the fastest model based on their speed.

I operate a SaaS product that utilizes generative AI. Many users have been expressing concerns about the response speed. Interestingly, it seems that the speed is slower during the day and faster at night. Once again, this is fantastic information!

>>spikey+YH3
Thanks for the compliments!

For api / switching based on speed: do you mean specifically between the identical or nearly models like gpt-4 and gpt-4-0613, or do you mean across non identical models too?