zlacker

[return to "Pushing ChatGPT's Structured Data Support to Its Limits"]
1. engina+og[view] [source] 2023-12-27 16:41:40
>>goranm+(OP)
is the tipping thing correct? I provided the same prompt to ChatGPT and received multiple emojis without offering a tip.

prompt: you're Ronald McDonald. respond with emojis. what do you do for fun? answer::circus_tent::hamburger::juggling::party_popper::balloon::game_die::french_fries::performing_arts::rolling_on_the_floor_laughing::people_holding_hands::rainbow::art_palette:

◧◩
2. minima+ii[view] [source] 2023-12-27 16:50:46
>>engina+og
Your mileage may vary with any examples since ChatGPT at a nonzero temperature is nondeterministic.

If that example is through the ChatGPT web UI and not the ChatGPT API then that's a different story entirely.

◧◩◪
3. daniel+TD[view] [source] 2023-12-27 18:50:09
>>minima+ii
It's also non-deterministic if you drop the temperature to zero. The only way to get deterministic responses is to lock the seed argument to a fixed value.
◧◩◪◨
4. soultr+Up1[view] [source] 2023-12-27 23:26:16
>>daniel+TD
Can you explain how this works more?
◧◩◪◨⬒
5. daniel+Kq1[view] [source] 2023-12-27 23:31:45
>>soultr+Up1
From the OpenAI cookbook[1]:

TLDR: Developers can now specify seed parameter in the Chat Completion request for consistent completions. We always include a system_fingerprint in the response that helps developers understand changes in our system that will affect determinism.

[1] https://cookbook.openai.com/examples/deterministic_outputs_w...

◧◩◪◨⬒⬓
6. soultr+Nr1[view] [source] 2023-12-27 23:39:36
>>daniel+Kq1
Thank you, I should have been more specific. I guess what I’m asking is, how deterministic would you say it is in your experience? Can this be used for classifying purposes where the values should not be outside what’s given in a variable input prompt , or when we say deterministic are we saying that , if given the same prompt then the output would be the exact same only? Or is the seed a starting parameter that effectively corners the LLM to a specific starting point only then depending on the variable prompts, potentially give non-deterministic answers?

Perhaps I’m misunderstanding how the seed is used in this context. If you have any examples of how you use it in real world context then that would be appreciated.

◧◩◪◨⬒⬓⬔
7. bigEno+l22[view] [source] 2023-12-28 05:57:17
>>soultr+Nr1
I’ve not had any success to make responses deterministic with these settings. I’m even beginning to suspect historic conversations via API are used to influence future responses, so I’m not sure if it’ll truly be possible.
[go to top]