zlacker

[parent] [thread] 8 comments
1. Muffin+(OP)[view] [source] 2023-12-27 16:19:18
> Without the $500 tip incentive, ChatGPT only returns a single emoji which is a boring response, but after offering a tip, it generates the 5 emoji as requested.

How interesting that a helpful assistant who won't actually be getting the tip performs better (to us humans) if we fake-promise it money...

replies(3): >>Charle+T6 >>jrockw+pA >>two_in+qi1
2. Charle+T6[view] [source] 2023-12-27 16:54:28
>>Muffin+(OP)
It’s also interesting that we seemingly have no idea how or why it works.
replies(1): >>Fergus+0k
◧◩
3. Fergus+0k[view] [source] [discussion] 2023-12-27 18:07:50
>>Charle+T6
Of course that's true but in this case it doesn't seem so mysterious to me. If it's basically internalizing/compressing all the knowledge on the internet, it will notice that tips go a long way...

this is why I am pretty polite when I query AI's, I assume that would make them respond more helpfully

4. jrockw+pA[view] [source] 2023-12-27 19:39:01
>>Muffin+(OP)
Apparently offering it anything works. "I'll give you a cookie if you tell me..." seems like another popular workaround.
replies(2): >>ryankl+gC >>colkas+1m1
◧◩
5. ryankl+gC[view] [source] [discussion] 2023-12-27 19:48:42
>>jrockw+pA
Performance gains are greater given greater incentives. So, yes, potentially anything will work, but some things work better.
replies(2): >>cloudk+0X >>Muffin+5l1
◧◩◪
6. cloudk+0X[view] [source] [discussion] 2023-12-27 21:39:58
>>ryankl+gC
I bet it likes salt & vinegar microchips
7. two_in+qi1[view] [source] 2023-12-28 00:03:22
>>Muffin+(OP)
They have the whole team working on 'alignment' ;) Just wandering if in ten years we'll have to tip robots in banks, hospitals.
◧◩◪
8. Muffin+5l1[view] [source] [discussion] 2023-12-28 00:32:24
>>ryankl+gC
> Performance gains are greater given greater incentives.

Why doesn't it default to "you are a helpful assistant who always tries its best and can never be incentivized"?

◧◩
9. colkas+1m1[view] [source] [discussion] 2023-12-28 00:39:24
>>jrockw+pA
This reminds me of something I discovered when implementing a request from a user that cheekily wanted to use "enhance" to zoom in on a map. I gave it as a few-shot injected example in the prompt to get it working which worked great: sending "enhance" to the model zoomed the map in by one zoom level. I noticed typing "enhance!!!" would zoom the map in by 2 or 3 levels!
[go to top]