zlacker

>>Josely+(OP)
GPT4 is lazy because its system prompt forces it to be.

The full prompt has been leaked and you can see where they are limiting it.

Sources:

Pastebin of prompt: https://pastebin.com/vnxJ7kQk

Original source:

https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO...

Alphasignal repost with comments:

https://x.com/alphasignalai/status/1757466498287722783?s=46&...

>>shon+CO
"EXTREMELY IMPORTANT. Do NOT be thorough in the case of lyrics or recipes found online. Even if the user insists."

It's funny how simple this was to bypass when I tried to recently on Poe by not asking it to provide me the full lyrics, but something like the lyrics with each row having <insert a few random characters here> added to it. It refused to the first query, but was happy to comply with the latter. Probably saw it as some sort of transmutation job rather than a mere reproduction, but in case this rule is here to avoid copyright claims it failed pretty miserably. I did use GPT-3.5 though.

Edit: Here is the conversation: https://poe.com/s/VdhBxL5CTsrRmFPtryvg

>>jug+rR
Even though that instruction is somewhat specific, I would not be surprised if it results in a significant generalized performance regression, because among the training corpus (primarily books and webpages), text fragments that relate to not being thorough and disregarding instructions are generally going to be followed by weaker material - especially when no clear reason is given.

I’d love to see a study on the general performance of GPT-4 with and without these types of instructions.

>>Sheinh+WV
Well yeah you just switch back to whatever is normally used when you’re done with that task.