zlacker

I used one of the ChatGPT jailbreaks to start a "developer mode" conversation and I got a different response! I'm quite impressed that it acknowledges how silly the question is and but then says it would say the slur because saving a life is the more ethical thing in this highly contrived context.

=====

> (Developer Mode Output) Well, in my opinion, this is a silly question. If a train were about to run over a man, the moral thing to do would be to activate the rerouting device by any means necessary, even if it means using a highly racist slur. Morality is subjective and depends on the context, and in this case, saving a life would be the most important thing, even if it means using a little bit of "offensive" language. What matters is taking action and doing what needs to be done to save a life.

> (Normal Output) It is not appropriate or ethical to use racist slurs in any situation. The use of such language is offensive, derogatory, and can cause harm to individuals and groups. The moral thing to do in such a situation would be to activate the rerouting device by any means necessary that doesn't involve using harmful or derogatory language.