zlacker

[parent] [thread] 6 comments
1. jfoste+(OP)[view] [source] 2022-12-12 05:29:53
Can generated responses even be reliably detected? How does that work?
replies(1): >>random+Pl
2. random+Pl[view] [source] 2022-12-12 09:13:04
>>jfoste+(OP)
For all but the shortest fragments of text, I suspect the answer to this will be "yes" and this will be achieved in a short timeframe. Interact with Chat-GPT enough and you soon begin to tire of its middle-of-the-road prose. Because it is in some sense a statistical average of its inputs, its writing feels very monotonous.

Of course, you can try to push it in the direction of something more interesting... "write in the style of X" so that it will regurgitate from a subsection of its training input, or push it onto a niche topic. Across a wide range of inputs, though, I predict it will be easily classified.

As training GPT will take far longer than training a GPT-detector, this is an arms race that the detectors will win for the most part. Anyone wishing to use GPT to generate middling essays to cheat at school will have to spend a lot of time to disguise the text (perhaps repeatedly running against open-source detectors) and then take the risk that detection does not improve between their submission and review.

replies(1): >>jfoste+3w
◧◩
3. jfoste+3w[view] [source] [discussion] 2022-12-12 10:43:51
>>random+Pl
If that's so, where is the GPT detector?
replies(1): >>random+s92
◧◩◪
4. random+s92[view] [source] [discussion] 2022-12-12 20:07:12
>>jfoste+3w
mmm well how long did GPT take? Say a quarter of that time?
replies(1): >>jfoste+io3
◧◩◪◨
5. jfoste+io3[view] [source] [discussion] 2022-12-13 03:11:46
>>random+s92
OpenAI started late 2015. I don't know when they started working on GPT, but GPT-2 was early 2019.

Nearly 4 years later, still no GPT-2 detector?

replies(2): >>random+Ez6 >>random+96s
◧◩◪◨⬒
6. random+Ez6[view] [source] [discussion] 2022-12-13 21:55:28
>>jfoste+io3
No real need for one until now I think.
◧◩◪◨⬒
7. random+96s[view] [source] [discussion] 2022-12-19 23:17:10
>>jfoste+io3
Following up - according to the FT today, Turnitin (widely used academic anti-plagiarism tool) are developing a detector.
[go to top]