zlacker

[parent] [thread] 4 comments
1. Andrew+(OP)[view] [source] 2025-05-22 08:35:00
Turns out that AI is not good at summarising things:

https://futurism.com/ai-chatbots-summarizing-research

replies(4): >>johnb2+j3 >>wiseow+U4 >>Gud+o9 >>TiredO+3V1
2. johnb2+j3[view] [source] 2025-05-22 09:01:06
>>Andrew+(OP)
As usual the paper is dead on arrival. They tested with obsolete models and non-reasoning models.

Try again with any SOTA reasoning model (GPT-o3, Gemini 2.5 Pro, Grok 3).

3. wiseow+U4[view] [source] 2025-05-22 09:20:09
>>Andrew+(OP)
It was good enough with summarizing this empty rant.
4. Gud+o9[view] [source] 2025-05-22 10:22:17
>>Andrew+(OP)
Ok, I disagree.

Out of curiosity, I used ChatGPT to make a summary of “FreeBSD vs Linux comparison”, and if came out as extremely fair and to the point, in my opinion.

5. TiredO+3V1[view] [source] 2025-05-22 21:39:37
>>Andrew+(OP)
There was this widely discussed paper about how using ai generated data for training will be the death of llms that was published about a week before all llms switched to using ai generated data for training and becoming twice as good as before
[go to top]