zlacker

[parent] [thread] 5 comments
1. XCSme+(OP)[view] [source] 2026-02-04 17:53:03
Oh wow, I thought humans are like 0.1% error rate, if they are native speakers and aware of the subject being discussed.
replies(3): >>zipy12+Ig >>rhdunn+gE >>Nimitz+0K
2. zipy12+Ig[view] [source] 2026-02-04 19:01:47
>>XCSme+(OP)
I was skepitcal upon hearing the figure but various sources do indeed back it up and [0] is a pretty interesting paper (old but still relevant human transcibers haven't changed in accuracy).

[0] https://www.microsoft.com/en-us/research/wp-content/uploads/...

replies(1): >>XCSme+1m
◧◩
3. XCSme+1m[view] [source] [discussion] 2026-02-04 19:28:00
>>zipy12+Ig
I think it's actually hard to verify how correct a transcription is, at scale. Curious where those error rate numbers come from, because they should test it on people actually doing their job.
4. rhdunn+gE[view] [source] 2026-02-04 20:51:55
>>XCSme+(OP)
It can depend a lot on different factors like:

- familiarity with the accent and/or speaker;

- speed and style/cadence of the speech;

- any other audio that is happening that can muffle or distort the audio;

- etc.

It can also take multiple passes to get a decent transcription.

replies(1): >>qingch+V91
5. Nimitz+0K[view] [source] 2026-02-04 21:17:42
>>XCSme+(OP)
Most of these errors will not be meaningful. Real speech is full of ambiguities. 3% is low
◧◩
6. qingch+V91[view] [source] [discussion] 2026-02-04 23:39:57
>>rhdunn+gE
You missed a giant factor: domain knowledge. Transcribing something outside of your knowledge realm is very hard. I posted above about transcribing the commentary of a motorbike race where the commentators only used the slang names of the riders.
[go to top]