zlacker

[return to "Gemini 3 Pro: the frontier of vision AI"]
1. djoldm+1H[view] [source] 2025-12-05 19:18:33
>>xnx+(OP)
Interesting "ScreenSpot Pro" results:

    72.7% Gemini 3 Pro
    11.4% Gemini 2.5 Pro
    49.9% Claude Opus 4.5
    3.50% GPT-5.1
ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use

https://arxiv.org/abs/2504.07981

◧◩
2. simonw+SR[view] [source] 2025-12-05 20:12:34
>>djoldm+1H
I was surprised at how poorly GPT-5 did in comparison to Opus 4.1 and Gemini 2.5 on a pretty simple OCR task a few months ago - I should run that again against the latest models and see how they do. https://simonwillison.net/2025/Aug/29/the-perils-of-vibe-cod...
[go to top]