Benchmarks / Agentic

OSWorld-Verified

Computer use on 361 verified Ubuntu desktop tasks (Chrome, LibreOffice, GIMP, VS Code…). Success rate of general models, best across step budgets.

13models
–Open Index weight
–last updated
OSWorldpublisher

OSWorld-Verified

Higher is better · best effort per model

Chart settings
13 of 13 selected

full table below

#ModelEffortScoreCost / taskHarness
1Fable 5max86.0%––
2Opus 5max83.4%––
3Muse Spark 1.1max80.7%––
4MiniMax M3max75.2%––
5Qwen 3.7 Plushigh73.3%––
6Kimi K2.6max73.1%––
7Sonnet 4.6max72.1%––
8Kimi K2.5max63.3%––
9Sonnet 4.5high62.9%––
10Qwen 3high41.6%––
11Sonnet 3.7medium35.8%––
12o3high23.0%––
13Qwen 2.5–3.9%––