Benchmarks / Agentic

Terminal-Bench 4.0

Resolution rate of agent+model systems on 66 professional computer-work tasks in a terminal (5 trials per task, 8-hour timeout). Rows are harness+model pairs.

23models
10%Open Index weight
–last updated

Terminal-Bench 4.0

Higher is better · best effort per model

Chart settings
23 of 23 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5.5max64.8%$14.30Claude Code
2Sonnet 5.5max61.8%$22.22Claude Code
3GPT-6 Astramax58.2%$9.90Codex
4GPT-6.1 Solmax58.2%$1.92Codex
5Fable 5.1max57.9%$18.92Claude Code
6Opus 5xhigh53.9%$18.44Claude Code
7GPT-6 Solmax49.4%$4.40Codex
8Fable 5max44.5%$22.02Claude Code
9GLM 5.3max41.8%$8.27Claude Code
10Grok 4.7xhigh37.6%$11.16Grok Build
11GPT-5.6 Solmax37.3%$7.70Codex
12GLM 5.3 Flashnone35.8%$8.74Claude Code
13Qwen 3.8 Maxmax27.0%$14.05Claude Code
14Opus 4.8max23.6%$19.64Claude Code
15GPT-5.6 Terramax21.5%$5.25Codex
16Grok 4.6high20.3%$10.88Grok Build
17Gemini 3.8 Flashhigh19.1%$5.54mini-SWE-agent
18GPT-5.6 Lunamax17.3%$1.05Codex
19GPT-6 Lunamax16.4%$0.219Codex
20Muse Spark 1.3xhigh14.6%$0.0000Muse Code
21Grok 4.5high12.4%$6.35Grok Build
22Sonnet 5max12.4%$29.10Claude Code
23Gemini 3.7 Flashhigh11.2%$3.82mini-SWE-agent