Benchmarks / Agentic

Terminal-Bench Science (Vals)

Research workflow tasks contributed by practicing scientists across five domains

40models
–Open Index weight
2026-10-14last updated
Vals AIpublisher

Terminal-Bench Science (Vals)

Higher is better · best effort per model

Chart settings
40 of 40 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6 Astramax62.9%$20.80Mini-SWE-agent
2GPT-6.1 Solmax52.9%$3.44Mini-SWE-agent
3Opus 5.5max47.1%$19.12Mini-SWE-agent
4Sonnet 5.5max47.1%$32.52Mini-SWE-agent
5Gemini 4high44.3%$44.90Mini-SWE-agent
6Fable 5.1max40.0%$38.01Mini-SWE-agent
7Wonder Fullmax37.1%$22.81Mini-SWE-agent
8GPT-6 Solmax30.0%$5.82Mini-SWE-agent
9Opus 5max27.1%$32.54Mini-SWE-agent
10Wondermax22.9%$19.61Mini-SWE-agent
11GPT-5.6 Solmax20.0%$7.32Mini-SWE-agent
12Fable 5max15.7%$51.99Mini-SWE-agent
13Qwen 3.8 Maxmax12.9%$16.68Mini-SWE-agent
14Grok 4.6high11.4%$4.82Mini-SWE-agent
15Muse Spark 1.3max10.0%$6.09Mini-SWE-agent
16Grok 4.7xhigh10.0%$17.04Mini-SWE-agent
17Haiku 5.5max10.0%$4.52Mini-SWE-agent
18GPT-5.6 Terramax10.0%$5.19Mini-SWE-agent
19Gemini 3.8 Flashhigh8.6%$5.64Mini-SWE-agent
20Gemini 3.7 Flashhigh7.1%$7.19Mini-SWE-agent
21Gemini 3.5 Flashhigh5.7%$3.80Mini-SWE-agent
22GLM 5.3max5.7%$15.63Mini-SWE-agent
23Sonnet 5max5.7%$30.30Mini-SWE-agent
24Ember-1–5.7%$30.76Mini-SWE-agent
25GPT-6 Lunamax4.3%$0.241Mini-SWE-agent
26DeepSeek V4 Flash 0731high4.3%$1.10Mini-SWE-agent
27Gemini 3.6 Flashhigh4.3%$4.39Mini-SWE-agent
28Opus 4.8max4.3%$23.14Mini-SWE-agent
29DeepSeek V4 Pro 0813max4.3%$4.63Mini-SWE-agent
30MiMo V2.6 Flashhigh4.3%$0.244Mini-SWE-agent
31Step 5 Preview–2.9%$4.25Mini-SWE-agent
32MiMo V2.6 Prohigh2.9%$0.621Mini-SWE-agent
33GLM 5.3 Flashmax2.9%$0.524Mini-SWE-agent
34Gemini 3.1 Prohigh1.4%$5.91Mini-SWE-agent
35Hy4–1.4%$2.14Terminus 2
36Kimi K3max1.4%$21.30Mini-SWE-agent
37Mercury 2.5high0.0%$0.178Mini-SWE-agent
38GPT-5.6 Lunamax0.0%$0.581Mini-SWE-agent
39DeepSeek V4.1 Flashhigh0.0%$0.473Mini-SWE-agent
40Qwen 3.8 27Bxhigh0.0%$11.14Mini-SWE-agent