Benchmarks / Math

ProofBench v1.1

Automated theorem proving benchmark

51models
–Open Index weight
2026-10-12last updated
Vals AIpublisher

ProofBench v1.1

Higher is better · best effort per model

Chart settings
51 of 51 selected

full table below

#ModelEffortScoreCost / taskHarness
1Sonnet 5.5max100.0%$0.558–
2Opus 5.5max100.0%$0.962–
3Fable 5.1max100.0%$2.70–
4AlephProver–100.0%$9.35–
5GPT-6.1 Solmax99.0%$0.233–
6GPT-6 Astramax99.0%$1.71–
7Gemini 4high99.0%$0.783–
8Opus 5max99.0%$2.11–
9Fable 5max95.0%$5.45–
10Wonder Fullmax94.0%$0.856–
11Haiku 5.5max89.0%$0.174–
12Kimi K3max87.0%$1.65–
13Aristotle–86.0%––
14Wondermax84.0%$1.31–
15GPT-6 Solmax83.0%$0.476–
16GPT-5.6 Solmax83.0%$1.44–
17Sonnet 5max77.0%$1.37–
18Hy4–75.0%$0.336–
19GPT-5.6 Terramax74.0%$1.27–
20MiMo V2.6 Prohigh70.0%$0.245–
21GPT-6 Lunamax64.0%$0.042–
22MiMo V2.6 Flashhigh63.0%$0.123–
23Ember-1–61.0%$1.74–
24GPT-5.6 Lunamax60.0%$0.123–
25Gemini 3.7 Flashhigh58.0%$0.559–
26Muse Spark 1.3max58.0%$0.479–
27Qwen 3.8 Maxmax58.0%$1.50–
28DeepSeek V4 Flash 0731high56.0%$0.037–
29DeepSeek V4.1 Flashhigh54.0%$0.126–
30Grok 4.6high51.0%$0.759–
31DeepSeek V4 Pro 0813max50.0%$0.062–
32GLM 5.3max49.0%$2.08–
33Gemini 3.8 Flashhigh48.0%$0.603–
34Muse Spark 1.2xhigh43.0%$0.442–
35Step 5 Preview–42.0%$0.715–
36Gemini 3.5 Flashhigh31.0%$0.570–
37Grok 4.5high31.0%$0.574–
38Grok 4.7xhigh26.0%$0.788–
39Gemini 3.1 Prohigh26.0%$0.784–
40MiMo V2.5 Proxhigh22.0%$0.090–
41GLM 5.3 Flashmax21.0%$0.224–
42MiniMax M3max18.0%$0.419–
43DeepSeek V4max16.0%$0.034–
44MiMo V2.5xhigh16.0%$0.057–
45Qwen 3.8 27Bxhigh16.0%$2.30–
46Mistral Large 4high10.0%$0.642–
47Mistral Medium 3.5high9.0%$1.30–
48Inkling Smallxhigh6.0%$0.075–
49Mercury 2.5high3.0%$0.044–
50Inklingmax0.0%$0.201–
51Nemotron 3.5 Lightning–0.0%$0.016–