Benchmarks / Math

MathArena

Uses MathArena's website-wide IRT expected-performance estimate. Score: website-wide IRT expected performance. Collected by Jake Boggs' benchmark dashboard.

81models
–Open Index weight
–last updated
boggspublisher

MathArena

Higher is better · best effort per model

Chart settings
81 of 81 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6.1 Solmax90.1%––
2GPT-6 Astramax88.0%––
3GPT-6 Solmax84.9%––
4Opus 5.5max83.3%––
5Fable 5.1max82.6%––
6Opus 5max73.7%––
7GPT-5.6 Solmax66.9%––
8GPT-5.5xhigh63.9%––
9Qwen 3.8 Maxmax56.1%––
10GPT-5.4 Proxhigh55.6%––
11Fable 5max55.4%––
12Kimi K3max50.5%––
13Grok 4.7xhigh46.7%––
14Muse Spark 1.3max46.6%––
15Muse Spark 1.1max46.5%––
16Opus 4.8max43.5%––
17DeepSeek V4.1 Flashmax43.3%––
18GPT-5.4xhigh40.8%––
19Grok 4.5max38.5%––
20GPT-5.2xhigh37.4%––
21Gemini 3.8 Flashmax35.3%––
22Gemini 3.1 Prohigh32.6%––
23DeepSeek V4 Promax29.7%––
24DeepSeek V4 Flashmax29.6%––
25Gemini 3.7 Flashmax29.3%––
26Kimi K2.6max27.8%––
27Gemini 3.5 Flashxhigh27.0%––
28Gemini 3.6 Flashxhigh26.8%––
29Opus 4.6max26.7%––
30GLM 5.2max26.4%––
31GLM 5.1max23.4%––
32Gemini 3 Prohigh22.8%––
33Opus 4.7max22.7%––
34Gemini 3 Flashhigh22.7%––
35GLM 5high22.0%––
36DeepSeek V3.2high21.5%––
37Qwen 3.5 397B-A17Bmax21.0%––
38Kimi K2.5max19.6%––
39GPT-5high18.7%––
40GPT-5.1high18.7%––
41GLM 4.6none17.8%––
42Kimi K2medium17.2%––
43Qwen 3.5 27Bhigh17.1%––
44Grok 4high16.4%––
45Grok 4.1 Fasthigh16.4%––
46gpt-oss-120bhigh16.3%––
47GPT-5 Minihigh16.0%––
48o4 minihigh16.0%––
49Qwen 3.5 35B-A3Blow15.9%––
50Grok 4 Fastnone15.8%––
51DeepSeek V3.1none15.3%––
52o3high15.1%––
53Qwen 3.6 35B–14.8%––
54GLM 4.5xhigh14.2%––
55Qwen 3high14.1%––
56Qwen 3.5 9Blow13.9%––
57DeepSeek R1.0528–13.8%––
58gpt-oss-20bhigh13.7%––
59GPT-5 Nanohigh13.7%––
60Gemini 2.5 Prohigh13.6%––
61Sonnet 4.5high13.5%––
62Qwen 3.5 4Blow12.8%––
63GLM 4.5 Air–12.7%––
64Grok 3 Minihigh12.4%––
65o3 minihigh12.3%––
66Qwen 3 30B-A3Bnone12.1%––
67Qwen 3 235B-A22Bxhigh11.6%––
68GLM 4.5 Vnone11.2%––
69Gemini 2.5 Flashmedium11.1%––
70Opus 4medium10.7%––
71o1medium10.6%––
72DeepSeek R1xhigh9.3%––
73Qwen 3 4Bnone8.7%––
74Gemini 2.0 Flashmedium7.9%––
75Sonnet 3.7medium7.3%––
76DeepSeek V3.03–6.9%––
77DeepSeek V3none4.3%––
78Qwen 3.5 2Blow4.3%––
79Gemini 2.0 Pronone4.2%––
80GPT-4ohigh3.1%––
81Sonnet 3.5medium2.3%––