Benchmarks / Reasoning

ARC-AGI-2

ARC-AGI-2 semi-private evaluation set: harder compositional grid puzzles designed to resist memorization; percent solved with verified cost per task.

85models
10%Open Index weight
–last updated
ARC Prizepublisher

ARC-AGI-2

Higher is better · best effort per model

Chart settings
85 of 85 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6 Astramax95.0%$1.12–
2GPT-6.1 Solmax94.2%$0.254–
3Opus 5.5high93.3%$0.408–
4GPT-5.6 Solmax92.5%$1.44–
5Gemini 4high91.3%$0.325–
6Opus 5max90.4%$2.06–
7Fable 5.1max90.0%$4.49–
8GPT-6 Solmax89.6%$0.439–
9Fable 5max89.2%$5.45–
10Gemini 3.8 Flashhigh89.2%$0.400–
11GPT-5.5xhigh85.0%$1.87–
12Gemini 3.7 Flashhigh84.6%$0.249–
13Gemini 3–84.6%$13.62–
14GPT-5.5 Prohigh84.6%$10.51–
15GPT-5.6 Terramax83.9%$1.09–
16GPT-5.4 Proxhigh83.3%$16.41–
17Gemini 3.1 Prohigh77.1%$0.962–
18Opus 4.7max75.8%$7.43–
19GPT-5.4xhigh74.0%$1.52–
20DeepSeek V4.1 Flashmax72.9%$0.129–
21Opus 4.8high72.1%$2.74–
22Gemini 3.5 Flashhigh72.1%$0.850–
23Opus 4.6high69.2%$3.47–
24Grok 4.6xhigh67.1%$0.757–
25GLM 5.3 Flashmax65.8%$0.093–
26Grok 4.20xhigh65.1%$0.920–
27DeepSeek V4 Flash 0731max61.4%$0.042–
28Grok 4.7xhigh61.4%$2.01–
29DeepSeek V4 Pro 0813max61.3%$0.598–
30Haiku 5.5xhigh61.3%$0.085–
31Sonnet 4.6high60.4%$2.70–
32Kimi K3max60.4%$1.59–
33Gemini 3.6 Flashhigh60.4%$0.606–
34GPT-5.6 Lunamax59.6%$0.177–
35GPT-6 Lunamax59.3%$0.062–
36GPT-5.2 Prohigh54.2%$15.72–
37GPT-5.2xhigh52.9%$1.90–
38Grok 4.5high52.6%$0.780–
39Qwen 3.8 27Bxhigh42.4%$0.447–
40Inkling Smallxhigh40.1%$0.233–
41Opus 4.5high37.6%$2.40–
42Inklingmax36.5%$0.642–
43Gemini 3 Flashhigh33.6%$0.231–
44Gemini 3 Prohigh31.1%$0.811–
45GLM 5.2max22.8%$0.250–
46GPT-5.4 Minixhigh18.9%$0.750–
47GPT-5 Prohigh18.3%$7.14–
48GPT-5.1high17.6%$1.17–
49Grok 4high16.0%$2.17–
50Sonnet 4.5high13.6%$0.759–
51Kimi K2.5max11.8%$0.280–
52Gemini 3.5 Flash-Litehigh10.3%$0.139–
53GPT-5high9.9%$0.730–
54Opus 4medium8.6%$1.93–
55o3high6.5%$0.834–
56o4 minihigh6.1%$0.856–
57Sonnet 4high5.9%$0.486–
58GPT-5.4 Nanoxhigh5.7%$0.160–
59Grok 4 Fastnone5.3%$0.061–
60Gemini 2.5 Prohigh4.9%$0.757–
61MiniMax M2.5high4.9%$0.170–
62GLM 5high4.9%$0.270–
63GPT-5 Minihigh4.4%$0.198–
64Haiku 4.5xhigh4.0%$0.377–
65DeepSeek V3.2high4.0%$0.120–
66o3 minihigh3.0%$0.547–
67GPT-5 Nanohigh2.6%$0.029–
68Gemini 2.5 Flashmedium2.5%$0.319–
69Gemini 2.0 Flashmedium1.3%$0.0040–
70DeepSeek R1xhigh1.3%$0.080–
71Qwen 3 235B-A22Bxhigh1.3%$0.0044–
72o1 minihigh0.8%$0.191–
73Gemini 1.5 Pronone0.8%$0.040–
74GPT-4.5none0.8%$2.10–
75GPT-4.1high0.4%$0.069–
76Grok 3 Minilow0.4%$0.013–
77GPT-4ohigh0.0%$0.080–
78GPT-4o minihigh0.0%$0.010–
79Llama 4 Maverickmedium0.0%$0.012–
80Llama 4 Scoutmedium0.0%$0.0062–
81GPT-4.1 Nanohigh0.0%$0.0036–
82GPT-4.1 Minihigh0.0%$0.014–
83Grok 3none0.0%$0.142–
84Magistral Small–0.0%$0.049–
85Magistral Medium–0.0%$0.108–