Benchmarks / Reasoning

EQ-Bench 3

Uses the published Elo leaderboard. Score: Elo scaled expected win rate vs claude-fable-5. Collected by Jake Boggs' benchmark dashboard.

69models
–Open Index weight
–last updated
boggspublisher

EQ-Bench 3

Higher is better · best effort per model

Chart settings
69 of 69 selected

full table below

#ModelEffortScoreCost / taskHarness
1Fable 5max2050––
2Opus 4.8max2030––
3Opus 4.7max1884––
4Opus 4.6max1717––
5Sonnet 4.6max1714––
6GPT-5.5xhigh1577––
7GLM 5.2max1575––
8DeepSeek V4 Promax1570––
9GLM 5.1max1567––
10GPT-5.4xhigh1563––
11Kimi K2medium1562––
12Kimi K2.6max1561––
13Gemini 3 Prohigh1559––
14GPT-5.2xhigh1559––
15GPT-5.1high1551––
16Opus 4.5high1546––
17Gemini 2.5 Prohigh1545––
18Kimi K2.5max1545––
19Gemini 3.1 Prohigh1538––
20GLM 5high1526––
21Sonnet 4.5high1511––
22o3high1500––
23DeepSeek V4 Flashmax1491––
24Gemma 4 31B IThigh1434––
25Gemma 4 26Bxhigh1431––
26GLM 4.7none1428––
27Qwen 3.5 397B-A17Bmax1413––
28Opus 4medium1400––
29GPT-5.3xhigh1393––
30Gemma 4 12B IT–1361––
31GLM 4.5xhigh1276––
32Sonnet 4high1243––
33o4 minihigh1233––
34DeepSeek R1xhigh1231––
35Qwen 3 235B-A22Bxhigh1214––
36Grok 4.1 Fasthigh1185––
37GPT-4.1high1180––
38Gemini 2.5 Flashmedium1165––
39Grok 3none1150––
40Grok 4high1148––
41Sonnet 3.7medium1112––
42GPT-4.1 Minihigh1099––
43Gemma 3 27B ITmedium1094––
44GLM 4.7 Flashnone1083––
45DeepSeek V3.0324–1082––
46Sonnet 3.5medium1081––
47gpt-oss-120bhigh1076––
48Mistral Small 3.2none1072––
49Grok 3 Minihigh1065––
50GPT-4.5none1053––
51Qwen 3 32Bnone1048––
52Llama 3.1max1043––
53GPT-4.1 Nanohigh1029––
54Gemma 3 4B IT–977––
55gpt-oss-20bhigh956––
56Mistral Large 2411–951––
57Gemini 2.0 Flashmedium911––
58Qwen 3 30B-A3Bnone868––
59Qwen 3 8Bnone866––
60Grok 4.20xhigh852––
61Qwen 2.5 72Bnone846––
62Llama 4 Maverickmedium807––
63Mistral Smallnone802––
64Llama 3.1 405bnone799––
65Mistral Small 3.1none784––
66Llama 4 Scoutmedium608––
67GPT-4high578––
68Gemma 2 9B IT–554––
69Llama 3.2 1bnone200––