Benchmarks / Reasoning

Mystery Game Puzzles (Epoch AI)

Epoch AI's deduction puzzles: work out the hidden rules of a mystery game from its observations. Score is the share solved. Data: Epoch AI, CC BY.

77models
–Open Index weight
–last updated
epoch-taskspublisher

Mystery Game Puzzles (Epoch AI)

Higher is better · best effort per model

Chart settings
77 of 77 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6 Astramax84.0%–Epoch AI
2GPT-6.1 Solmax80.0%–Epoch AI
3Opus 5.5max71.0%–Epoch AI
4Sonnet 5.5max65.0%–Epoch AI
5Gemini 4high64.0%–Epoch AI
6Fable 5.1max58.0%–Epoch AI
7GPT-5.6 Solmax58.0%–Epoch AI
8GPT-6 Solmax56.0%–Epoch AI
9GPT-5.5xhigh56.0%–Epoch AI
10Fable 5max52.0%–Epoch AI
11Gemini 3.8 Flashhigh47.0%–Epoch AI
12DeepSeek V4.1 Flashmax43.0%–Epoch AI
13DeepSeek V4 Pro 0813max43.0%–Epoch AI
14Qwen 3.8 Maxxhigh38.0%–Epoch AI
15GPT-5.4xhigh37.0%–Epoch AI
16Gemini 3.7 Flashhigh37.0%–Epoch AI
17Opus 5max37.0%–Epoch AI
18Opus 4.8max36.0%–Epoch AI
19GPT-5.6 Terramax35.0%–Epoch AI
20Grok 4.6xhigh34.0%–Epoch AI
21Gemini 3.1 Prohigh34.0%–Epoch AI
22DeepSeek V4 Flash 0731max34.0%–Epoch AI
23GLM 5.3max33.0%–Epoch AI
24Qwen 3.7 Maxmax32.0%–Epoch AI
25Gemini 3.5 Flashhigh32.0%–Epoch AI
26Haiku 5.5max30.0%–Epoch AI
27Gemini 3.6 Flashhigh30.0%–Epoch AI
28Grok 4.7xhigh29.0%–Epoch AI
29o3high29.0%–Epoch AI
30Kimi K3max26.0%–Epoch AI
31Gemini 3 Flashlow26.0%–Epoch AI
32Muse Spark 1.3max25.0%–Epoch AI
33GPT-5.2high23.0%–Epoch AI
34GPT-5high23.0%–Epoch AI
35Qwen 3.6 35B-A3Bnone22.0%–Epoch AI
36Opus 4.5high22.0%–Epoch AI
37GPT-5.6 Lunamax21.0%–Epoch AI
38Opus 4.1high21.0%–Epoch AI
39Qwen 3.5 Flashmax20.0%–Epoch AI
40Nemotron 3 Ultra 550B A55Bmax20.0%–Epoch AI
41Qwen 3.6 Maxnone19.0%–Epoch AI
42GPT-5.1low19.0%–Epoch AI
43GLM 5.2low19.0%–Epoch AI
44Gemini 3.5 Flash-Litelow19.0%–Epoch AI
45Kimi K2.6max18.0%–Epoch AI
46Qwen 3.6 Flashnone18.0%–Epoch AI
47Qwen 3.5 397B-A17Bnone18.0%–Epoch AI
48Mistral Large 4high17.0%–Epoch AI
49Qwen 3.7 Plushigh17.0%–Epoch AI
50Qwen 3.5 122B-A10Bnone17.0%–Epoch AI
51Qwen 3.5 Plusnone17.0%–Epoch AI
52DeepSeek V4 Pronone17.0%–Epoch AI
53Sonnet 4.5high17.0%–Epoch AI
54Sonnet 4.6low16.0%–Epoch AI
55Sonnet 5max16.0%–Epoch AI
56Qwen 3.7 Flashmax15.0%–Epoch AI
57Opus 4.6max15.0%–Epoch AI
58Opus 4.7max13.0%–Epoch AI
59GPT-4high12.0%–Epoch AI
60Qwen 3.6 Plusnone12.0%–Epoch AI
61GPT-4o minihigh12.0%–Epoch AI
62GPT-5.4 Mininone11.0%–Epoch AI
63GPT-5 Miniminimal10.0%–Epoch AI
64GPT-5.4 Nanonone9.0%–Epoch AI
65GPT-5 Nanomedium9.0%–Epoch AI
66Qwen 3 235B-A22Bxhigh9.0%–Epoch AI
67GLM 5.3 Flashmax8.0%–Epoch AI
68MiniMax M3none8.0%–Epoch AI
69GPT-6 Lunamax7.0%–Epoch AI
70o3 minihigh7.0%–Epoch AI
71Qwen 3.6 27Bnone7.0%–Epoch AI
72GPT-4.1 Minihigh7.0%–Epoch AI
73Inkling Smallxhigh6.0%–Epoch AI
74o4 minihigh5.0%–Epoch AI
75Qwen 3 Maxmax5.0%–Epoch AI
76GPT-3.5high3.0%–Epoch AI
77gpt-oss-120bmedium2.0%–Epoch AI