Benchmarks / 3D

EQ-Bench Longform Creative Writing

LLM-judged benchmark in which models plan and write a short story/novella over 8x 1000-word turns, scored 0-100 across 14 rubric dimensions. Maintained by EQ-Bench. Score: Score (0-100): average of all chapter scores plus the final scored piece across 14 rubric dimensions, with the forced poetry/metaphor criterion weighted 5x and a long-context degradation penalty applied.

104models
–Open Index weight
–last updated

EQ-Bench Longform Creative Writing

Higher is better · best effort per model

Chart settings
104 of 104 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5max86.3%––
2Fable 5.1max85.3%––
3Opus 5.5max84.6%––
4Fable 5max83.0%––
5Grok 4.7max83.0%––
6GPT-6 Astramax82.8%––
7Muse Spark 1.3max82.8%––
8GPT-6 Solmax82.8%––
9Opus 4.7max81.8%––
10GLM 5.3max81.8%––
11GPT-5.6 Solmax81.7%––
12Muse Spark 1.2max81.5%––
13Opus 4.8max80.8%––
14Sonnet 4.6max79.9%––
15Kimi K3max79.6%––
16Kimi K2.6max78.5%––
17GPT-5.4xhigh78.3%––
18Sonnet 5max78.3%––
19GPT-5.5xhigh78.2%––
20GPT-5.6 Terramax78.0%––
21GLM 5.2max77.9%––
22Opus 4.6max77.7%––
23Gemini 3.8 Flashmax76.8%––
24DeepSeek V4 Promax75.6%––
25GPT-5.6 Lunamax75.5%––
26Kimi K2.5max74.9%––
27DeepSeek V4.1 Flashmax74.0%––
28MiMo V2.5 Proxhigh73.7%––
29GLM 5.1max73.5%––
30Opus 4.5high73.1%––
31GPT-5.2025high73.1%––
32GPT-5.4 Minixhigh73.0%––
33Inklingmax72.5%––
34Gemini 3.5 Flashxhigh71.8%––
35GPT-5.2xhigh71.6%––
36Sonnet 4.5high71.4%––
37GLM 5high70.9%––
38MiMo V2 Pro–70.9%––
39Muse Spark 1.1max70.6%––
40Opus 4.1high70.5%––
41Kimi K2medium69.0%––
42Gemini 3 Prohigh68.8%––
43Grok 4.20xhigh68.5%––
44Qwen 3.5 397B-A17Bmax68.3%––
45Gemini 3.1 Prohigh68.2%––
46DeepSeek V3.2high66.8%––
47GPT-5high66.8%––
48Qwen 3 Maxmax66.2%––
49GLM 4.7none66.0%––
50DeepSeek V4 Flashmax66.0%––
51MiniMax M2.5high65.3%––
52Haiku 4.5xhigh65.0%––
53o3high62.7%––
54GPT-5.3xhigh62.6%––
55DeepSeek V3.1none62.3%––
56DeepSeek V4 Flash 0731max61.2%––
57DeepSeek V3.0324–60.1%––
58DeepSeek R1xhigh59.5%––
59DeepSeek R1.0528–59.1%––
60Qwen 3.5 27Bhigh59.0%––
61Gemini 2.5 Prohigh58.8%––
62Sonnet 4high58.4%––
63Sonnet 3.5medium58.4%––
64MiniMax M2.1–57.8%––
65GPT-5.4 Nanoxhigh57.8%––
66Sonnet 3.7medium57.7%––
67Qwen 3 235B-A22Bxhigh57.4%––
68GLM 4.6none57.3%––
69Gemma 4 31B IThigh56.5%––
70GPT-5 Minihigh56.2%––
71Gemini 3 Flashhigh55.7%––
72GLM 4.5xhigh55.5%––
73Qwen 3.5 122B-A10Bnone54.3%––
74Qwen 3.8 27Bmax53.3%––
75MiMo V2 Flashhigh53.1%––
76Gemma 4 26Bxhigh50.7%––
77Gemini 3.1 Flash-Litehigh49.0%––
78Gemma 4 12B IT–48.7%––
79Gemini 2.5 Flashmedium48.6%––
80Mistral Large 3none48.3%––
81GLM 4.7 Flashnone47.8%––
82MiniMax M2–46.4%––
83Mistral Medium 3.1none46.2%––
84Grok 4high45.7%––
85Gemma 3 27B ITmedium45.2%––
86Qwen 3.5 35B-A3Blow44.5%––
87Mistral Small 4high43.2%––
88Gemma 3 12B IT–41.8%––
89Mistral Small 3.2none41.6%––
90Qwen 3 32Bnone40.5%––
91Grok 4.1 Fasthigh40.1%––
92Qwen 3 14Bnone35.9%––
93gpt-oss-120bhigh35.8%––
94Qwen 3 30B-A3Bnone35.6%––
95Gemma 3 4B IT–34.4%––
96Mistral Smallnone32.6%––
97GPT-4.1 Nanohigh32.4%––
98Llama 4 Maverickmedium31.9%––
99Qwen 3high31.5%––
100Llama 4 Scoutmedium31.1%––
101Mistralnone28.7%––
102GPT-5 Nanohigh28.0%––
103gpt-oss-20bhigh21.2%––
104Qwen 3 4Bnone17.0%––