Benchmarks / 3D

EQ-Bench Creative Writing v3

A LLM-judged creative writing benchmark with vocabulary and GPT-slop controls. Maintained by EQ-bench. Score: Elo Score column in the leaderboard.

109models
–Open Index weight
–last updated

EQ-Bench Creative Writing v3

Higher is better · best effort per model

Chart settings
109 of 109 selected

full table below

#ModelEffortScoreCost / taskHarness
1GPT-6 Astramax2173––
2Fable 5.1max2162––
3Opus 5max2133––
4GPT-6 Solmax2125––
5Kimi K3max2082––
6GLM 5.3max2075––
7Opus 5.5max2050––
8Grok 4.7max2007––
9GPT-5.6 Solmax1972––
10Fable 5max1943––
11Muse Spark 1.1max1927––
12Opus 4.7max1914––
13Muse Spark 1.3max1906––
14GPT-5.6 Terramax1855––
15GPT-5.5xhigh1844––
16Qwen 3.8xhigh1843––
17Muse Spark 1.2max1840––
18Opus 4.8max1840––
19GPT-5.4xhigh1840––
20GPT-5.6 Lunamax1829––
21Sonnet 4.6max1810––
22Opus 4.6max1809––
23Sonnet 5max1794––
24GLM 5.2max1757––
25Gemini 3.8 Flashmax1748––
26Kimi K2.6max1725––
27Gemini 3.7 Flashmax1723––
28GPT-5.2xhigh1703––
29Nemotron 3 Ultramax1692––
30GPT-5.3xhigh1690––
31Opus 4.5high1687––
32Sonnet 4.5high1678––
33o3high1676––
34Qwen 3.8 27Bmax1671––
35Kimi K2medium1666––
36GPT-5.4 Minixhigh1665––
37GPT-5.2025high1627––
38Inklingmax1608––
39Gemini 3.6 Flashxhigh1604––
40GLM 5high1601––
41GLM 5.1max1592––
42Opus 4medium1580––
43Grok 4.5max1579––
44Kimi K2.5max1579––
45Grok 4.20xhigh1574––
46DeepSeek V4 Flashmax1559––
47Gemini 3.5 Flash-Litexhigh1559––
48DeepSeek V4 Promax1553––
49DeepSeek V4.1 Flashmax1540––
50Gemini 3 Prohigh1525––
51DeepSeek V3.2high1515––
52DeepSeek R1xhigh1500––
53MiMo V2.5 Proxhigh1493––
54Inkling Smallxhigh1491––
55Gemini 3.1 Prohigh1491––
56Sonnet 4high1483––
57Qwen 3.5 397B-A17Bmax1478––
58Mistral Medium 3.1none1476––
59DeepSeek V3.0324–1472––
60Sonnet 3.5medium1451––
61DeepSeek V4 Flash 0731max1438––
62DeepSeek V3.1none1436––
63Gemini 2.5 Prohigh1421––
64DeepSeek R1.0528–1421––
65GPT-4.1high1420––
66GLM 4.7none1413––
67Mistral Large 3none1412––
68Sonnet 3.7medium1412––
69GLM 4.6none1411––
70Mistral Smallnone1369––
71Gemma 4 31B IThigh1366––
72Qwen 3 235B-A22Bxhigh1366––
73MiniMax M2.5high1361––
74GLM 4.5xhigh1341––
75Grok 4.1 Fasthigh1327––
76GPT-5 Minihigh1313––
77Gemma 4 26Bxhigh1305––
78Gemma 4 12B IT–1289––
79Nemotron 3.5 Lightning–1280––
80Gemma 3 27B ITmedium1266––
81GPT-4.5none1258––
82Mistral Small 3.2none1255––
83Grok 3none1186––
84GPT-4.1 Minihigh1147––
85Gemini 2.5 Flashmedium1137––
86Gemini 2.0 Flashmedium1128––
87Gemma 3 12B IT–1126––
88GLM 4.7 Flashnone1125––
89GLM 4–1068––
90Gemma 3 4B IT–1068––
91Mistral Large 2411–985––
92gpt-oss-120bhigh961––
93GPT-4.1 Nanohigh946––
94Mistralnone881––
95GPT-4o minihigh873––
96Llama 3.1 405bnone870––
97Llama 4 Maverickmedium860––
98Gemma 2 9B IT–841––
99Llama 3.1 70bnone784––
100Llama 4 Scoutmedium783––
101Mistral Small 3.1none761––
102GPT-4.0314–752––
103Haiku 3medium717––
104Llama 3.1 8bmedium713––
105GPT-5 Nanohigh705––
106gpt-oss-20bhigh666––
107Llama 3.2 3bnone595––
108GPT-3.5high451––
109Llama 3.2 1bnone200––