Benchmarks / 3D

Judgemark v4

Meta-evaluation that rates LLM judges on how discriminatively they score fixed creative-writing samples. Maintained by EQ-Bench. Score: Composite judge-separation score on the reported 100-point scale (unclamped bounds not verified).

40models
–Open Index weight
–last updated

Judgemark v4

Higher is better · best effort per model

Chart settings
40 of 40 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 4.6max91––
2GPT-5.5xhigh88––
3Opus 4.7max84––
4Gemini 3.7 Flashmax83––
5Sonnet 4.6max82––
6Muse Spark 1.2max79––
7Opus 5max79––
8Gemini 3.1 Prohigh79––
9Opus 4.8max78––
10Grok 4.5max77––
11GLM 5.2max73––
12GLM 5.3max73––
13Gemma 4 31B IThigh72––
14GPT-5.4xhigh72––
15Sonnet 5max71––
16Gemini 3.5 Flashxhigh69––
17Qwen 3.8 27Bmax67––
18GLM 5.1max67––
19Qwen 3.5 27Bhigh61––
20Gemini 3.1 Flash-Litehigh59––
21MiMo V2.5 Proxhigh58––
22Kimi K2.6max57––
23Qwen 3.5 397B-A17Bmax54––
24Qwen 3.6 27Bmax53––
25Gemma 4 26Bxhigh53––
26Nemotron 3 Ultramax53––
27Grok 4.3xhigh50––
28DeepSeek V4 Promax47––
29Gemini 3 Flashhigh46––
30Qwen 3.6 Maxmax45––
31Qwen 3.5 35B-A3Blow41––
32DeepSeek V4 Flashmax37––
33Qwen 3.6 35B-A3Bmax33––
34Qwen 3.5 9Blow32––
35Qwen 3.6 Flashmax31––
36DeepSeek V4 Flash 0731max31––
37GPT-5.4 Nanoxhigh28––
38GPT-5.4 Minixhigh27––
39Mistral Small 4high16––
40gpt-oss-120bhigh15––