ZeroBench · Open Analysis

#	Model	Effort	Score	Cost / task	Harness
1	GPT-6 Astra	max	52.0%	–	–
2	Opus 5.5	max	43.0%	–	–
3	GPT-6 Sol	max	41.0%	–	–
4	GPT-5.6 Sol	max	30.0%	–	–
5	Opus 5	max	26.0%	–	–
6	Fable 5	max	24.0%	–	–
7	GPT-5.4	xhigh	23.0%	–	–
8	GPT-5.5	xhigh	23.0%	–	–
9	Gemini 3.5 Flash	xhigh	22.0%	–	–
10	GPT-5.6 Luna	max	21.0%	–	–
11	Gemini 3 Pro	high	20.0%	–	–
12	GPT-6 Luna	max	20.0%	–	–
13	Gemini 3.1 Pro	high	19.0%	–	–
14	GPT-5.6 Terra	max	19.0%	–	–
15	Opus 4.8	max	18.0%	–	–
16	Gemini 3.6 Flash	high	18.0%	–	–
17	GPT-5.2	medium	18.0%	–	–
18	Grok 4.6	xhigh	17.0%	–	–
19	Opus 4.7	max	15.0%	–	–
20	Gemini 3 Flash	high	15.0%	–	–
21	Grok 4.5	high	15.0%	–	–
22	Gemini 3.5 Flash-Lite	high	14.0%	–	–
23	Sonnet 5	max	13.0%	–	–
24	Grok 4.3	high	13.0%	–	–
25	Opus 4.6	max	12.0%	–	–
26	Sonnet 4.6	max	12.0%	–	–
27	GPT-5.4 Mini	xhigh	11.0%	–	–
28	o4 mini	high	11.0%	–	–
29	Grok 4.20	xhigh	10.0%	–	–
30	Opus 4.5	high	9.0%	–	–
31	GPT-5 Mini	high	9.0%	–	–
32	Opus 4.1	high	8.0%	–	–
33	GPT-5	medium	7.0%	–	–
34	Opus 4	medium	6.0%	–	–
35	Sonnet 3.7	medium	6.0%	–	–
36	Sonnet 4	high	6.0%	–	–
37	GPT-4.5	none	6.0%	–	–
38	GPT-5.1	medium	6.0%	–	–
39	Grok 4	high	6.0%	–	–
40	o3	high	6.0%	–	–
41	Sonnet 4.5	high	5.0%	–	–
42	Gemini 2 Flash	–	5.0%	–	–
43	Gemini 2.5 Pro	high	5.0%	–	–
44	Gemini 3.1 Flash-Lite	high	5.0%	–	–
45	Sonnet 3.5	medium	3.0%	–	–
46	Gemini 2.5 Flash	medium	3.0%	–	–
47	GPT-4.1	high	3.0%	–	–
48	GPT-5 Nano	high	3.0%	–	–
49	Llama 4 Scout	medium	3.0%	–	–
50	Gemini 1 Pro	–	2.0%	–	–
51	Gemini 1.5 Flash	none	2.0%	–	–
52	Gemini 1.5 Pro	none	2.0%	–	–
53	GPT-4o mini	high	2.0%	–	–
54	Llama 4 Maverick	medium	2.0%	–	–
55	Sonnet 3	none	1.0%	–	–
56	Qwen 2	–	1.0%	–	–
57	Haiku 3	medium	0.0%	–	–
58	Opus 3	none	0.0%	–	–
59	GPT-4o	high	0.0%	–	–
60	Llama 3.2 90b	none	0.0%	–	–
61	o1	high	0.0%	–	–