Vibe Code Bench v1.1 · Open Analysis

#	Model	Effort	Score	Cost / task	Harness
1	Sonnet 5.5	max	92.4%	$31.25	OpenHands
2	Gemini 4	high	91.9%	$8.11	OpenHands
3	Haiku 5.5	max	90.4%	$6.07	OpenHands
4	Fable 5	max	90.4%	$41.71	OpenHands
5	Opus 5.5	max	90.3%	$57.92	OpenHands
6	Fable 5.1	max	90.3%	$33.37	OpenHands
7	GPT-6 Astra	max	89.6%	$38.51	OpenHands
8	GPT-6.1 Sol	max	88.9%	$6.23	OpenHands
9	Opus 5	max	88.4%	$33.88	OpenHands
10	GPT-6 Sol	max	87.8%	$26.36	OpenHands
11	Grok 4.7	xhigh	86.2%	$15.83	OpenHands
12	Wonder Full	max	86.0%	$2.29	OpenHands
13	Muse Spark 1.3	max	85.9%	$2.54	OpenHands
14	MiMo V2.6 Pro	high	85.2%	$1.04	OpenHands
15	Kimi K3	max	85.0%	$10.01	OpenHands
16	DeepSeek V4.1 Flash	high	84.7%	$0.407	OpenHands
17	Ember-1	–	83.9%	$8.56	OpenHands
18	Wonder	max	83.1%	$1.80	OpenHands
19	Opus 4.8	max	82.7%	$26.88	OpenHands
20	DeepSeek V4 Pro 0813	max	82.3%	$0.356	OpenHands
21	GPT-6 Luna	max	81.6%	$1.35	OpenHands
22	Sonnet 5	max	81.3%	$25.39	OpenHands
23	GPT-5.6 Sol	max	80.5%	$33.40	OpenHands
24	Muse Spark 1.2	xhigh	79.1%	$1.53	OpenHands
25	MiMo V2.6 Flash	high	79.0%	$0.563	OpenHands
26	Gemini 3.8 Flash	high	78.7%	$6.87	OpenHands
27	Mistral Large 4	high	78.4%	$39.46	OpenHands
28	GLM 5.3	max	78.1%	$12.45	OpenHands
29	Hy4	–	77.5%	$2.18	OpenHands
30	GPT-5.6 Luna	max	77.1%	$0.726	OpenHands
31	Grok 4.6	high	76.2%	$4.88	OpenHands
32	DeepSeek V4 Flash 0731	high	74.7%	$0.906	OpenHands
33	GPT-5.6 Terra	max	74.6%	$7.89	OpenHands
34	Muse Spark 1.1	xhigh	72.2%	$0.923	OpenHands
35	Opus 4.7	max	71.0%	$21.41	OpenHands
36	Step 5 Preview	–	70.4%	$5.86	OpenHands
37	Gemini 3.7 Flash	high	70.4%	$4.83	OpenHands
38	GPT-5.5	xhigh	69.8%	$16.66	OpenHands
39	Grok 4.5	high	69.0%	$4.10	OpenHands
40	GPT-5.4	xhigh	67.4%	$10.69	OpenHands
41	Qwen 3.8 27B	xhigh	64.8%	$23.46	OpenHands
42	Qwen 3.8 Max	max	64.7%	$8.24	OpenHands
43	Gemini 3.6 Flash	high	64.0%	$3.04	OpenHands
44	GLM 5.2	max	64.0%	$8.49	OpenHands
45	GPT-5.3 Codex	xhigh	61.8%	$11.91	OpenHands
46	Opus 4.6	max	57.6%	$8.69	OpenHands
47	Sonnet 4.6	max	55.8%	$7.35	Claude Code
48	GPT-5.2	xhigh	53.5%	$17.75	OpenHands
49	DeepSeek V4	max	49.9%	$2.21	OpenHands
50	Composer 2.5	none	49.6%	$0.502	Cursor CLI
51	Gemini 3.5 Flash	high	48.7%	$2.54	OpenHands
52	GPT-5.4 Mini	xhigh	48.0%	$1.19	OpenHands
53	Qwen 3.7 Max	max	47.7%	$11.40	OpenHands
54	MiniMax M3	max	47.6%	$6.45	OpenHands
55	Kimi K2.7 Code	max	47.2%	$3.84	OpenHands
56	Qwen 3.7 Plus	high	46.4%	$1.08	OpenHands
57	MiMo V2.5	xhigh	42.2%	$0.068	OpenHands
58	GPT-5.2 Codex	high	37.9%	$4.15	OpenHands
59	Kimi K2.6	max	37.9%	$1.93	OpenHands
60	Gemini 3.5 Flash-Lite	high	37.2%	$0.833	OpenHands
61	MiMo V2.5 Pro	xhigh	34.1%	$0.167	OpenHands
62	Gemini 3.1 Pro	high	32.0%	$3.83	OpenHands
63	GLM 5.1	max	31.5%	$2.89	OpenHands
64	GLM 5.3 Flash	max	30.8%	$2.35	OpenHands
65	GPT-5.4 Nano	high	26.1%	$1.28	OpenHands
66	Qwen 3.6 Plus	max	25.6%	$5.45	OpenHands
67	GPT-5.1	high	24.6%	$2.57	OpenHands
68	GLM 5	high	23.4%	$40.27	OpenHands
69	Sonnet 4.5	high	22.6%	$6.66	OpenHands
70	GPT-5.1 Codex	high	22.2%	$7.32	OpenHands
71	Opus 4.5	high	20.6%	$32.87	OpenHands
72	Gemini 3 Flash	high	20.2%	$0.942	OpenHands
73	GPT-5	high	20.1%	$1.53	OpenHands
74	Muse Spark	–	19.7%	$0.580	OpenHands
75	Grok 4.3	high	19.4%	$1.28	OpenHands
76	Inkling	max	19.2%	$1.61	OpenHands
77	Inkling Small	xhigh	19.1%	$0.432	OpenHands
78	Kimi K2.5	max	17.5%	$0.879	OpenHands
79	Qwen 3.5 Plus	none	15.7%	$3.80	OpenHands
80	MiniMax M2.5	high	14.9%	$2.20	OpenHands
81	Gemini 3 Pro	high	14.3%	$6.42	OpenHands
82	GPT-5 Mini	high	14.2%	$0.249	OpenHands
83	Grok Build 0.1	–	13.3%	–	Grok Build
84	Qwen 3.6 27B	max	11.9%	$4.66	OpenHands
85	MiniMax M2.7	high	11.9%	$2.82	OpenHands
86	Haiku 4.5	xhigh	11.4%	$1.31	OpenHands
87	Laguna M.1	–	11.0%	$2.06	OpenHands
88	Nemotron 3 Ultra 550B A55B	max	7.6%	–	OpenHands
89	SWE 1.6	none	7.2%	–	Devin CLI
90	Laguna XS.2	–	5.2%	$0.981	OpenHands
91	DeepSeek V3.2	high	5.1%	$2.47	OpenHands
92	Grok 4.20	xhigh	4.1%	$0.772	OpenHands
93	Mercury 2.5	high	3.7%	$0.378	OpenHands
94	Qwen 3 Max	max	3.5%	$6.02	OpenHands
95	Ling 3.0 Flash Fin	–	3.4%	$0.233	OpenHands
96	GLM 4.6	none	3.1%	$10.85	OpenHands
97	Ling 3.0 Flash	–	2.9%	$0.292	OpenHands
98	Mistral Medium 3.5	high	2.9%	$16.74	OpenHands
99	Grok 4.1 Fast	high	1.2%	$0.209	OpenHands
100	Gemini 2.5 Pro	high	0.4%	$1.22	OpenHands
101	Gemini 3.1 Flash-Lite	high	0.0%	$0.510	OpenHands
102	Nemotron 3.5 Lightning	–	0.0%	$0.129	OpenHands
103	Grok 4 Fast	none	0.0%	$0.133	OpenHands
104	Mistral Small 4	high	0.0%	$6.47	OpenHands