Benchmarks / Coding

sudo L7

Uses Surge AI's published percentage score across 60 expert-authored engineering tasks. Score: score. Collected by Jake Boggs' benchmark dashboard.

12models
–Open Index weight
–last updated
boggspublisher

sudo L7

Higher is better · best effort per model

Chart settings
12 of 12 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5.5max45.0%––
2Sonnet 5.5max45.0%––
3GPT-6 Astramax32.2%––
4GPT-6.1 Solmax31.7%––
5Fable 5.1max27.2%––
6Qwen 3.8 Maxxhigh15.6%––
7GLM 5.3max15.0%––
8Kimi K3max13.9%––
9Mistral Large 4high13.3%––
10Muse Spark 1.3max12.2%––
11Gemini 3.8 Flashhigh10.6%––
12Grok 4.7xhigh10.6%––