Benchmarks / Agentic

CADBench

Uses Seldon's first-party mean verifier score. Score: mean verifier score. Collected by Jake Boggs' benchmark dashboard.

12models
–Open Index weight
–last updated
boggspublisher

CADBench

Higher is better · best effort per model

Chart settings
12 of 12 selected

full table below

#ModelEffortScoreCost / taskHarness
1Fable 5max57.9%––
2Opus 5max57.0%––
3Gemini 3.8 Flashmax54.7%––
4GPT-5.6 Solmax51.2%––
5Gemini 3.7 Flashmax50.1%––
6GPT-5.6 Terramax25.8%––
7Muse Spark 1.3max20.7%––
8Kimi K3max17.2%––
9Qwen 3.8 Maxmax17.0%––
10Grok 4.6max16.7%––
11Muse Spark 1.2max13.4%––
12Inklingmax6.8%––