Benchmarks / Agentic

DAYJOB: Healthcare

Uses Surge AI's rubric-graded healthcare assignment success rate. Score: score. Collected by Jake Boggs' benchmark dashboard.

30models
–Open Index weight
–last updated
boggspublisher

DAYJOB: Healthcare

Higher is better · best effort per model

Chart settings
30 of 30 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5.5max24.7%––
2GPT-6 Astramax11.6%––
3Fable 5.1max9.6%––
4Gemini 4high9.6%––
5Opus 5max8.4%––
6Grok 4.7xhigh8.4%––
7Muse Spark 1.3max7.8%––
8Fable 5max5.6%––
9GPT-6 Solmax3.6%––
10Grok 4.6xhigh2.8%––
11Muse Spark 1.2xhigh2.0%––
12Qwen 3.8 Maxxhigh2.0%––
13GPT-5.6 Solmax1.6%––
14GPT-5.6 Terraxhigh1.6%––
15Kimi K3max1.2%––
16Gemini 3.8 Flashhigh0.8%––
17DeepSeek V4 Promax0.4%––
18GLM 5.3max0.4%––
19GLM 5.3 Flashmax0.4%––
20GPT-5.6 Lunamax0.4%––
21Hy3high0.4%––
22Sonnet 5max0.0%––
23DeepSeek V4 Flashmax0.0%––
24Gemini 3.1 Prohigh0.0%––
25Gemini 3.7 Flashhigh0.0%––
26GPT-6 Lunamax0.0%––
27Inklingmax0.0%––
28Kimi K2.7 Codemax0.0%––
29Mistral Large 3none0.0%––
30Nemotron 3 Ultra 550B A55Bmax0.0%––