Benchmarks / Agentic

Remote Labor Index

Uses the dashboard.safe.ai RLI automation-rate API. Score: automation rate. Collected by Jake Boggs' benchmark dashboard.

16models
–Open Index weight
–last updated
boggspublisher

Remote Labor Index

Higher is better · best effort per model

Chart settings
16 of 16 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5.5max21.3%––
2GPT-6 Astramax20.8%––
3Fable 5.1max17.9%––
4Fable 5max15.8%––
5Opus 4.8max8.3%––
6GPT-5.5xhigh6.3%––
7Gemini 3.8 Flashmax5.8%––
8Gemini 3.7 Flashmax5.0%––
9Opus 4.6max4.2%––
10Opus 4.5high3.8%––
11GPT-5.2xhigh2.5%––
12Sonnet 4.5high2.1%––
13Grok 4high2.1%––
14GPT-5high1.7%––
15Gemini 3 Prohigh1.3%––
16Gemini 2.5 Prohigh0.8%––