Benchmarks / Agentic

MCPMark Verified

AI agents complete realistic multi-step tasks through Model Context Protocol servers for Notion, GitHub, a filesystem, Postgres and a Playwright browser, each checked by the task's own verification script; Verified is the maintainers' version-pinned, stabilized 127-task set. Maintained by EVAL SYS. Score: Pass@1 in percent: the share of the 127 Verified tasks a single run of the model passes, each task decided by its automated verify.py.

8models
–Open Index weight
–last updated

MCPMark Verified

Higher is better · best effort per model

Chart settings
8 of 8 selected

full table below

#ModelEffortScoreCost / taskHarness
1Kimi K3max96.1%––
2GPT-5.5xhigh92.9%––
3GPT-5.6 Solmax92.9%––
4Fable 5max86.6%––
5Kimi K2.7 Codemax81.9%––
6Opus 4.8max76.4%––
7Kimi K2.6max72.8%––
8DeepSeek V4 Promax71.7%––