Benchmarks / Agentic

Hermes Bench

Uses mean reward across 150 Hermes Bench tasks in the Hermes Agent harness. Score: mean task reward. Collected by Jake Boggs' benchmark dashboard.

14models
–Open Index weight
–last updated
boggspublisher

Hermes Bench

Higher is better · best effort per model

Chart settings
14 of 14 selected

full table below

#ModelEffortScoreCost / taskHarness
1Opus 5.5max76.7%––
2Grok 4.7max74.4%––
3GPT-6 Astramax73.7%––
4GPT-6 Solmax73.5%––
5Sonnet 5.5max73.5%––
6GLM 5.3max71.8%––
7Kimi K3max71.5%––
8DeepSeek V4.1 Flashmax70.7%––
9Qwen 3.8 Maxmax70.5%––
10GPT-6 Lunamax70.5%––
11GLM 5.3 Flashmax68.9%––
12Gemini 3.8 Flashmax62.2%––
13Hy4–58.6%––
14Ling 3.0 Flash–53.8%––