Benchmarks / Agentic
ITSMBench
Uses first-party pass@1 across 89 enterprise IT service-management tasks. Score: pass@1. Collected by Jake Boggs' benchmark dashboard.
ITSMBench
Higher is better · best effort per model
full table below
| # | Model | Effort | Score |
|---|---|---|---|
| 1 | Opus 5 | max | 46.1% |
| 2 | Grok 4.5 | high | 45.4% |
| 3 | GPT-5.6 Sol | xhigh | 39.1% |
| 4 | GPT-5.6 Terra | xhigh | 29.4% |
| 5 | GLM 5.2 | high | 19.8% |