Benchmarks / Agentic

AA-AnalystAgent

AA-AnalystAgent: multi-step financial/data analysis agent tasks; pass rate.

48models
–Open Index weight
–last updated

AA-AnalystAgent

Higher is better · best effort per model

Chart settings
48 of 48 selected

full table below

#ModelEffortScoreCost / taskHarness
1Gemini 3.7 Flashhigh60.0%––
2Sonnet 5.5max57.5%––
3Fable 5.1max57.5%––
4Opus 5.5max56.3%––
5Grok 4.7high55.0%––
6Opus 5max53.8%––
7Haiku 5.5max53.8%––
8GPT-6 Astramax51.2%––
9GPT-6.1 Solmax50.0%––
10GPT-5.5xhigh50.0%––
11Gemini 4high48.8%––
12Fable 5max48.8%––
13GPT-5.6 Solmax47.5%––
14Gemini 3.8 Flashhigh46.3%––
15Sonnet 5max46.3%––
16Qwen 3.8 Maxmax45.0%––
17Opus 4.8max45.0%––
18Gemini 3.5 Flashhigh45.0%––
19Opus 4.7max43.8%––
20GPT-6 Lunamax43.8%––
21Grok 4.6high41.3%––
22Gemini 3.1 Pro–41.3%––
23GLM 5.3max38.8%––
24Kimi K3max38.8%––
25Muse Spark 1.3max37.5%––
26MiMo V2.6 Pro–37.5%––
27Step 5 Preview–35.0%––
28DeepSeek V4.1 Flashmax35.0%––
29Grok 4.5high35.0%––
30Inkling Small–27.5%––
31GLM 5.3 Flashmax25.0%––
32DeepSeek V4 Flash 0420max25.0%––
33Inklingxhigh23.8%––
34Sonnet 4.6max20.0%––
35MiMo V2.5 Pro–20.0%––
36Muse Glimmer (High)high20.0%––
37DeepSeek V4 Pro 0424max18.8%––
38Qwen 3.7 Maxmax18.8%––
39Ling 3.0 Flash Fin–16.3%––
40GPT-5.4 Minixhigh15.0%––
41Haiku 4.5–15.0%––
42Mistral Medium 3.5high12.5%––
43MiniMax M2.7–11.3%––
44MiniMax M3–10.0%––
45Grok 4.3high8.8%––
46Gemini 3.1 Flash-Litehigh8.8%––
47Nemotron 3 Ultramax6.3%––
48Mistral Small 4–1.3%––