Benchmarks / Long Context

MLCR-AA

Medical Long Context Reasoning (MLCR-AA): reasoning over long medical records; overall score.

71models
–Open Index weight
–last updated

MLCR-AA

Higher is better · best effort per model

Chart settings
71 of 71 selected

full table below

#ModelEffortScoreCost / taskHarness
1Sonnet 5.5max75.0%––
2Fable 5.1max71.1%––
3Opus 5.5max66.7%––
4Fable 5max64.4%––
5Haiku 5.5max63.3%––
6Opus 5high59.4%––
7Sonnet 5max55.0%––
8GLM 5.3 Flashmax51.1%––
9GLM 5.3max48.3%––
10Opus 4.8max45.6%––
11Muse Spark 1.3max43.3%––
12Kimi K3max38.3%––
13GPT-6 Astramax35.0%––
14GPT-6.1 Solmax33.9%––
15GPT-5.6 Terramax31.7%––
16Muse Spark 1.2xhigh31.1%––
17Opus 4.7high28.9%––
18GPT-5.6 Solmax26.1%––
19Sonnet 4.6max24.4%––
20DeepSeek V4.1 Flashmax22.8%––
21Gemini 3.8 Flashhigh21.7%––
22Qwen 3.8 27Bxhigh21.7%––
23DeepSeek V4 Pro 0424max21.1%––
24Qwen 3.8 Maxmax20.0%––
25Muse Glimmer (High)high20.0%––
26GPT-5.6 Lunamax19.4%––
27MiMo V2.6 Pro–18.3%––
28Gemini 3.5 Flashhigh18.3%––
29GPT-5.5xhigh17.8%––
30DeepSeek V4 Pro 0813max17.8%––
31MiniMax M3–17.2%––
32Step 5 Preview–16.7%––
33GPT-6 Solmax16.1%––
34GPT-6 Lunamax16.1%––
35Kimi K2.7 Code–16.1%––
36Gemini 3.1 Pro–15.6%––
37Grok 4.7xhigh15.0%––
38Gemini 3.7 Flashhigh15.0%––
39Grok 4.5high15.0%––
40DeepSeek V4 Flash 0420max15.0%––
41Gemini 3.6 Flashhigh14.4%––
42DeepSeek V4 Flash 0731max13.3%––
43Grok 4.6high12.2%––
44Inklingxhigh12.2%––
45Gemini 3 Flashnone11.7%––
46Nemotron 3 Ultramax11.1%––
47Grok 4.3high10.0%––
48MiMo V2.5 Pro–9.4%––
49Qwen 3.7 Plus–9.4%––
50Gemini 2.5 Flash–8.9%––
51GLM 5.2max7.2%––
52Gemini 3.5 Flash-Litehigh7.2%––
53K2 Horizon 375B A23B–6.7%––
54Haiku 4.5–6.1%––
55Gemini 3.1 Flash-Litehigh6.1%––
56GPT-5.4 Nanoxhigh5.0%––
57GPT-5.4 Minixhigh3.9%––
58Nova 2.0 Pro Preview (Medium)medium3.9%––
59MiniMax M2.7–3.3%––
60Nemotron 3 Super 120B A12B (Reasoning)–3.3%––
61Llama 4 Mavericknone2.2%––
62Gemini 2.5 Flash Lite–2.2%––
63Mistral Medium 3.5high1.7%––
64Nemotron 3.5 Lightning–1.1%––
65gpt-oss-120bhigh1.1%––
66Command A–0.6%––
67gpt-oss-20bhigh0.6%––
68Solar Pro 3high0.6%––
69Qwen 3.8 2.4T-A95B–0.0%––
70Nova Litenone0.0%––
71GPT-4o mininone0.0%––