Benchmarks / Speed

Output Speed (tokens/s)

Median output tokens per second measured by AA (median across providers, or first-party API).

211models
–Open Index weight
–last updated

Output Speed (tokens/s)

Higher is better · best effort per model

Chart settings
211 of 211 selected

full table below

#ModelEffortScoreCost / taskHarness
1Celeris-1none1380––
2Mercury 2.5–777––
3Mercury 2high542––
4Gemini 3.5 Flash-Litehigh446––
5Muse Spark 1.2xhigh375––
6Gemini 3.1 Flash-Litehigh368––
7Trinity Large Thinking–346––
8Gemini 2.5 Flash Lite–342––
9Muse Spark 1.3xhigh323––
10Nova Micronone311––
11Nemotron 3.5 Lightning–303––
12Gemini 3.7 Flashlow302––
13gpt-oss-20blow283––
14Ling 3.0 Flash–278––
15GPT-5.4 Minixhigh275––
16NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)none253––
17Qwen 3.5none241––
18Nemotron 3 Nano Omni 30B A3B Reasoning–237––
19Haiku 5.5max237––
20NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)–233––
21Nemotron 3.5 Super VL–233––
22gpt-oss-120blow232––
23Ling 3.0 Flash Fin–226––
24Gemini 3.6 Flashhigh224––
25Gemini 3.5 Flashmedium222––
26Gemini 3 Flash–220––
27Granite 4.2 3B–219––
28GPT-4.1 Nanonone218––
29Ling 3.1 Flash–215––
30Ministral 3 3Bnone214––
31Gemini 2.5 Flash–211––
32NVIDIA Nemotron Nano 9B V2 (Reasoning)–209––
33Qwen 3.7 Maxmax206––
34NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)none204––
35Inkling Small–200––
36Step 3.7 Flashhigh199––
37Inklingxhigh192––
38Nova 2.0 Lite (Medium)medium190––
39Muse Spark 1.1xhigh188––
40o3 minihigh187––
41GPT-5 Codexhigh186––
42Muse Wondermax184––
43Nova 2.0 Lite (High)high184––
44Nova 2.0 Lite (Low)low183––
45Mistral Small 4–181––
46DeepSeek V4.1 Flashmax180––
47Nova 2.0 Lite (Non-reasoning)none180––
48Command A–178––
49DeepSeek V4 Flashmax175––
50DeepSeek V4 Flash 0731max174––
51NVIDIA Nemotron Nano 9B V2 (Non-reasoning)none170––
52Nova Litenone169––
53GPT-5.1 Codex Minihigh167––
54Quasar 438B (Max, Based on GLM-5.2)max167––
55GPT-5.4 Nanomedium166––
56Qwen 3.5 35B-A3Bnone166––
57Mistral Medium 3.5high165––
58Qwen 3–163––
59GPT-4onone160––
60GPT-5.5 Instant–159––
61Solar Pro 3high159––
62GPT-4.1none158––
63Qwen 3 Codernone156––
64Nemotron 3 Ultramax156––
65o4 minihigh151––
66Gemini 3.8 Flashhigh147––
67GPT-4.1 Mininone146––
68Nemotron 3 Super 120B A12B (Reasoning)–146––
69GPT-5 Nanohigh146––
70Kimi K2–145––
71Qwen 3.6 35B-A3Bnone144––
72Step 3.5 Flash 2603–143––
73Sonnet 5.5max141––
74DeepSeek R1–141––
75Qwen 3.5 122B-A10Bnone141––
76GLM 5.2none140––
77Gemini 3.1 Pro–140––
78Llama 3.1 8bnone139––
79GPT-5 Minihigh138––
80GPT-5.6 Terramax137––
81Nova 2.0 Pro Preview (Low)low131––
82Granite 4.2 8B–130––
83o3–130––
84GPT-5.6 Lunamax130––
85Nova Pronone130––
86Nova 2.0 Pro Preview (Medium)medium129––
87Muse Glimmer (High)high128––
88Step 3.5 Flash–128––
89GPT-5.1 Codexhigh127––
90GPT-5.2 Codexxhigh125––
91GPT-6 Lunamax124––
92DeepSeek V3.1–121––
93Gemma 4 12Bnone120––
94Gemini 2.5 Pro–119––
95Agnes 2.5 Pro Beta–118––
96GPT-5.1high118––
97Ring-2.6-1Txhigh117––
98Qwen 3 30B-A3Bnone115––
99Nova 2.0 Pro Preview (Non-reasoning)none112––
100Grok 4.20–110––
101GPT-6 Solmax108––
102Ministral 3 8Bnone107––
103GPT-4o mininone107––
104DeepSeek V3none105––
105GPT-5high104––
106Muse Spark Open (Xhigh)xhigh103––
107Grok 4.3medium102––
108Grok 4.7xhigh102––
109GPT-5.5xhigh101––
110GPT-5.3 Codexxhigh101––
111Grok 3none100––
112GLM 4.7 Flashnone100––
113Gemini 4high100––
114North Mini Code–99––
115Qwen 3.5 9Bnone98––
116Gemma 4 26Bnone98––
117Haiku 4.5–97––
118Opus 5.5max97––
119MiniMax M3–95––
120GPT-5.6 Solmax95––
121GPT-5.4xhigh95––
122Qwen 2.5 Turbonone94––
123Llama 3.3 70bnone93––
124DeepSeek V4 Pro 0424none93––
125Step 5 Preview–91––
126Ministral 3 14Bnone89––
127DeepSeek V4 Pro 0813none89––
128Hy3–89––
129Grok 4–89––
130GLM 4.6 V–88––
131Reka Flash 3–86––
132Qwen 3.5 27Bnone85––
133Solar Pro 4–82––
134Llama 4 Scoutnone81––
135Sonnet 5max81––
136Solar Mini 4–81––
137GPT-5.2xhigh80––
138Mistral Large 3none79––
139Grok Build 0.1–77––
140Granite 4.2 30B–76––
141GLM 4.5 Air–76––
142Magistral Small 1.2–74––
143GLM 5.3max74––
144Mistral Large 4–71––
145Fable 5.1max71––
146Fable 5max71––
147GLM 5–70––
148LongCat 2.0–70––
149GLM 5.1–70––
150GLM 5.3 Flashmax68––
151MiniMax M2–68––
152MiniMax M1–67––
153Opus 4.5–67––
154MiniMax M2.5–67––
155Opus 4.8max66––
156Grok 3 Minihigh64––
157Sonnet 4.6max63––
158Grok 4.6high62––
159MiniMax M2.1–62––
160GPT-6.1 Solmax61––
161Grok 4.5high60––
162GLM 4.5 V–60––
163Opus 5max60––
164MiniMax M2.7–59––
165Opus 4.7max58––
166Llama 4 Mavericknone58––
167Qwen 3.5 397B-A17Bnone56––
168Qwen 3.6 Plus–56––
169Qwen 3.7 Plus–56––
170Kimi K2.5none56––
171Qwen 3.6 27B–56––
172Mistral Small 3none55––
173GPT-6 Astramax55––
174Qwen 3 32Bnone53––
175MiMo V2.6 Flash–53––
176Sonnet 4.5–51––
177Qwen 3.8 Flash–51––
178Kimi K2.7 Code–50––
179Gemma 4 31Bnone50––
180Qwen 3 14Bnone50––
181MiMo V2.6 Pro–48––
182Kimi K2.6–48––
183Opus 4.6max47––
184DeepSeek V4 Flash 0420max47––
185Gemma 4 E4B (Reasoning)–47––
186Phi-4 Mini Instructnone45––
187Qwen 3 235B-A22Bnone45––
188Mistral Medium 3none45––
189Granite 3.3 8B (Non-reasoning)none44––
190Kimi K3max44––
191Qwen 3.8 27Bnone43––
192Gemma 4 E4B (Non-reasoning)none42––
193Phi-4none42––
194Qwen 3.8 Maxmax39––
195Qwen 3.8 2.4T-A95B–39––
196GLM 4.7none38––
197Seed-OSS-36B-Instruct–38––
198MiMo V2.5 Pro–38––
199GLM 4.6–37––
200Llama 3.1 405b–35––
201MiMo V2.5–34––
202Mistral Small 3.2none33––
203Llama 3.1 70bnone33––
204GPT-4none32––
205Mistral Small 3.1none30––
206Qwen 2.5 72Bnone30––
207Mixtral 8x7B Instructnone24––
208Llama 3.2 11bnone23––
209Ling 3.0 Tiny–15––
210Qwen 3.5 4B–12––
211Ling-flash-2.0none5––