Benchmarks / Speed

Provider throughput

Median provider output throughput in tokens per second across OpenRouter endpoints (3d).

178models
–Open Index weight
–last updated
OpenRouterpublisher

Provider throughput

Higher is better · best effort per model

Chart settings
178 of 178 selected

full table below

#ModelEffortScoreCost / taskHarness
1Muse Spark 1.1max198––
2Llama 3.2 3bnone173––
3Gemini 2.5 Flash Litenone160––
4Haiku 5.5max142––
5Gemini 3.5 Flashxhigh131––
6Gemini 3.5 Flash-Litexhigh128––
7Gemini 3.6 Flashxhigh127––
8o3 minihigh125––
9Inkling Smallxhigh121––
10Gemini 3.1 Flash-Litehigh121––
11gpt-oss-120bhigh120––
12Codestral 2508–117––
13Mistral Small 4high115––
14o4 minihigh111––
15Qwen 2.5 7B–110––
16Muse Spark 1.2max109––
17Mistral Medium 3.1none108––
18Qwen 3.6 Flashmax107––
19Llama 3.2 1bnone107––
20Mistral Medium 3.5high105––
21Llama 3.1 8bmedium104––
22Gemini 3.1 Flash–103––
23GPT-5.6 Luna Pro–102––
24Mistral Medium 3none102––
25GPT-5.6 Sol Promax102––
26GPT-5.4 Minixhigh102––
27gpt-oss-20bhigh101––
28Sonnet 5.5max99––
29DeepSeek V4.1 Flashmax95––
30Gemini 3 Flashhigh95––
31GPT-5.4 Nanoxhigh92––
32Qwen 3 30B-A3Bnone92––
33GPT-5 Minihigh91––
34Gemini 3.8 Flashmax90––
35DeepSeek V4 Flashmax90––
36Gemma 3 4Bnone89––
37Gemini 3.1 Prohigh89––
38Grok Build 0.1–87––
39GPT-4.1 Nanohigh87––
40Gemini 2.5 Prohigh85––
41Gemini 2.5 Flashmedium85––
42Qwen 3.5 Flashmax84––
43GPT-5.6 Terra Pro–83––
44Gemini 3.7 Flashmax82––
45GPT-5 Nanohigh82––
46GPT-5.6 Lunamax82––
47GPT-4.1high81––
48Inklingmax80––
49o1high80––
50Grok 4.3xhigh80––
51Muse Spark 1.3max78––
52Grok 4.20xhigh78––
53Devstral 2none78––
54GPT-3.5high78––
55Haiku 4.5xhigh77––
56GLM 5.2max77––
57GPT-6 Luna Promax77––
58Opus 5.5max77––
59GLM 5.3max76––
60DeepSeek V3.1none76––
61Opus 4.8max75––
62Muse Wondermax75––
63Sonnet 5max75––
64Gemini 3 Prohigh73––
65GPT-5.6 Terramax72––
66GLM 5.3 Flashmax71––
67GPT-4ohigh71––
68MiniMax M3max69––
69Qwen 3.5 122B-A10Bnone69––
70Qwen 3.7 Maxmax68––
71GPT-4.1 Minihigh68––
72GPT-5.6 Solmax68––
73Opus 5max67––
74Grok 4.7max66––
75GPT-4o minihigh66––
76Qwen 3.8xhigh65––
77Qwen 3.5 35B-A3Blow64––
78Mistral Large 4high63––
79Mistral Largenone63––
80GPT-6 Sol Promax62––
81DeepSeek V4 Flash 0731max62––
82Fable 5.1max61––
83GPT-5.1high61––
84GPT-5.5xhigh58––
85Mistral Large 3none58––
86GPT-6 Solmax57––
87Qwen 3.7 Flashmax57––
88Qwen 3.6 35B-A3Bmax57––
89GLM 5high56––
90GPT-5.4xhigh55––
91GPT-6 Lunamax55––
92Qwen 3 Codermedium55––
93GPT-5high55––
94GPT-4high55––
95Opus 4.7max55––
96GPT-5.1 Codex Minihigh54––
97o3high54––
98Qwen 3.5 Plusnone54––
99GPT-5.3 Codexxhigh53––
100GPT-5.2xhigh53––
101Mistral Large 2407–53––
102Qwen 3.5 9Blow52––
103Grok 4.5max52––
104Sonnet 4.6max52––
105Qwen 3 14Bnone52––
106GLM 4.5 Vnone51––
107GPT-5.1 Codexmax50––
108Grok 4.6max50––
109Kimi K3max50––
110Qwen 3.7 Plushigh50––
111Qwen 3.8 Flashmax49––
112GLM 4.5 Air–49––
113Mistral Small 3none49––
114Fable 5max49––
115DeepSeek V4 Flash 0423–49––
116MiniMax M2.5high49––
117Qwen 3.5 397B-A17Bmax49––
118Opus 4.5high49––
119Qwen 3.8 27Bmax48––
120Hy3xhigh48––
121Gemma 4 26Bxhigh48––
122Llama 3.1 70bnone48––
123GLM 4.7 Flashnone47––
124Llama 3.3 70bnone47––
125DeepSeek V4 Pro 0423–46––
126MiniMax M2.1–46––
127MiniMax M2.7high45––
128GPT-6.1 Sol Pro–44––
129DeepSeek V4 Pro 0813max44––
130Qwen 3.6 27Bmax44––
131GLM 5.1max44––
132MiniMax M2–44––
133Gemini 4max44––
134GPT-6 Astra Promax43––
135Qwen 3.6 Plusmax43––
136GPT-5.2 Codexxhigh43––
137Qwen 3high43––
138Kimi K2.5max42––
139Hy4–41––
140Kimi K2.7 Codemax41––
141Mistralnone41––
142MiniMax M1–41––
143GPT-6 Astramax40––
144Mistral Small 3.2none40––
145Opus 4.6max39––
146Sonnet 4.5high38––
147Kimi K2medium37––
148GLM 5 Vhigh37––
149Qwen 3.8 2.4T-A95B–36––
150Qwen 3 235B-A22Bxhigh36––
151Mistral Small 3.1none36––
152Qwen 2.5–36––
153Qwen 3.8 Maxmax35––
154Qwen 3.5 27Bhigh35––
155Kimi K2.6max34––
156GLM 4.6 Vlow34––
157Llama 4 Maverickmedium33––
158GPT-6.1 Solmax33––
159MiMo V2.6 Prohigh33––
160Gemma 3 27Bnone31––
161Qwen 2.5 Codernone31––
162Qwen 3 32Bnone31––
163Qwen 2.5 72Bnone29––
164DeepSeek V3.2high28––
165MiMo V2.5 Proxhigh26––
166Gemma 3 12Bnone26––
167MiMo V2.6 Flashhigh25––
168Gemma 4 31Bmax25––
169GLM 4.6none25––
170GLM 4.5xhigh25––
171MiMo V2.5xhigh22––
172Llama 4 Scoutmedium21––
173DeepSeek V3none20––
174GPT-5.5 Proxhigh16––
175Gemma 2 27B–14––
176GLM 4.7none13––
177Opus 4.1high11––
178o3 prohigh8––