Live Evidence

Why one model is not enough

Real data from every council run we process — updated every 15 minutes. No simulations, no cherry-picked examples.

→

Speed leaderboard

Latest benchmark run per model, sorted by median latency (fastest first). Scores are updated nightly.

Top 10 fastest models

RankModelProviderP50 msP95 msErrorsLast run
1pplOVH AI Endpoints (GRA)4533632026-06-16
2Llama-3.1-8B-InstructOVH AI Endpoints (GRA)9010102026-05-27
3Meta-Llama-3_3-70B-InstructOVH AI Endpoints (GRA)10515502026-05-27
4Mistral-Nemo-Instruct-2407OVH AI Endpoints (GRA)10713302026-05-27
5Qwen2.5-VL-72B-InstructOVH AI Endpoints (GRA)10813602026-05-27
6Mistral-Small-3.2-24B-Instruct-2506OVH AI Endpoints (GRA)11212902026-05-27
7Mistral-Small-3.2-24B-Instruct-2506OVH AI Endpoints (GRA)11247402026-06-23
8Mistral-7B-Instruct-v0.3OVH AI Endpoints (GRA)11412802026-06-23
9Mistral-Nemo-Instruct-2407OVH AI Endpoints (GRA)11512202026-06-23
10Mistral-7B-Instruct-v0.3OVH AI Endpoints (GRA)11949302026-05-27
▸Show all results (195)
RankModelProviderP50 msP95 msErrorsLast run
11Qwen3-Coder-30B-A3B-InstructOVH AI Endpoints (GRA)12215802026-05-27
12Llama-3.1-8B-InstructOVH AI Endpoints (GRA)12913002026-06-23
13Claude Opus 4Anthropic17217232026-06-15
14NVIDIA Nemotron Super 49B v1.5OpenRouter17819602026-06-23
15Meta-Llama-3_3-70B-InstructOVH AI Endpoints (GRA)17933802026-06-23
16Claude Sonnet 4Anthropic18021132026-06-15
17Llama 4 MaverickOpenRouter19575102026-06-23
18Nous Hermes 3 70BOpenRouter19525002026-06-23
19Llama 3.3 70B InstructOpenRouter19742802026-06-23
20Mistral Voxtral Small 24BOpenRouter21525102026-06-23
21Qwen3.5-397B-A17BOVH AI Endpoints (GRA)22790302026-06-23
22Qwen2.5-VL-72B-InstructOVH AI Endpoints (GRA)313119202026-06-23
23Qwen3-32BOVH AI Endpoints (GRA)41243902026-05-27
24gpt-5.4-nanoOpenAI43165602026-06-23
25Qwen3-32BOVH AI Endpoints (GRA)44550502026-06-23
26Qwen3.5-9BOVH AI Endpoints (GRA)46050202026-06-23
27Qwen3-Coder-30B-A3B-InstructOVH AI Endpoints (GRA)46047302026-06-23
28Qwen3.5-9BOVH AI Endpoints (GRA)49049502026-05-27
29Gemini 2.5 FlashGoogle Gemini53490602026-06-23
30Gemini 2.5 Flash-LiteGoogle Gemini537496202026-06-23
31gpt-4o-miniOpenAI57672602026-06-23
32gpt-5-chat-latestOpenAI58663202026-06-23
33gpt-4.1-miniOpenAI59161902026-06-23
34gpt-5.2OpenAI591231002026-06-23
35o3-miniOpenAI60772402026-06-23
36gpt-4.1-nanoOpenAI62969802026-06-23
37gpt-4oOpenAI63164602026-06-23
38gpt-oss-20bOVH AI Endpoints (GRA)66668902026-06-23
39gpt-5.4-miniOpenAI68673202026-06-23
40o3OpenAI69878502026-06-23
41gpt-5.4OpenAI71094602026-06-23
42Llama 4 ScoutOpenRouter72983102026-06-23
43o4-miniOpenAI746104402026-06-23
44gpt-5-miniOpenAI773107002026-06-23
45gpt-oss-120bOVH AI Endpoints (GRA)790310802026-06-23
46gpt-5.1OpenAI79685002026-06-23
47Cohere Command-AOpenRouter842100302026-06-23
48DeepSeek v4 ProOpenRouter886216502026-06-23
49Google Lyria 3 Pro PreviewOpenRouter920100732026-06-16
50Claude Opus 4.7Anthropic922145002026-06-23
51Qwen 2.5 VL 72B InstructOpenRouter923183802026-06-23
52Qwen 3.6 PlusOpenRouter928104102026-06-23
53Qwen 3.7 MaxOpenRouter94399102026-06-23
54gpt-5-nanoOpenAI962110302026-06-23
55gpt-5.3-chat-latestOpenAI97198232026-06-23
56gpt-5.2-chat-latestOpenAI981126902026-06-23
57gpt-4.1OpenAI1041104602026-06-23
58MiniMax M2.5OpenRouter1189243802026-06-23
59gpt-5OpenAI1240177502026-06-23
60Gemini 2.5 ProGoogle Gemini1251143202026-06-23
61Claude Opus 4.8Anthropic12943000012026-06-23
62gpt-5.1-chat-latestOpenAI1301241202026-06-23
63Claude Sonnet 4.5Anthropic1359276702026-06-23
64Claude Sonnet 4.6Anthropic1387502802026-06-23
65gpt-3.5-turbo-16kOpenAI1440—02026-06-21
66Claude Haiku 4.5Anthropic1570223002026-06-23
67gpt-5.5OpenAI1697306502026-06-23
68Claude Opus 4.5Anthropic1743785802026-06-23
69Claude Opus 4.6Anthropic1773194902026-06-23
70DeepSeek v3.2OpenRouter2110226802026-06-23
71gpt-3.5-turboOpenAI2203—02026-06-21
72gpt-3.5-turbo-0125OpenAI2209—02026-06-21
73Gemini 3.1 Flash LiteGoogle Gemini2301—02026-06-21
74gpt-3.5-turbo-1106OpenAI2399—02026-06-21
75Gemini Flash-Lite LatestGoogle Gemini2524—02026-06-21
76gpt-4o-2024-11-20OpenAI2617—02026-06-21
77gpt-4o-2024-05-13OpenAI2665—02026-06-21
78Nano BananaGoogle Gemini2873—02026-06-21
79gpt-4.1-nano-2025-04-14OpenAI3655—02026-06-21
80Gemini Flash LatestGoogle Gemini3827—02026-06-21
81Claude Opus 4.1Anthropic3873647602026-06-23
82Gemini 3.5 FlashGoogle Gemini3984—02026-06-21
83gpt-4o-search-previewOpenAI4031—02026-06-21
84Gemini Robotics-ER 1.6 PreviewGoogle Gemini4190—02026-06-21
85Gemini 3 Flash PreviewGoogle Gemini4311—02026-06-21
86Nano Banana 2Google Gemini4330—02026-06-21
87gpt-4.1-2025-04-14OpenAI4906—02026-06-21
88gpt-5-search-api-2025-10-14OpenAI5380—02026-06-21
89gpt-4OpenAI5540—02026-06-21
90gpt-4o-mini-search-previewOpenAI5662—02026-06-21
91gpt-4.1-mini-2025-04-14OpenAI5732—02026-06-21
92gpt-4o-search-preview-2025-03-11OpenAI5743—02026-06-21
93Gemini Pro LatestGoogle Gemini6398—02026-06-21
94gpt-5-search-apiOpenAI6462—02026-06-21
95gpt-4o-mini-search-preview-2025-03-11OpenAI6736—02026-06-21
96Gemini 3.1 Pro PreviewGoogle Gemini6790—02026-06-21
97gpt-4o-2024-08-06OpenAI6866—02026-06-21
98gpt-4o-mini-2024-07-18OpenAI7064—02026-06-21
99Gemini 3.1 Pro Preview Custom ToolsGoogle Gemini7298—02026-06-21
100gpt-4-0613OpenAI8426—02026-06-21
101Lyria 3 Clip PreviewGoogle Gemini9402—02026-06-14
102Nano Banana ProGoogle Gemini10741—02026-06-21
103Nano Banana ProGoogle Gemini11201—02026-06-21
104Gemma 4 31B ITGoogle Gemini11240—02026-06-14
105Gemma 4 26B A4B ITGoogle Gemini12943—02026-06-14
106gpt-4-turboOpenAI14489—02026-06-21
107gpt-4-turbo-2024-04-09OpenAI16898—02026-06-21
108gpt-3.5-turbo-instructOpenAI——12026-05-27
109gpt-3.5-turbo-instruct-0914OpenAI——12026-05-27
110gpt-4o-audio-previewOpenAI——12026-05-24
111gpt-4o-realtime-previewOpenAI——12026-05-24
112gpt-4o-realtime-preview-2024-12-17OpenAI——12026-05-24
113gpt-4o-audio-preview-2024-12-17OpenAI——12026-05-24
114gpt-4o-mini-realtime-preview-2024-12-17OpenAI——12026-05-24
115gpt-4o-mini-audio-preview-2024-12-17OpenAI——12026-05-24
116o1-2024-12-17OpenAI——12026-06-21
117o1OpenAI——12026-06-21
118gpt-4o-mini-realtime-previewOpenAI——12026-05-24
119gpt-4o-mini-audio-previewOpenAI——12026-05-24
120o3-mini-2025-01-31OpenAI——12026-06-21
121OpenAI GPT-4o TranscribeOpenAI——12026-05-31
122OpenAI GPT-4o mini TranscribeOpenAI——12026-05-31
123o1-pro-2025-03-19OpenAI——12026-05-27
124o1-proOpenAI——12026-05-27
125gpt-4o-mini-ttsOpenAI——12026-05-31
126o3-2025-04-16OpenAI——12026-06-21
127o4-mini-2025-04-16OpenAI——12026-06-21
128OpenAI GPT Image 1OpenAI——12026-05-31
129gpt-4o-realtime-preview-2025-06-03OpenAI——12026-05-24
130gpt-4o-audio-preview-2025-06-03OpenAI——12026-05-24
131o4-mini-deep-researchOpenAI——12026-05-27
132gpt-4o-transcribe-diarizeOpenAI——12026-06-21
133o4-mini-deep-research-2025-06-26OpenAI——12026-05-27
134gpt-5-2025-08-07OpenAI——12026-06-21
135gpt-5-mini-2025-08-07OpenAI——12026-06-21
136gpt-5-nano-2025-08-07OpenAI——12026-06-21
137gpt-audio-2025-08-28OpenAI——12026-06-21
138gpt-realtimeOpenAI——12026-05-31
139gpt-realtime-2025-08-28OpenAI——12026-05-31
140gpt-audioOpenAI——12026-06-21
141gpt-5-codexOpenAI——12026-05-31
142gpt-image-1-miniOpenAI——12026-05-31
143gpt-5-pro-2025-10-06OpenAI——12026-05-27
144gpt-5-proOpenAI——12026-05-27
145gpt-audio-miniOpenAI——12026-06-21
146gpt-audio-mini-2025-10-06OpenAI——12026-06-21
147gpt-realtime-miniOpenAI——12026-05-31
148gpt-realtime-mini-2025-10-06OpenAI——12026-05-31
149gpt-5.1-2025-11-13OpenAI——12026-06-21
150gpt-5.1-codexOpenAI——12026-05-31
151gpt-5.1-codex-miniOpenAI——12026-05-31
152gpt-5.1-codex-maxOpenAI——12026-05-31
153gpt-image-1.5OpenAI——12026-06-21
154gpt-5.2-2025-12-11OpenAI——12026-06-21
155gpt-5.2-pro-2025-12-11OpenAI——12026-05-27
156gpt-5.2-proOpenAI——12026-05-27
157gpt-4o-mini-transcribe-2025-12-15OpenAI——12026-05-31
158gpt-4o-mini-transcribe-2025-03-20OpenAI——12026-05-31
159gpt-4o-mini-tts-2025-03-20OpenAI——12026-05-31
160gpt-4o-mini-tts-2025-12-15OpenAI——12026-05-31
161gpt-realtime-mini-2025-12-15OpenAI——12026-05-31
162gpt-audio-mini-2025-12-15OpenAI——12026-06-21
163chatgpt-image-latestOpenAI——12026-06-14
164gpt-5.2-codexOpenAI——12026-05-31
165gpt-5.3-codexOpenAI——12026-05-31
166gpt-realtime-1.5OpenAI——12026-05-31
167gpt-audio-1.5OpenAI——12026-06-21
168gpt-5.4-2026-03-05OpenAI——12026-06-21
169gpt-5.4-proOpenAI——12026-05-27
170gpt-5.4-pro-2026-03-05OpenAI——12026-05-27
171gpt-5.4-nano-2026-03-17OpenAI——12026-06-21
172gpt-5.4-mini-2026-03-17OpenAI——12026-06-21
173gpt-image-2OpenAI——12026-06-21
174gpt-image-2-2026-04-21OpenAI——12026-06-21
175gpt-5.5-2026-04-23OpenAI——12026-06-21
176gpt-5.5-proOpenAI——12026-05-27
177gpt-5.5-pro-2026-04-23OpenAI——12026-05-27
178Gemini 2.0 FlashGoogle Gemini——12026-05-27
179Gemini 2.0 Flash 001Google Gemini——12026-05-27
180Gemini 2.0 Flash-Lite 001Google Gemini——12026-05-27
181Gemini 2.0 Flash-LiteGoogle Gemini——12026-05-27
182Gemini 2.5 Flash Preview TTSGoogle Gemini——12026-06-21
183Gemini 2.5 Pro Preview TTSGoogle Gemini——12026-06-21
184Gemma 3 1BGoogle Gemini——12026-05-24
185Gemma 3 4BGoogle Gemini——12026-05-24
186Gemma 3 12BGoogle Gemini——12026-05-24
187Gemma 3 27BGoogle Gemini——12026-05-24
188Gemma 3n E4BGoogle Gemini——12026-05-24
189Gemma 3n E2BGoogle Gemini——12026-05-24
190Gemini 3 Pro PreviewGoogle Gemini——12026-05-27
191Gemini 3.1 Flash Lite PreviewGoogle Gemini——12026-05-27
192Lyria 3 Pro PreviewGoogle Gemini——12026-06-14
193Gemini 3.1 Flash TTS PreviewGoogle Gemini——12026-06-21
194Gemini Robotics-ER 1.5 PreviewGoogle Gemini——12026-05-27
195Gemini 2.5 Computer Use Preview 10-2025Google Gemini——12026-06-21
196Deep Research Max Preview (Apr-21-2026)Google Gemini——12026-06-21
197Deep Research Preview (Apr-21-2026)Google Gemini——12026-06-21
198Deep Research Pro Preview (Dec-12-2025)Google Gemini——12026-06-21
199gpt-realtime-translateOpenAI——12026-05-27
200gpt-realtime-2OpenAI——12026-05-27
201gpt-realtime-whisperOpenAI——12026-05-27
202Antigravity Agent PreviewGoogle Gemini——12026-06-14
203Claude Fable 5Anthropic——12026-06-14
204OpenAI text-embedding-3-smallOpenAI——12026-06-21
205OpenAI text-embedding-3-largeOpenAI——12026-06-21