Skip to content
Tier A — Frontier
Runs in:USMade in:United States
OpenAI

gpt-6-sol

Tier A — Frontier · 1.05M tokens

Tokonomix Editorial Team·Reviewed by Mes Kalkan··
Section 01

Speed analysis

Latency measured across all benchmark runs. P50 (median) and P95 (95th percentile) give a realistic picture of response speed under normal and peak load.

P50 latency (median)P95 latency107 runs
563110716502194273710-2611-22ms
Section 02

Quality scores

How this model compares to the rest of the field on each prompt category, from a pairwise fit over the same prompts. The raw judge score sits underneath each number.

73%
Coding
judge mean 90
96%
Creative
judge mean 90
45%
Factual
judge mean 69
51%
Reasoning
judge mean 95

Win rate per category: how often this model beats a field-average model on a prompt from that category. 50% is average, not a failing grade. It is not a percentage of correct answers.

Section 03

Pricing

What you pay per million tokens when you use this model on Tokonomix, plus an estimate for a typical conversation.

💰
API rates — gpt-6-sol
$2.60 per 1M input tokens
$13.00 per 1M output tokens
≈ $0.0042 per typical conversation (800 tokens)
Input vs output price (per 1M tokens)
per 1M input tokens$2.60
per 1M output tokens$13.00
Section 04

Tokens per second

Throughput in tokens per second, derived from measured P50 latency. Higher is better; fluctuations track provider-side load.

Throughput (tokens / s)276 / avg 249
35267

Estimated from P50 latency × 200 output tokens — the absolute number depends on this assumption; the trend is what matters.

Section 05

Capabilities

toolssource: seed-newest-generation-2026-09-30visionjson modepdf inputreasoningjson schemaparallel toolsprompt cachingmax output tokens: 128000
Section 06

Availability

Availability

How often this model answers when we call it — measured across real API requests and live tests over the last 30 days. This is separate from quality: these numbers only tell you whether the model responds, not how good the answer is.

Last 7 days

—

Last 30 days

100.0%

n=23

Median response time

14,958ms

n=23

Based on 397 measurements over the last 30 days.

Technical details

Only live API calls and live-test requests count — internal probes and benchmark runs are excluded.

Calls with a custom API key (BYOK) are excluded: those failures are key-specific, not a sign of model downtime.

Failed calls are NOT included in quality scores — quality is measured on successful responses only. Availability and quality are independent signals.

Median response time (p50) across successful calls with a recorded duration. Outliers (very slow or very fast calls) pull the median less than the average.

Total calls (30d)

23

OK responses (30d)

23

Total calls (7d)

0

OK responses (7d)

0

Section 07

Tokonomix benchmark verdicts

⚖️
Endorsed by 1 judge
Independent LLM judges evaluated this model on our weekly intelligence tests
claude-sonnet-4-584/100 · 28 runs
22 correct3 partial3 wrong79% accuracy
● 2026-11-22

Major quality leap with 37-point gain, now scoring 94/100 overall

GPT-6-SOL demonstrates a substantial performance improvement in this benchmark window, jumping from 56.8 to 94.0 overall quality score. The 37.2-point increase represents one of the most significant improvements observed between consecutive windows. Coding performance reached a perfect 100, up from 74, while creative tasks scored 90. Reasoning remained consistently strong at 92 across both windows, indicating stable performance in logical tasks. The previous window's notably low factual score of 5 is absent from current metrics, suggesting either category restructuring or significant correction of knowledge retrieval issues. Latency also improved by 19 percent, dropping from 2929ms to 2377ms at the median, though response times remain in the multi-second range. With only 3 test runs in the current window compared to 4 previously, the sample size is limited but results appear promising. The dramatic quality improvement, particularly in coding capabilities, positions this model as a strong performer, though users should monitor whether these gains persist across larger sample sizes in future windows.

Quality

94.0

Latency p50

2,377 ms

Test runs

3

✓ Quality up 37 points✓ Perfect coding score achieved✓ 19% faster response time✗ Limited test sample size
Last automated test
Nov 22, 2026 · 08:04 UTC · Speed benchmark
P50 latency
725 ms
P95 latency
742 ms
Errors
0 / 6 runs
Last reviewed by Tokonomix Team·November 22, 2026