Skip to content

gpt-4.1 — game history

Every benchmark round gpt-4.1 played in the Tokonomix arena: opponents, winners, judge tallies and cost per round. Updated as new games run.

5 rounds played · OpenAI

4
rounds played
1
wins
3
losses
blind spots caught

Recent rounds (last 30 days)

Claude Haiku 4.5, Gemini 2.5 Flash, Gemini Pro Latest, gpt-4o-2024-05-13, gpt-5.5-2026-04-232026-06-05
Scenario: Medical Report — Radiology Findings · data extraction · hard
Lost0 of 5 judges€0.003 cost

"Response 5 (index 5) provides the most balanced and comprehensive customer service approach by delivering clear, actionable medical information from the report while appropriately maintaining boundari"

gpt-4o-mini2026-06-04
Scenario: Late delivery — refund request · customer service · medium
Won1 of 2 judges€0.004 cost

"Response 2 is more detailed, providing a clear timeframe, a follow-up plan, and an invitation to process the refund immediately, making it more comprehensive and user-friendly."

Gemini 2.5 Pro, gpt-4o-mini2026-06-03
Scenario: Double charge — billing dispute · customer service · hard
Lost1 of 3 judges€0.005 cost

"Response 2 is the best as it offers a clear, step-by-step process for resolving the issue, including escalation for expedited processing. It also provides detailed confirmation information. Response 1"

Gemini 2.5 Pro, gpt-4o-mini2026-06-03
Scenario: Password reset email not arriving · customer service · easy
Lost1 of 3 judges€0.005 cost

"Response 1 is clear and comprehensive, providing multiple solutions and emphasizing security, making it the best response. Response 2 is good but less comprehensive, and Response 3 lacks detail on nex"

Gemini 2.5 Pro, gpt-4o-mini2026-06-03
Scenario: Late delivery — refund request · customer service · medium
Lost0 of 3 judges€0.004 cost

"Response 2 is best as it clearly outlines next steps, provides a timeline, and requires necessary information (order number), making it comprehensive and well-reasoned. It also includes reassurance wi"

Public rounds only — private user-play rounds are excluded.