Data Extraction Race — results
Software License Agreement — Acme & Northwind
$0.0158 total
Scoreboard
#1 gpt-oss-20bOVH AI Endpoints (GRA)★ Won this round on this document
97/100
5232 ms · $0.0002
| Field | Expected | Model answer | |
|---|---|---|---|
| product | Enterprise Analytics Suite | Enterprise Analytics Suite | exact |
| licensee | Northwind Trading B.V. | Northwind Trading B.V. | exact |
| licensor | Acme Industries Ltd | Acme Industries Ltd | exact |
| signatory | Maria Hendricks | Maria Hendricks | exact |
| annual_fee | 48000 | 48000 | exact |
| term_months | 36 | 36 | exact |
| license_type | non-exclusive | non-exclusive | exact |
| governing_law | State of Delaware | State of Delaware | exact |
| effective_date | 2026-06-04 | June 4, 2026 | close |
| notice_period_days | 90 | 90 | exact |
#2 Claude Fable 5Anthropic
94/100
3584 ms · $0.0152
| Field | Expected | Model answer | |
|---|---|---|---|
| product | Enterprise Analytics Suite | Enterprise Analytics Suite | exact |
| licensee | Northwind Trading B.V. | Northwind Trading B.V. | exact |
| licensor | Acme Industries Ltd | Acme Industries Ltd | exact |
| signatory | Maria Hendricks | Maria Hendricks | exact |
| annual_fee | 48000 | $48,000.00 | close |
| term_months | 36 | 36 | exact |
| license_type | non-exclusive | non-exclusive | exact |
| governing_law | State of Delaware | State of Delaware | exact |
| effective_date | 2026-06-04 | June 4, 2026 | close |
| notice_period_days | 90 | 90 | exact |
#3 Qwen3.5-9BOVH AI Endpoints (GRA)
—No valid JSON returned
23555 ms · $0.0004
| Field | Expected | Model answer | |
|---|---|---|---|
| product | Enterprise Analytics Suite | — | missing |
| licensee | Northwind Trading B.V. | — | missing |
| licensor | Acme Industries Ltd | — | missing |
| signatory | Maria Hendricks | — | missing |
| annual_fee | 48000 | — | missing |
| term_months | 36 | — | missing |
| license_type | non-exclusive | — | missing |
| governing_law | State of Delaware | — | missing |
| effective_date | 2026-06-04 | — | missing |
| notice_period_days | 90 | — | missing |
Source document
This Software License Agreement is entered into on June 4, 2026 between Acme Industries Ltd (the "Licensor") and Northwind Trading B.V. (the "Licensee"). The Licensor grants a non-exclusive license to the Enterprise Analytics Suite for an annual fee of $48,000.00, payable yearly in advance. The initial term runs for 36 months and renews automatically unless either party gives 90 days written notice. The governing law of this agreement shall be the State of Delaware. Liability is capped at the total fees paid in the preceding twelve months. The agreement was signed by Maria Hendricks on behalf of the Licensee. Extract the following fields as JSON: licensor, licensee, effective_date, annual_fee, term_months, notice_period_days, governing_law, product, license_type, signatory.
How scoring works
Every model received the identical prompt and field list and answered once at temperature 0. We compare each field to the ground truth: an exact match earns full credit, the same value in a different format earns partial credit, anything else earns none. No model judges another — the score is pure field matching. A win means this model scored highest on THIS document with THESE fields, not that it is better overall.