Benchmarks
Intelligence test
Models are ranked by pairwise comparison, not by an absolute score. On every prompt each pair of models is compared head-to-head, and a Bradley-Terry model fits a rating from those comparisons. The win rate below turns that rating into the question it answers: how often this model beats an average model on this board. 50% is average.
8,083
scored runs
80,557
pairwise comparisons
24
prompts
4,263
runs without a score (provider error)
22 of 24 prompts separate models at all. The rest are answered equally well by nearly everyone and carry no ranking signal — that is what an absolute score near 100 was really measuring.
- Coding 4/4
- Creative 2/2
- Factual 3/4
- Multilingual 7/8
- Reasoning 4/4
- Healthcare 2/2
Win rate
Elo 1165
- Won / lost / tied
- 251 / 60 / 245
- prompts
- 8
- comparisons
- 556
- Judge mean
- 83.6
By category
Win rate
Elo 1164
- Won / lost / tied
- 1077 / 171 / 1206
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 94.8
By category
Win rate
Elo 1164
- Won / lost / tied
- 296 / 81 / 251
- prompts
- 9
- comparisons
- 628
- Judge mean
- 86.3
By category
Win rate
Elo 1162
- Won / lost / tied
- 998 / 161 / 1149
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 93.9
By category
Win rate
Elo 1153
- Won / lost / tied
- 982 / 198 / 1128
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 92.2
By category
Win rate
Elo 1152
- Won / lost / tied
- 953 / 175 / 1180
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 92.3
By category
Win rate
Elo 1146
- Won / lost / tied
- 310 / 124 / 194
- prompts
- 9
- comparisons
- 628
- Judge mean
- 87.5
By category
Win rate
Elo 1143
- Won / lost / tied
- 964 / 183 / 1307
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 94.8
By category
Win rate
Elo 1139
- Won / lost / tied
- 932 / 224 / 1152
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 91.2
By category
Win rate
Elo 1138
- Won / lost / tied
- 914 / 211 / 1183
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 91.8
By category
Win rate
Elo 1134
- Won / lost / tied
- 898 / 218 / 1192
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 91.9
By category
Win rate
Elo 1134
- Won / lost / tied
- 917 / 238 / 1153
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 92.6
By category
Win rate
Elo 1130
- Won / lost / tied
- 929 / 229 / 1296
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 93.7
By category
Win rate
Elo 1129
- Won / lost / tied
- 292 / 132 / 204
- prompts
- 9
- comparisons
- 628
- Judge mean
- 85.8
By category
Win rate
Elo 1129
- Won / lost / tied
- 971 / 292 / 1136
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 96.3
By category
Win rate
Elo 1114
- Won / lost / tied
- 858 / 296 / 1154
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 91.2
By category
Win rate
Elo 1112
- Won / lost / tied
- 903 / 313 / 1238
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 94.1
By category
Win rate
Elo 1109
- Won / lost / tied
- 254 / 126 / 248
- prompts
- 9
- comparisons
- 628
- Judge mean
- 84.5
By category
Win rate
Elo 1108
- Won / lost / tied
- 304 / 178 / 146
- prompts
- 9
- comparisons
- 628
- Judge mean
- 87.3
By category
Win rate
Elo 1107
- Won / lost / tied
- 838 / 318 / 1152
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 89.9
By category
Win rate
Elo 1104
- Won / lost / tied
- 855 / 348 / 1105
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 90.5
By category
Win rate
Elo 1103
- Won / lost / tied
- 900 / 375 / 1124
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 94.4
By category
Win rate
Elo 1098
- Won / lost / tied
- 824 / 364 / 1069
- prompts
- 20
- comparisons
- 2257
- Judge mean
- 85.5
By category
Win rate
Elo 1095
- Won / lost / tied
- 906 / 425 / 1123
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 93.6
By category
Win rate
Elo 1089
- Won / lost / tied
- 868 / 430 / 1101
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 95.0
By category
Win rate
Elo 1087
- Won / lost / tied
- 855 / 421 / 1178
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 93.1
By category
Win rate
Elo 1084
- Won / lost / tied
- 855 / 440 / 1159
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 92.4
By category
Win rate
Elo 1083
- Won / lost / tied
- 855 / 445 / 1154
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 92.8
By category
Win rate
Elo 1082
- Won / lost / tied
- 790 / 419 / 1074
- prompts
- 20
- comparisons
- 2283
- Judge mean
- 87.5
By category
Win rate
Elo 1079
- Won / lost / tied
- 751 / 412 / 1024
- prompts
- 20
- comparisons
- 2187
- Judge mean
- 85.2
By category
Win rate
Elo 1074
- Won / lost / tied
- 829 / 478 / 1147
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 91.0
By category
Win rate
Elo 1073
- Won / lost / tied
- 818 / 478 / 1103
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 93.4
By category
Win rate
Elo 1071
- Won / lost / tied
- 455 / 233 / 696
- prompts
- 23
- comparisons
- 1384
- Judge mean
- 93.5
By category
Win rate
Elo 1070
- Won / lost / tied
- 800 / 474 / 1180
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 92.9
By category
Win rate
Elo 1070
- Won / lost / tied
- 628 / 395 / 653
- prompts
- 14
- comparisons
- 1676
- Judge mean
- 88.9
By category
Win rate
Elo 1069
- Won / lost / tied
- 735 / 438 / 1135
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 89.9
By category
Win rate
Elo 1069
- Won / lost / tied
- 770 / 481 / 1002
- prompts
- 20
- comparisons
- 2253
- Judge mean
- 92.7
By category
Win rate
Elo 1068
- Won / lost / tied
- 779 / 492 / 1037
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 90.0
By category
Win rate
Elo 1067
- Won / lost / tied
- 239 / 181 / 208
- prompts
- 9
- comparisons
- 628
- Judge mean
- 81.9
By category
Win rate
Elo 1065
- Won / lost / tied
- 422 / 242 / 575
- prompts
- 14
- comparisons
- 1239
- Judge mean
- 92.7
By category
Win rate
Elo 1063
- Won / lost / tied
- 778 / 500 / 1121
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 93.6
By category
Win rate
Elo 1059
- Won / lost / tied
- 639 / 456 / 581
- prompts
- 14
- comparisons
- 1676
- Judge mean
- 87.5
By category
Win rate
Elo 1056
- Won / lost / tied
- 547 / 426 / 529
- prompts
- 19
- comparisons
- 1502
- Judge mean
- 84.0
By category
Win rate
Elo 1053
- Won / lost / tied
- 204 / 174 / 178
- prompts
- 8
- comparisons
- 556
- Judge mean
- 75.7
By category
Win rate
Elo 1052
- Won / lost / tied
- 372 / 240 / 472
- prompts
- 18
- comparisons
- 1084
- Judge mean
- 92.6
By category
Win rate
Elo 1051
- Won / lost / tied
- 746 / 558 / 1004
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 82.6
By category
Win rate
Elo 1050
- Won / lost / tied
- 762 / 568 / 1124
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 87.0
By category
Win rate
Elo 1042
- Won / lost / tied
- 624 / 497 / 1001
- prompts
- 20
- comparisons
- 2122
- Judge mean
- 82.4
By category
Win rate
Elo 1040
- Won / lost / tied
- 225 / 211 / 192
- prompts
- 9
- comparisons
- 628
- Judge mean
- 83.1
By category
Win rate
Elo 1036
- Won / lost / tied
- 748 / 641 / 1065
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 86.6
By category
Win rate
Elo 1023
- Won / lost / tied
- 650 / 632 / 1026
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 88.5
By category
Win rate
Elo 1023
- Won / lost / tied
- 691 / 676 / 941
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 88.5
By category
Win rate
Elo 1022
- Won / lost / tied
- 603 / 586 / 933
- prompts
- 20
- comparisons
- 2122
- Judge mean
- 80.1
By category
Win rate
Elo 1014
- Won / lost / tied
- 702 / 736 / 961
- prompts
- 24
- comparisons
- 2399
- Judge mean
- 90.8
By category
Win rate
Elo 1013
- Won / lost / tied
- 731 / 774 / 803
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 80.8
By category
Win rate
Elo 1011
- Won / lost / tied
- 564 / 615 / 676
- prompts
- 20
- comparisons
- 1855
- Judge mean
- 83.2
By category
Win rate
Elo 1004
- Won / lost / tied
- 383 / 402 / 599
- prompts
- 23
- comparisons
- 1384
- Judge mean
- 79.3
By category
Win rate
Elo 1001
- Won / lost / tied
- 654 / 773 / 881
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 87.3
By category
Win rate
Elo 992
- Won / lost / tied
- 710 / 890 / 854
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 88.9
By category
Win rate
Elo 958
- Won / lost / tied
- 632 / 1027 / 795
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 77.3
By category
Win rate
Elo 956
- Won / lost / tied
- 378 / 651 / 727
- prompts
- 19
- comparisons
- 1756
- Judge mean
- 71.6
By category
Win rate
Elo 943
- Won / lost / tied
- 433 / 804 / 713
- prompts
- 20
- comparisons
- 1950
- Judge mean
- 68.2
By category
Win rate
Elo 918
- Won / lost / tied
- 136 / 299 / 121
- prompts
- 8
- comparisons
- 556
- Judge mean
- 63.6
By category
Win rate
Elo 896
- Won / lost / tied
- 443 / 1126 / 621
- prompts
- 20
- comparisons
- 2190
- Judge mean
- 80.5
By category
Win rate
Elo 895
- Won / lost / tied
- 293 / 673 / 333
- prompts
- 14
- comparisons
- 1299
- Judge mean
- 73.4
By category
Win rate
Elo 893
- Won / lost / tied
- 316 / 801 / 449
- prompts
- 14
- comparisons
- 1566
- Judge mean
- 62.9
By category
Win rate
Elo 889
- Won / lost / tied
- 543 / 1353 / 558
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 64.1
By category
Win rate
Elo 878
- Won / lost / tied
- 261 / 767 / 451
- prompts
- 14
- comparisons
- 1479
- Judge mean
- 59.4
By category
Win rate
Elo 870
- Won / lost / tied
- 261 / 817 / 474
- prompts
- 19
- comparisons
- 1552
- Judge mean
- 51.7
By category
Win rate
Elo 862
- Won / lost / tied
- 271 / 867 / 413
- prompts
- 14
- comparisons
- 1551
- Judge mean
- 65.2
By category
Win rate
Elo 852
- Won / lost / tied
- 447 / 1403 / 458
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 73.5
By category
Win rate
Elo 846
- Won / lost / tied
- 302 / 1003 / 391
- prompts
- 19
- comparisons
- 1696
- Judge mean
- 49.6
By category
Win rate
Elo 844
- Won / lost / tied
- 229 / 790 / 349
- prompts
- 14
- comparisons
- 1368
- Judge mean
- 61.9
By category
Win rate
Elo 838
- Won / lost / tied
- 207 / 824 / 411
- prompts
- 14
- comparisons
- 1442
- Judge mean
- 54.8
By category
Win rate
Elo 838
- Won / lost / tied
- 255 / 932 / 375
- prompts
- 14
- comparisons
- 1562
- Judge mean
- 55.9
By category
Win rate
Elo 828
- Won / lost / tied
- 395 / 1468 / 445
- prompts
- 20
- comparisons
- 2308
- Judge mean
- 51.0
By category
Win rate
Elo 817
- Won / lost / tied
- 176 / 911 / 481
- prompts
- 20
- comparisons
- 1568
- Judge mean
- 50.3
By category
Win rate
Elo 789
- Won / lost / tied
- 384 / 1714 / 356
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 48.1
By category
Win rate
Elo 788
- Won / lost / tied
- 210 / 960 / 273
- prompts
- 24
- comparisons
- 1443
- Judge mean
- 44.1
By category
Win rate
Elo 787
- Won / lost / tied
- 194 / 1089 / 398
- prompts
- 19
- comparisons
- 1681
- Judge mean
- 48.1
By category
Win rate
Elo 786
- Won / lost / tied
- 141 / 699 / 244
- prompts
- 18
- comparisons
- 1084
- Judge mean
- 41.4
By category
Win rate
Elo 751
- Won / lost / tied
- 316 / 1810 / 328
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 44.0
By category
Win rate
Elo 737
- Won / lost / tied
- 136 / 1106 / 336
- prompts
- 24
- comparisons
- 1578
- Judge mean
- 33.6
By category
Win rate
Elo 714
- Won / lost / tied
- 269 / 1908 / 277
- prompts
- 24
- comparisons
- 2454
- Judge mean
- 36.4
By category
Win rate
Elo 694
- Won / lost / tied
- 47 / 446 / 63
- prompts
- 8
- comparisons
- 556
- Judge mean
- 44.8
By category
85 models ranked from 80,557 pairwise comparisons across 24 prompts.
Provisional
Too little evidence to rank: needs at least 5 prompts and 30 comparisons.
Win rate
Elo 192
- Won / lost / tied
- 0 / 281 / 6
- prompts
- 4
- comparisons
- 287
- Judge mean
- 0.0
By category