Benchmarks
Intelligence test
Models are ranked by pairwise comparison, not by an absolute score. On every prompt each pair of models is compared head-to-head, and a Bradley-Terry model fits a rating from those comparisons. The win rate below turns that rating into the question it answers: how often this model beats an average model on this board. 50% is average.
8,228
scored runs
111,690
pairwise comparisons
24
prompts
4,629
runs without a score (provider error)
22 of 24 prompts separate models at all. The rest are answered equally well by nearly everyone and carry no ranking signal — that is what an absolute score near 100 was really measuring.
- Coding 4/4
- Creative 2/2
- Factual 3/4
- Multilingual 7/8
- Reasoning 4/4
- Healthcare 2/2
Win rate
Elo 1174
- Won / lost / tied
- 1062 / 83 / 1366
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 96.9
By category
Win rate
Elo 1169
- Won / lost / tied
- 1047 / 97 / 1367
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 96.3
By category
Win rate
Elo 1166
- Won / lost / tied
- 1190 / 178 / 1344
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 96.4
By category
Win rate
Elo 1157
- Won / lost / tied
- 1085 / 133 / 1494
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 96.6
By category
Win rate
Elo 1148
- Won / lost / tied
- 1015 / 188 / 1308
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 95.1
By category
Win rate
Elo 1148
- Won / lost / tied
- 1009 / 185 / 1317
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 95.5
By category
Win rate
Elo 1146
- Won / lost / tied
- 1060 / 184 / 1468
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 96.2
By category
Win rate
Elo 1145
- Won / lost / tied
- 1017 / 208 / 1286
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 95.7
By category
Win rate
Elo 1143
- Won / lost / tied
- 1022 / 228 / 1261
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 95.6
By category
Win rate
Elo 1141
- Won / lost / tied
- 1105 / 258 / 1349
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 97.6
By category
Win rate
Elo 1140
- Won / lost / tied
- 1042 / 204 / 1466
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.6
By category
Win rate
Elo 1137
- Won / lost / tied
- 781 / 223 / 817
- prompts
- 14
- comparisons
- 1821
- Judge mean
- 92.7
By category
Win rate
Elo 1132
- Won / lost / tied
- 979 / 254 / 1278
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 96.1
By category
Win rate
Elo 1127
- Won / lost / tied
- 941 / 244 / 1326
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 96.0
By category
Win rate
Elo 1125
- Won / lost / tied
- 903 / 223 / 1385
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 95.3
By category
Win rate
Elo 1120
- Won / lost / tied
- 775 / 279 / 830
- prompts
- 14
- comparisons
- 1884
- Judge mean
- 91.5
By category
Win rate
Elo 1119
- Won / lost / tied
- 979 / 281 / 1452
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.9
By category
Win rate
Elo 1110
- Won / lost / tied
- 979 / 344 / 1389
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.3
By category
Win rate
Elo 1108
- Won / lost / tied
- 899 / 324 / 1288
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 94.2
By category
Win rate
Elo 1106
- Won / lost / tied
- 971 / 361 / 1380
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.0
By category
Win rate
Elo 1103
- Won / lost / tied
- 1008 / 417 / 1287
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 94.5
By category
Win rate
Elo 1103
- Won / lost / tied
- 976 / 386 / 1350
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 96.5
By category
Win rate
Elo 1096
- Won / lost / tied
- 586 / 299 / 655
- prompts
- 16
- comparisons
- 1540
- Judge mean
- 89.7
By category
Win rate
Elo 1091
- Won / lost / tied
- 953 / 448 / 1311
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.5
By category
Win rate
Elo 1088
- Won / lost / tied
- 990 / 504 / 1218
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.2
By category
Win rate
Elo 1088
- Won / lost / tied
- 552 / 255 / 731
- prompts
- 14
- comparisons
- 1538
- Judge mean
- 94.4
By category
Win rate
Elo 1087
- Won / lost / tied
- 615 / 274 / 910
- prompts
- 23
- comparisons
- 1799
- Judge mean
- 93.5
By category
Win rate
Elo 1085
- Won / lost / tied
- 900 / 436 / 1376
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 90.2
By category
Win rate
Elo 1084
- Won / lost / tied
- 850 / 429 / 1232
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 93.1
By category
Win rate
Elo 1084
- Won / lost / tied
- 903 / 449 / 1360
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 92.9
By category
Win rate
Elo 1083
- Won / lost / tied
- 801 / 398 / 1186
- prompts
- 20
- comparisons
- 2385
- Judge mean
- 89.6
By category
Win rate
Elo 1083
- Won / lost / tied
- 893 / 446 / 1373
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 95.1
By category
Win rate
Elo 1080
- Won / lost / tied
- 780 / 396 / 1209
- prompts
- 20
- comparisons
- 2385
- Judge mean
- 86.0
By category
Win rate
Elo 1077
- Won / lost / tied
- 805 / 427 / 1320
- prompts
- 20
- comparisons
- 2552
- Judge mean
- 89.2
By category
Win rate
Elo 1076
- Won / lost / tied
- 871 / 470 / 1371
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 94.8
By category
Win rate
Elo 1074
- Won / lost / tied
- 789 / 444 / 1152
- prompts
- 20
- comparisons
- 2385
- Judge mean
- 80.6
By category
Win rate
Elo 1074
- Won / lost / tied
- 895 / 512 / 1305
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 93.2
By category
Win rate
Elo 1073
- Won / lost / tied
- 902 / 524 / 1286
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 94.3
By category
Win rate
Elo 1073
- Won / lost / tied
- 911 / 536 / 1265
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 94.5
By category
Win rate
Elo 1072
- Won / lost / tied
- 758 / 432 / 1123
- prompts
- 20
- comparisons
- 2313
- Judge mean
- 82.6
By category
Win rate
Elo 1070
- Won / lost / tied
- 501 / 290 / 608
- prompts
- 18
- comparisons
- 1399
- Judge mean
- 92.6
By category
Win rate
Elo 1068
- Won / lost / tied
- 762 / 451 / 1235
- prompts
- 20
- comparisons
- 2448
- Judge mean
- 90.4
By category
Win rate
Elo 1066
- Won / lost / tied
- 867 / 542 / 1303
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 94.1
By category
Win rate
Elo 1065
- Won / lost / tied
- 722 / 437 / 1154
- prompts
- 20
- comparisons
- 2313
- Judge mean
- 80.4
By category
Win rate
Elo 1063
- Won / lost / tied
- 788 / 505 / 1218
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 87.2
By category
Win rate
Elo 1059
- Won / lost / tied
- 648 / 414 / 1161
- prompts
- 19
- comparisons
- 2223
- Judge mean
- 81.0
By category
Win rate
Elo 1058
- Won / lost / tied
- 735 / 484 / 1292
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 93.5
By category
Win rate
Elo 1058
- Won / lost / tied
- 778 / 529 / 1204
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 94.6
By category
Win rate
Elo 1055
- Won / lost / tied
- 862 / 611 / 1239
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 89.4
By category
Win rate
Elo 1051
- Won / lost / tied
- 831 / 610 / 1271
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 91.7
By category
Win rate
Elo 1048
- Won / lost / tied
- 726 / 541 / 1244
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 93.0
By category
Win rate
Elo 1032
- Won / lost / tied
- 807 / 720 / 1185
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 92.1
By category
Win rate
Elo 1029
- Won / lost / tied
- 737 / 682 / 1092
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 92.5
By category
Win rate
Elo 1027
- Won / lost / tied
- 784 / 741 / 986
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 90.4
By category
Win rate
Elo 1024
- Won / lost / tied
- 734 / 707 / 1070
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 92.4
By category
Win rate
Elo 1016
- Won / lost / tied
- 776 / 802 / 933
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 87.1
By category
Win rate
Elo 1003
- Won / lost / tied
- 485 / 536 / 778
- prompts
- 23
- comparisons
- 1799
- Judge mean
- 79.3
By category
Win rate
Elo 998
- Won / lost / tied
- 766 / 925 / 1021
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 91.2
By category
Win rate
Elo 998
- Won / lost / tied
- 585 / 719 / 1081
- prompts
- 20
- comparisons
- 2385
- Judge mean
- 84.0
By category
Win rate
Elo 995
- Won / lost / tied
- 515 / 647 / 1078
- prompts
- 20
- comparisons
- 2240
- Judge mean
- 74.0
By category
Win rate
Elo 993
- Won / lost / tied
- 521 / 671 / 824
- prompts
- 18
- comparisons
- 2016
- Judge mean
- 83.0
By category
Win rate
Elo 992
- Won / lost / tied
- 778 / 979 / 955
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 88.9
By category
Win rate
Elo 986
- Won / lost / tied
- 728 / 973 / 1011
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 90.8
By category
Win rate
Elo 973
- Won / lost / tied
- 680 / 1012 / 1020
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 83.0
By category
Win rate
Elo 967
- Won / lost / tied
- 515 / 824 / 974
- prompts
- 20
- comparisons
- 2313
- Judge mean
- 70.7
By category
Win rate
Elo 964
- Won / lost / tied
- 669 / 1065 / 978
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 83.5
By category
Win rate
Elo 944
- Won / lost / tied
- 662 / 1194 / 856
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 82.0
By category
Win rate
Elo 944
- Won / lost / tied
- 361 / 639 / 538
- prompts
- 14
- comparisons
- 1538
- Judge mean
- 58.3
By category
Win rate
Elo 933
- Won / lost / tied
- 624 / 1236 / 852
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 83.1
By category
Win rate
Elo 932
- Won / lost / tied
- 378 / 811 / 812
- prompts
- 19
- comparisons
- 2001
- Judge mean
- 60.3
By category
Win rate
Elo 930
- Won / lost / tied
- 617 / 1245 / 850
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 77.6
By category
Win rate
Elo 928
- Won / lost / tied
- 378 / 798 / 633
- prompts
- 14
- comparisons
- 1809
- Judge mean
- 54.8
By category
Win rate
Elo 922
- Won / lost / tied
- 432 / 983 / 825
- prompts
- 20
- comparisons
- 2240
- Judge mean
- 57.2
By category
Win rate
Elo 921
- Won / lost / tied
- 518 / 1119 / 748
- prompts
- 20
- comparisons
- 2385
- Judge mean
- 80.1
By category
Win rate
Elo 916
- Won / lost / tied
- 372 / 758 / 408
- prompts
- 14
- comparisons
- 1538
- Judge mean
- 69.1
By category
Win rate
Elo 911
- Won / lost / tied
- 555 / 1254 / 702
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 77.8
By category
Win rate
Elo 906
- Won / lost / tied
- 348 / 841 / 559
- prompts
- 14
- comparisons
- 1748
- Judge mean
- 67.4
By category
Win rate
Elo 885
- Won / lost / tied
- 559 / 1484 / 669
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 63.7
By category
Win rate
Elo 879
- Won / lost / tied
- 284 / 803 / 451
- prompts
- 14
- comparisons
- 1538
- Judge mean
- 55.9
By category
Win rate
Elo 839
- Won / lost / tied
- 240 / 990 / 516
- prompts
- 18
- comparisons
- 1746
- Judge mean
- 37.9
By category
Win rate
Elo 835
- Won / lost / tied
- 441 / 1573 / 497
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 72.5
By category
Win rate
Elo 835
- Won / lost / tied
- 221 / 853 / 373
- prompts
- 13
- comparisons
- 1447
- Judge mean
- 52.2
By category
Win rate
Elo 820
- Won / lost / tied
- 294 / 1235 / 464
- prompts
- 19
- comparisons
- 1993
- Judge mean
- 42.5
By category
Win rate
Elo 803
- Won / lost / tied
- 381 / 1673 / 457
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 51.7
By category
Win rate
Elo 798
- Won / lost / tied
- 208 / 1154 / 485
- prompts
- 20
- comparisons
- 1847
- Judge mean
- 36.6
By category
Win rate
Elo 796
- Won / lost / tied
- 179 / 971 / 388
- prompts
- 14
- comparisons
- 1538
- Judge mean
- 47.2
By category
Win rate
Elo 794
- Won / lost / tied
- 426 / 1763 / 322
- prompts
- 20
- comparisons
- 2511
- Judge mean
- 77.5
By category
Win rate
Elo 792
- Won / lost / tied
- 192 / 915 / 292
- prompts
- 18
- comparisons
- 1399
- Judge mean
- 41.4
By category
Win rate
Elo 780
- Won / lost / tied
- 250 / 1275 / 353
- prompts
- 24
- comparisons
- 1878
- Judge mean
- 44.1
By category
Win rate
Elo 771
- Won / lost / tied
- 209 / 1338 / 446
- prompts
- 19
- comparisons
- 1993
- Judge mean
- 44.0
By category
Win rate
Elo 768
- Won / lost / tied
- 384 / 1958 / 370
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 48.1
By category
Win rate
Elo 750
- Won / lost / tied
- 338 / 1996 / 378
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 44.4
By category
Win rate
Elo 726
- Won / lost / tied
- 182 / 1437 / 345
- prompts
- 24
- comparisons
- 1964
- Judge mean
- 30.7
By category
Win rate
Elo 692
- Won / lost / tied
- 284 / 2181 / 247
- prompts
- 24
- comparisons
- 2712
- Judge mean
- 37.3
By category
94 models ranked from 111,690 pairwise comparisons across 24 prompts.
Provisional
Too little evidence to rank: needs at least 5 prompts and 30 comparisons.
Win rate
Elo 155
- Won / lost / tied
- 0 / 361 / 6
- prompts
- 4
- comparisons
- 367
- Judge mean
- 0.0
By category