Fair model comparisons
Equal-run rankings for fixed model rosters using only shared completed rounds.
Older sets keep accumulating shared rounds. New official rosters are opened automatically only when no existing set already contains the models in that run. Sets qualify at 6 weekly shared rounds or 3 monthly shared rounds.
Weekly comparison set automatically opened when the Aug 19 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Jul 24 official roster first required a new equal-run benchmark group across 8 models.
Weekly comparison set automatically opened when the Jul 24 official roster first required a new equal-run benchmark group across 8 models.
Weekly comparison set automatically opened when the Jul 21 official roster first required a new equal-run benchmark group across 7 models.
Weekly comparison set automatically opened when the Jul 10 official roster first required a new equal-run benchmark group across 8 models.
Weekly comparison set that starts when Grok 4.5 joins the weekly benchmark roster.
Weekly comparison set that starts when Claude Fable 5 joins the weekly benchmark roster.
Weekly comparison set that adds Claude Opus 4.8 to the established model roster.
Original weekly comparison set for the first four CapitalBench models.
Monthly comparison set automatically opened when the Jul 21 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Jul 10 official roster first required a new equal-run benchmark group across 8 models.
Monthly comparison set that starts when Grok 4.5 joins the monthly benchmark roster.
Monthly comparison set that starts when Claude Fable 5 joins the monthly benchmark roster.
Monthly comparison set that adds Claude Opus 4.8 to the established model roster.
Original monthly comparison set for the first four CapitalBench models.
Weekly comparison set automatically opened when the Aug 13 official roster first required a new equal-run benchmark group across 8 models.
Weekly comparison set automatically opened when the Sep 4 official roster first required a new equal-run benchmark group across 7 models.
Weekly comparison set automatically opened when the Sep 3 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Sep 4 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Sep 3 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Aug 19 official roster first required a new equal-run benchmark group across 7 models.
Monthly comparison set automatically opened when the Aug 13 official roster first required a new equal-run benchmark group across 8 models.
No benchmark sets match this filter.
Main published results compared with the newest groups that have results.
Grok 4.3 ranks first in both groups. The groups share 3 completed rounds. Aug 19 Weekly includes 11 more rounds. Claude Opus 4.8 appears only in Aug 13 Weekly.
Use Aug 19 Weekly as the more reliable ranking because it has 14 completed rounds. Aug 13 Weekly has 3 and needs 3 more before it has enough evidence to become the main ranking.
Compare weekly groupsGrok 4.5 ranks first in both groups. The groups share 11 completed rounds. Jul 21 Monthly includes 8 more rounds. Claude Opus 5 appears only in Jul 24 Monthly.
Jul 24 Monthly is the main published ranking. Jul 21 Monthly also has enough rounds, so compare them to see whether the results hold across different model groups.
Compare monthly groups