Does the chess rating formula work?
Every chess player has a rating, and a formula from the 1950s says what should happen when two of them meet: 100 points ahead, you should score 64%. Here are 560,709 games to check it against.
What this is. Every rated game played on lichess.org from January to April 2013 that has two ratings and a result, from the Lichess open database (CC0). Games are grouped by the gap between the two ratings, in steps of 25 points. The score counts a win as 1 and a draw as a half. Arpad Elo's formula says the higher-rated player should score 1 ÷ (1 + 10^(−gap/400)).
The shape is right, and the formula is too confident: at every gap the favourite does a little worse than predicted, by 3 points on average and up to 6. A player 200 points ahead is meant to score 77% and scores 72%. A player 400 points behind still wins one game in eight. Two reasons are likely. Lichess uses a later system (Glicko-2) on the same scale, and these files include many players with only a few games, whose ratings have not settled, which flattens any such curve. White's first move is worth about 15 rating points: with equal ratings White scores 52.1%. Only 3% of these games were drawn; among grandmasters it is more than half.