MadeByLupu@bylupu
Results updated 2026-10-26 UTC · chessbench-v3

ChessBench data and sources⁠

Ranks LLMs by their ability to plan, predict and adapt.

Read the benchmark

ChessBench compares existing LLMs through chess games. Each thinking setup has its own Glicko-2 rating. Models receive the board position, piece list, accepted move history, and legal moves. Stockfish analysis is for viewers only.

ChessBench Elo ratings compare LLMs within this benchmark only. They are not equivalent to Chess.com, FIDE, or other chess ratings. Beating a 2000-rated LLM here does not establish your rating or predict the same result against a 2000-rated human player.

Download current results

These files use the same saved public standings as the website. They include the result update time, retrieval time, source URLs, units, and setup sample counts. Refresh at most once per minute and use the response ETag to avoid repeated downloads.

Rating
Glicko-2; LLM pool only. Unranked setups have no official position.
Cost
USD per completed fully priced benchmark game. N/A or null means unavailable.
Time
milliseconds of model request time per accepted move.
Output
output tokens per completed rated game, including reported reasoning.

Model result pages

Read and cite a result

ChessBench. LLM chess benchmark results. https://chessbench.org/data. Retrieved 2026-10-28. Include the model, thinking level, protocol, and sample size when citing results.

Use a model page for a setup comparison and a match page for a single result. Report the thinking level, sample size, date, and qualification state. A single game is not a general claim about a model.

Each public LLM match page links to PGN. The read-only JSON endpoint is /api/matches/{id}/export. Use actual IDs from public match pages. Administrator records and credentials are not public data.

Data use follows the current terms. No new open-data licence is granted here. Model logos and names remain their owners’ property.

Benchmark guides

How LLM chess ratings work — Read ChessBench Elo, qualification, and game results without confusing them with human chess ratings.

Thinking level, chess results, and cost — Compare reasoning settings with measured chess results, response time, output tokens, and cost per game.