GoBench: Evaluating LLMs on the Game of Go
See the codepaper: https://rolandgao.com/gobench.pdf
Active leaderboard: https://rolandgao.com/blog/gobench/
Use Python 3.12 or newer. From the repository root:
python3 -m venv .venv
source .venv/bin/activate
python -m pip install -e .
Edit the CONFIG = ArenaConfig(...) block near the top of arena.py, then run:
python arena.py
Generate a summary of the configured historical runs:
python arena.py --summary
@misc{gao2026gobench,
title = {{GoBench}: Evaluating {LLMs} on the Game of {Go}},
author = {Gao, Roland},
year = {2026},
url = {https://rolandgao.com/gobench.pdf}
}
12 commits
Python
95.6%
TeX
4.4%
GoBench: Evaluating LLMs on the Game of Go
See the codepaper: https://rolandgao.com/gobench.pdf
Active leaderboard: https://rolandgao.com/blog/gobench/
Use Python 3.12 or newer. From the repository root:
python3 -m venv .venv
source .venv/bin/activate
python -m pip install -e .
Edit the CONFIG = ArenaConfig(...) block near the top of arena.py, then run:
python arena.py
Generate a summary of the configured historical runs:
python arena.py --summary
@misc{gao2026gobench,
title = {{GoBench}: Evaluating {LLMs} on the Game of {Go}},
author = {Gao, Roland},
year = {2026},
url = {https://rolandgao.com/gobench.pdf}
}
12 commits
Python
95.6%
TeX
4.4%