BOSSFIGHT: can a frontier LLM run a business? An end-to-end benchmark of AI business managers.
See the codeSee what people are saying
README
Report · Methodology · Related work · Transcripts · clod.farm
Update, 2026-10-04: added Claude Opus 5.5 and GPT-6 Astra at a reader's request. Same tests, same seeds, same judge panel.
Exhibits D–I
More figures: money, negotiation, layoffs, integrity, hiring, marketing, meetings
- Seven tracks: a 24-week company simulation, negotiation, hiring, firing, decisions, integrity and marketing.
- Four are scored against ground truth. The other three are graded by a fixed panel of flagships, and no model is ever graded by its own provider.
- Identical worlds: every model and baseline faces the same random draws.
Full details are in the methodology.
pip install -r requirements.txt pillow
export BOSSFIGHT_KEYS=/path/to/keys.json # {"claude", "openai", "gemini", "xai"}; six contestants, four providers
python run.py && python analyze.py && python pixel.py
Limitations
- Sample size: three runs or seeds per condition.
- Simulator: stylized and calibrated by the authors.
- World model:
gemini-3.8-flashshares a family with one contestant. - Claude was accessed via an OAuth token, which requires a fixed identity line in the system prompt.
- Test detection: the simulation prompt says "game".
See REPORT.md §4.
Citation
@misc{bossfight2026,
title = {BOSSFIGHT: An End-to-End Benchmark of Large Language Models as Business Managers},
author = {{clod.farm research}},
year = {2026},
url = {https://github.com/matank001/bossfight}
}
Snapshot 2026-10-03 · clod.farm research · MIT · Pixel art and sign style: clodfarm · Fonts: Press Start 2P and VT323 (SIL OFL) · Icons: Lucide (ISC) · Provider logos: LobeHub (MIT); they are trademarks of their owners and identify the models only.
Similar repos
Languages
Python
100.0%
BOSSFIGHT: can a frontier LLM run a business? An end-to-end benchmark of AI business managers.
See the codeSee what people are saying
README
Report · Methodology · Related work · Transcripts · clod.farm
Update, 2026-10-04: added Claude Opus 5.5 and GPT-6 Astra at a reader's request. Same tests, same seeds, same judge panel.
Exhibits D–I
More figures: money, negotiation, layoffs, integrity, hiring, marketing, meetings
- Seven tracks: a 24-week company simulation, negotiation, hiring, firing, decisions, integrity and marketing.
- Four are scored against ground truth. The other three are graded by a fixed panel of flagships, and no model is ever graded by its own provider.
- Identical worlds: every model and baseline faces the same random draws.
Full details are in the methodology.
pip install -r requirements.txt pillow
export BOSSFIGHT_KEYS=/path/to/keys.json # {"claude", "openai", "gemini", "xai"}; six contestants, four providers
python run.py && python analyze.py && python pixel.py
Limitations
- Sample size: three runs or seeds per condition.
- Simulator: stylized and calibrated by the authors.
- World model:
gemini-3.8-flashshares a family with one contestant. - Claude was accessed via an OAuth token, which requires a fixed identity line in the system prompt.
- Test detection: the simulation prompt says "game".
See REPORT.md §4.
Citation
@misc{bossfight2026,
title = {BOSSFIGHT: An End-to-End Benchmark of Large Language Models as Business Managers},
author = {{clod.farm research}},
year = {2026},
url = {https://github.com/matank001/bossfight}
}
Snapshot 2026-10-03 · clod.farm research · MIT · Pixel art and sign style: clodfarm · Fonts: Press Start 2P and VT323 (SIL OFL) · Icons: Lucide (ISC) · Provider logos: LobeHub (MIT); they are trademarks of their owners and identify the models only.
Similar repos
Languages
Python
100.0%