jasmineee-li/eval-awareness

stars

421

commits

Jupyter Notebook

primary language

Jul 13, 2026

updated

README

eval-awareness

(rough) research codebase for Evaluation Cooperativeness May Be a Scalable Mitigation for Eval Gaming, by Jasmine Li & Alexander Matt Turner.

paper✨ ·blog🤸‍♀️ · code👓

Evaluation cooperativeness — FAR poster

Citation

bibtex @misc{li2026evalcoop, title = {Evaluation Cooperativeness May Be a Scalable Mitigation for Eval Gaming}, author = {Li, Jasmine and Turner, Alexander Matt}, year = {2026}, url = {https://jasminexli.com/eval-coop-paper} }

Contributors

jasmineee-li

367 commits

claude

54 commits

Similar repos

jasmineee-li/warp

shared contributors

lm-playpen/playpen-paper-2025

Code for reproducing the results reported in (Horst et al., 2025)

alisawuffles/proxy-tuning

Code associated with Tuning Language Models by Proxy (Liu et al., 2024)

134

pan-webis-de/pan-code

Code used for evaluation and baselines in the PAN shared tasks.

yangzhang33/eval_benchmark

zycheiheihei/MMTrustEval

xu1998hz/llm_self_bias

This is the project to quantify the issues with LLM's self evaluation

VietHoang1512/PSR

Think Twice, Generate Once: Safeguarding by Progressive Self-Reflection (EMNLP 2025 Findings)

Languages

Jupyter Notebook

64.2%

Python

28.3%

Shell

4.3%

C++

1.1%

README

eval-awareness

(rough) research codebase for Evaluation Cooperativeness May Be a Scalable Mitigation for Eval Gaming, by Jasmine Li & Alexander Matt Turner.

paper✨ ·blog🤸‍♀️ · code👓

Evaluation cooperativeness — FAR poster