Handshake-AI-Research/deepswe-samples

Coding Agents Build for the Grader They Imagine, Not the User: Speculative Reward Hacking in DeepSWE

3 commits

updated Sep 23, 2026

See what people are saying

Newest first

Most points

Source	Message	Score	Date
	Speculative Reward Hacking in Coding Agents I audited thousands of agent rollouts in DeepSWE-1.1. Over 80% contained reasoning about an imagined grader. Yet no grader/verifier is mentioned in prompts nor accessible to the agents. Agents reasoned things like: "Let me look at the problem from the grader's perspective" and referred to "hidden…	0	Sep 25, 2026

README

Coding Agents Build for the Grader They Imagine, Not the User: Speculative Reward Hacking in DeepSWE

Contributors

jwmueller

2 commits

huiwengoh-hs

1 commits

Similar repos

datacurve/deep-swe

Dataset

lilfry09/Awesome-coding-agent-paper

Curated papers, benchmarks, datasets, environments, and engineering notes for repository-level…

EuniAI/awesome-code-agents

A living collection of frontier research on code agents, from the code we build to the worlds we…

134

R2E-Gym/R2E-Gym

[COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers…

335

Picrew/awesome-rsi

A curated collection of papers, research blogs, and open-source projects on recursive…

xhwang22/Awesome-Reward-Hacking

A curated list of papers and resources on Reward Hacking, Emergent Misalignment, and Proxy…

iSEngLab/Awesome-Self-Evolving-Coding-Agents

Repository for Self-Evolving Coding Agents

149

zongqing0068/awesome-co-evolution

A curated paper list for co-evolution in agentic systems

Handshake-AI-Research/deepswe-samples

Coding Agents Build for the Grader They Imagine, Not the User: Speculative Reward Hacking in DeepSWE

3 commits

updated Sep 23, 2026

See the code

See what people are saying

Newest first

Most points

Source	Message	Score	Date
	Speculative Reward Hacking in Coding Agents I audited thousands of agent rollouts in DeepSWE-1.1. Over 80% contained reasoning about an imagined grader. Yet no grader/verifier is mentioned in prompts nor accessible to the agents. Agents reasoned things like: "Let me look at the problem from the grader's perspective" and referred to "hidden…	0	Sep 25, 2026

README

Coding Agents Build for the Grader They Imagine, Not the User: Speculative Reward Hacking in DeepSWE

Similar repos

datacurve/deep-swe

Dataset

lilfry09/Awesome-coding-agent-paper

Curated papers, benchmarks, datasets, environments, and engineering notes for repository-level…

EuniAI/awesome-code-agents

A living collection of frontier research on code agents, from the code we build to the worlds we…

134

R2E-Gym/R2E-Gym

[COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers…

335

Picrew/awesome-rsi

A curated collection of papers, research blogs, and open-source projects on recursive…

xhwang22/Awesome-Reward-Hacking

A curated list of papers and resources on Reward Hacking, Emergent Misalignment, and Proxy…

iSEngLab/Awesome-Self-Evolving-Coding-Agents

Repository for Self-Evolving Coding Agents

149

zongqing0068/awesome-co-evolution

A curated paper list for co-evolution in agentic systems

Contributors

jwmueller

2 commits

huiwengoh-hs

1 commits