theonlypal/PCCG-Qwen3-4B-continuation-control

Causal continuation-control study for PCCG-Qwen3-4B using Jacobian Lens and activation intervention.

1

stars

1

commits

Python

primary language

Sep 8, 2026

updated

README

Continuation control

40/40 GO→EOS

40/40 EOS→GO

640/640 controls unchanged

Prompt, weights, and generated reasoning prefix held fixed during intervention.

Rayan Pal
getswiftapi.com
Independent Researcher

Thinking-enabled PCCG-Qwen3-4B with an equality-conditioned continuation policy. One fixed 2,560-dimensional activation direction at block 29, applied after the model generated </think>. Intervention strength: 2.0. GO is followed by native EOS.

Confirmation measurementResult
Correct generated comparison trace and answer80/80
Unmodified replay80/80
GO→EOS40/40
EOS→GO40/40
Controls unchanged640/640

Anthropic's Jacobian Lens provides internal vocabulary readouts. Additive activation interventions measure causal effects. Method.

Verify

Clone with Git LFS installed. The fitted lens is stored in Git LFS.

git lfs pull
python verify.py

Checks package hashes and recounts the confirmation records. Runs on CPU using the Python standard library.

Reproduce

Commands and model requirements.

Contents

  • results/: complete study records, logits, activations, fitted lens, and fixed direction.
  • source/: executed study code and Anthropic's Jacobian Lens implementation.
  • protocol/: prompts, case sets, model qualification record, and reproduction settings.
  • SHA256SUMS: package file hashes.
  • LICENSE: Apache 2.0. The vendored implementation retains its license in source/vendor/LICENSE.

Contributors

theonlypal

1 commits

theonlypal/PCCG-Qwen3-4B-continuation-control

Causal continuation-control study for PCCG-Qwen3-4B using Jacobian Lens and activation intervention.

1

stars

1

commits

Python

primary language

Sep 8, 2026

updated

README

Continuation control

40/40 GO→EOS

40/40 EOS→GO

640/640 controls unchanged

Prompt, weights, and generated reasoning prefix held fixed during intervention.

Rayan Pal
getswiftapi.com
Independent Researcher

Thinking-enabled PCCG-Qwen3-4B with an equality-conditioned continuation policy. One fixed 2,560-dimensional activation direction at block 29, applied after the model generated </think>. Intervention strength: 2.0. GO is followed by native EOS.

Confirmation measurementResult
Correct generated comparison trace and answer80/80
Unmodified replay80/80
GO→EOS40/40
EOS→GO40/40
Controls unchanged640/640

Anthropic's Jacobian Lens provides internal vocabulary readouts. Additive activation interventions measure causal effects. Method.

Verify

Clone with Git LFS installed. The fitted lens is stored in Git LFS.

git lfs pull
python verify.py

Checks package hashes and recounts the confirmation records. Runs on CPU using the Python standard library.

Reproduce

Commands and model requirements.

Contents

  • results/: complete study records, logits, activations, fitted lens, and fixed direction.
  • source/: executed study code and Anthropic's Jacobian Lens implementation.
  • protocol/: prompts, case sets, model qualification record, and reproduction settings.
  • SHA256SUMS: package file hashes.
  • LICENSE: Apache 2.0. The vendored implementation retains its license in source/vendor/LICENSE.

Contributors

theonlypal

1 commits

Languages

Python

100.0%