Shadowgraph
TrendingBuzzAbout
Sign in

summerbro-hhj/wavefront-decoding

Python

0

2 commits

updated Sep 26, 2026

See the code

See what people are saying

SourceMessageScoreDate

[Paper] WaveFront Decoding: Parallelized Self-Speculative Decoding for Looped Language Models (r/LocalLLaMA)

Looped language models repeatedly apply a weight-shared block to increase effective depth without increasing parameter count, but the resulting T sequential recurrent-block calls per generated token substantially increase decoding latency. To address the issue, we introduce Wavefront Decoding…

2

Oct 6, 2026

README

WaveFront Decoding

We introduce Wavefront Decoding (WFD), a training-free, lossless self-speculative decoding framework native to looped language models.

Paper: arXiv

Environment Setup

Make sure you pulled submodules

git submodule update --init

We recommend creating a virtual environment and installing PyTorch first.

conda create -n [name] python=3.11 -y
conda activate [name]
pip install torch
pip install -r env/requirements.txt

python env/verify_env.py

Spec-Bench Protocol

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp2_spec_bench/run.sh

Edit run.sh to configure options before running.

MATH-500 and GSM8K

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp3_accuracy/run.sh

Edit run.sh to configure options before running.

Acceptance-Controlled Evaluation

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp4_emu/run.sh

Edit run.sh to configure options before running.

CUDA Graph Evaluation

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp5_graph/run.sh

Edit run.sh to configure options before running.

Similar repos

satindergrewal/DeepSpec

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

2

deepseek-ai/DeepSpec

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

7,190

Escanord/FAFO

1

Dogacel/Attention-Drift

Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.

32

hxri/ddtreeplus

0

Leosang-lx/FlowSpec

Continuous Pipelined Speculative Decoding

22

cychomatica/FreeDave

[NeurIPS 2026] Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large…

24

pablo-labo/specdiff_aoi

0

summerbro-hhj/wavefront-decoding

Python

0

2 commits

updated Sep 26, 2026

See the code

See what people are saying

SourceMessageScoreDate

[Paper] WaveFront Decoding: Parallelized Self-Speculative Decoding for Looped Language Models (r/LocalLLaMA)

Looped language models repeatedly apply a weight-shared block to increase effective depth without increasing parameter count, but the resulting T sequential recurrent-block calls per generated token substantially increase decoding latency. To address the issue, we introduce Wavefront Decoding…

2

Oct 6, 2026

README

WaveFront Decoding

We introduce Wavefront Decoding (WFD), a training-free, lossless self-speculative decoding framework native to looped language models.

Paper: arXiv

Environment Setup

Make sure you pulled submodules

git submodule update --init

We recommend creating a virtual environment and installing PyTorch first.

conda create -n [name] python=3.11 -y
conda activate [name]
pip install torch
pip install -r env/requirements.txt

python env/verify_env.py

Spec-Bench Protocol

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp2_spec_bench/run.sh

Edit run.sh to configure options before running.

MATH-500 and GSM8K

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp3_accuracy/run.sh

Edit run.sh to configure options before running.

Acceptance-Controlled Evaluation

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp4_emu/run.sh

Edit run.sh to configure options before running.

CUDA Graph Evaluation

CUDA_VISIBLE_DEVICES=[gpu_num] bash experiments/exp5_graph/run.sh

Edit run.sh to configure options before running.

Similar repos

satindergrewal/DeepSpec

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

2

deepseek-ai/DeepSpec

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

7,190

Escanord/FAFO

1

Dogacel/Attention-Drift

Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.

32

hxri/ddtreeplus

0

Leosang-lx/FlowSpec

Continuous Pipelined Speculative Decoding

22

cychomatica/FreeDave

[NeurIPS 2026] Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large…

24

pablo-labo/specdiff_aoi

0