Hermit-w/SpecInfer

My own simple framework to implement speculative decode

0

stars

72

commits

Python

primary language

Feb 6, 2026

updated

README

SpecInfer

My own simple framework to implement speculative decode

Contributors

72 commits

Similar repos

ziglang/zig-spec

225

cadentj/autointerp

3

joshualu777/LLM-SpecDec

1

tianhaoz95/spec-dllm

0

mv302/faer-synesis

0

Prathmesh234/simple-inference-autoresearch

Simple inference scaffolding + autoresearch

0

Prathmesh234/simple-inference

Simple inference engine for llama from first principles

0

kavin525zhang/LLM_reasoning_framework

1

Languages

Python

99.4%

Hermit-w/SpecInfer

My own simple framework to implement speculative decode

0

stars

72

commits

Python

primary language

Feb 6, 2026

updated

README

SpecInfer

My own simple framework to implement speculative decode

Similar repos

ziglang/zig-spec

225

cadentj/autointerp

3

joshualu777/LLM-SpecDec

1

tianhaoz95/spec-dllm

0

mv302/faer-synesis

0

Prathmesh234/simple-inference-autoresearch

Simple inference scaffolding + autoresearch

0

Prathmesh234/simple-inference

Simple inference engine for llama from first principles

0

kavin525zhang/LLM_reasoning_framework

1

Contributors

72 commits

Languages

Python

99.4%