arXiv:2402.02057 · 1 repo reference this paper in their README
hao-ai-lab/LookaheadDecoding
1,343
·
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
