arXiv:2305.10427 · 2 repos reference this paper in their README
hao-ai-lab/LookaheadDecoding
1,343
·
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
MasterGodzilla/LookAhead
0
No description