Shadowgraph
About
Sign in
← Papers

Past-Future Scheduler for LLM Serving under SLA Guarantees

ACM:3676641.3716011 · 1 repo reference this paper in their README

ModelTC/lightllm

4,280

·

+10

·

Python

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for…