Shadowgraph
About
Sign in
← Papers

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism

ACM:3694715.3695948 · 1 repo reference this paper in their README

ModelTC/lightllm

4,270

·

+0

·

Python

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for…