arXiv:2406.18665 · 2 repos reference this paper in their README
lm-sys/RouteLLM
5,476
·
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
anyscale/llm-router
258
Tutorial for building LLM router
