Deprecated inference engine
See the codeThis repo is an artifact from the early days of OpenRouter, when the opensource LLM provider ecosystem was much more nascent. Early adopters wanted to chat with niche fine-tunes, so we built this with vllm to serve them.
No longer in use, but preserved here for historical purposes.
Check out the current models list here, or head over to our docs to learn more about our modern features for growing startups and enterprises alike.
908 followers · starred Jan 2025
1,697 followers · starred Jul 2025
645 followers · starred Sep 2024
292 followers · starred Aug 2025
Deprecated inference engine
See the codeThis repo is an artifact from the early days of OpenRouter, when the opensource LLM provider ecosystem was much more nascent. Early adopters wanted to chat with niche fine-tunes, so we built this with vllm to serve them.
No longer in use, but preserved here for historical purposes.
Check out the current models list here, or head over to our docs to learn more about our modern features for growing startups and enterprises alike.
908 followers · starred Jan 2025
1,697 followers · starred Jul 2025
645 followers · starred Sep 2024
292 followers · starred Aug 2025