LLM API Aggregation & Proxying

17 repos

Tools and services for routing requests to multiple large language model APIs through unified interfaces, including reverse proxies, API adapters, and gateway solutions that support providers like OpenAI, Deepseek, Gemini, and others. Most repos are Python-based backend services that abstract away provider-specific implementations, allowing developers to switch between or load-balance across different LLM providers with minimal code changes. The cluster includes both standalone proxy servers (one-api, new-api) and library-level solutions for LLM integration and model serving.

Python · 9
Go · 4
JavaScript · 1
Rust · 1
Svelte · 1
TypeScript · 1
openai ·387,190
llm ·185,616
mcp ·165,158
llms ·164,639
deepseek ·162,858
ai ·156,733
ollama ·153,314
self-hosted ·152,909
webui ·151,969
llm-ui ·151,679