LLM API Integration & Load Balancing
32 repos
Tools and libraries for integrating multiple large language model APIs (Claude, GPT, Gemini) into applications, with emphasis on load balancing, quota management, request routing, and cost optimization across different providers. The cluster spans implementation across Swift, Go, and JavaScript, ranging from proxy layers and API hubs to usage tracking and scaling utilities. Central projects like CLIProxyAPI-Quota-Inspector and gpt-load address the operational challenge of efficiently distributing requests across LLM endpoints while managing rate limits and budgets.
Go · 7
Swift · 7
JavaScript · 7
TypeScript · 3
Python · 3
Shell · 2
claude-code ·345,254
codex ·306,847
gemini ·146,342
openclaw ·143,629
opencode ·139,673
hermes ·137,584
claude ·135,967
ai-tools ·134,289
hermes-agent ·134,289
rust ·132,543
