LLM API gateways and cost management

16 repos

Tools and libraries for managing API calls to large language models across multiple providers (OpenAI, Anthropic, etc.), with a focus on cost tracking, budget enforcement, and request routing. The cluster includes gateway middleware, client libraries in TypeScript and Python, and observability tools that help teams control LLM spending and understand token usage patterns across different model providers.

TypeScript · 7
Python · 4
JavaScript · 1
Swift · 1
openai ·97,761
gemini ·86,168
anthropic ·85,685
chatgpt ·79,378
llm ·74,557
claude ·69,632
langchain ·60,627
ai-gateway ·58,335
llmops ·58,299
azure-openai ·58,297