Cluster 438928

10 repos

Go · 7

C++ · 1

Rust · 1

Shell · 1

kubernetes ·29,293

ai-gateway ·23,997

api-gateway ·21,291

ai ·20,274

envoy ·16,484

inference ·15,522

llm ·14,330

cloud-native ·9,365

ai-native ·9,365

gateway-api ·7,832

Related clusters

Kubernetes Operators and Cloud-Native Infrastructure21 Envoy proxy and service mesh infrastructure15 LLM Inference Optimization & Serving15 GPU-Accelerated ML & CUDA Kernels37 Cluster 46217735 LLM Serving and Inference Optimization36

envoyproxy/ai-gateway

Manages Unified Access to Generative AI Services built on Envoy Gateway

2,047

1,565 commits

theagentrouter/agent-router

Manages Unified Access to Generative AI Services built on Envoy Gateway

2,047

1,574 commits

envoyproxy/gateway

Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway

3,025

4,781 commits

vllm-project/semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference

5,731

1,824 commits

agentgateway/agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

Rust

4,807

2,533 commits

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

Shell

4,505

1,326 commits

higress-group/higress

🤖 AI Gateway | AI Native API Gateway

9,365

1,836 commits

openvinotoolkit/model_server

A scalable inference server for models optimized with OpenVINO™

C++

929

3,606 commits

ai-dynamo/grove

Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling

263

416 commits

volcano-sh/volcano

A Cloud Native Batch System (Project under CNCF)

5,939

5,946 commits