NVIDIA/GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice…

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps,…

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

sjmach/artificial-intelligence

A repository for A.I. projects

paguasmar/veloxml-deploy

Deploy LLMs to production in one command. VeloxML CLI is an open-source engine that provisions…

lancedb/vectordb-recipes

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

liangruibupt/aws-is-how

Know How Guide and Hands on Guide for AWS

dusty-nv/NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language…