⚡️ LLM Agents and DevTools

This is a curated list of autonomous agents and developer tools powered by LLM.

• Agents
• Agent Platforms
• App Generators
• Coding Assistants
• Cognitive Architectures
• Digital Humans
• Documentation
• Embodied AI
• Evaluation
• Foundation Models
• IDEs
• Knowledge Bases
• LLMOps
• OpenAI Plugins
• PR Agents
• Prompts Tuning
• Reasoning and Planning
• Research
• Search
• Security
• Shell Assistants
• Training & Deployment

Agents

• Adala - Autonomous DAta (Labeling) Agent framework.
• AgentGPT - 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
• AutoGPT — An experimental open-source attempt to make GPT-4 fully autonomous.
• BabyAGI — An AI-powered task management system.
• BambooAI - A lightweight library that leverages Language Models (LLMs) to enable natural language interactions, allowing you to source and converse with data.
• BlockAGI - Your Self-Hosted, Hackable Research Agent Inspired by AutoGPT.
• CAMEL - Communicative Agents for “Mind” Exploration of Large Scale Language Model Society.
• Chat-Haruhi-Suzumiya - Reviving Anime Character in Reality via Large Language Model.
• DB-GPT - by TsinghuaDatabaseGroup. LLM As Database Administrator.
• DB-GPT - by eosphoros-ai. Revolutionizing Database Interactions with Private LLM Technology.
• Data-Copilot - Bridging Billions of Data and Humans with Autonomous Workflow.
• DemoGPT — Auto Gen-AI App Generator with the Power of Llama 2
• DevOpsGPT - DevOpsGPT: AI-Driven Software Development Automation Solution
• Factory — Agents for code generation. Waitlisted.
• GPT Engineer — CLI agent that generates a repository from a prompt, and asks clarifying questions.
• GPT Migrate — CLI agent that converts a full-stack application from one language or framework to another. Uses GPT-4 32k context.
• GeneralAgent - A simple, general, customizable Agent Framework.
• GitWit — Web-based agent for adding features to full-stack apps in Git repositories.
• Gorilla - Large Language Model Connected with Massive APIs.
• Grit - GitHub-integrated agent for automating maintenance tasks and other development work.
• HyperWrite - Personal Assistant — AI Agent
• Muzic - Music Understanding and Generation with Artificial Intelligence.
• SalesGPT - Context-aware AI Sales Agent to automate sales outreach.
• Second.dev — A platform for adding features to full-stack apps.
• ShortGPT - Experimental AI framework for automated short/video content creation.
• Smol Developer — CLI agent that generates a repository from a prompt. Uses OpenAI and Anthropic.
• Teenage-AGI - Use OpenAI and Pinecone to Give memory to an AI agent and also allows it to "think" before making an action (outputting text)
• Transformers Agent - HuggingFace Transformers Agent offer a natural language API built on transformers and a curated set of tools. An agent interprets user natural language input & use tools to fulfil the user request.
• WebArena - A Realistic Web Environment for Building Autonomous Agents.
• automata - Automata's objective is to evolve into a fully autonomous, self-programming Artificial Intelligence system.
• beebot - An Autonomous AI Agent that works.
• gpt-researcher - GPT based autonomous agent that does online comprehensive research on any given topic.
• gpt_academic - 为 ChatGPT/GLM 提供图形交互界面，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持 Python 和 C++等项目剖析&自译解功能，PDF/LaTex 论文翻译&总结功能，支持并行问询多种 LLM 模型，支持 chatglm2 等本地模型。兼容文心一言, moss, llama2, rwkv, claude2, 通义千问, 书生, 讯飞星火等。
• lemon-agent - Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation.
• loopgpt - A re-implementation of the popular Auto-GPT project as a proper python package, written with modularity and extensibility in mind.
• mini-agi - A minimal general-purpose autonomous agent based on GPT-3.5 / GPT-4. Can analyze stock prices, perform network security tests, create art, and order pizza.
• rci-agent - RCI Agent for MiniWoB++
• talk - Talk with ChatGPT using your VOICE

Agent Platforms

• AgentBench - A Comprehensive Benchmark to Evaluate LLMs as Agents.
• AutoAgents - Generate different roles for GPTs to form a collaborative entity for complex tasks.
• AutoGen - Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework.
• BOLAA - Benchmarking and Orchestrating LLM-augmented Autonomous Agents.
• E2B — Open source cloud platform for hosting LLM-based agents. Supports Smol Developer.
• GeniA - Your Engineering Gen AI Team member 🧬🤖💻
• Gentopia - Build AGI through Interaction of Specialized Agents.
• JARVIS - A system to connect LLMs with ML community.
• LLM-ToolMaker - Large Language Models as Tool Makers.
• OpenAGI - An open-source AGI research platform, specifically designed to offer complex, multi-step tasks and accompanied by task-specific datasets, evaluation metrics, and a diverse range of extensible models.
• OpenAgents - An Open Platform for Language Agents in the Wild
• PromethAI-Backend - Open-source framework that gives you AI Agents that help you navigate decision-making, get personalized goals and execute them.
• SuperAGI Open source platform for hosting LLM-based agents including SuperCoder.
• Superagent - Build, deploy, and manage LLM-powered agents.
• ToolBench - An open platform for training, serving, and evaluating large language model for tool learning.
• XAgent - An Autonomous LLM Agent for Complex Task Solving.
• YYLO - Command-line orchestrator for coding agents with typed task, validation, merge, and release-readiness boundaries; task start creates a dedicated branch/worktree and the merge queue owns risk-based review.
• agents - An Open-source Framework for Autonomous Language Agents.
• ai-legion - An LLM-powered autonomous agent platform.
• chidori - A reactive runtime for building durable AI agents.
• databerry - The no-code platform for building custom LLM Agents.
• issue-orchestrator - Orchestrates Claude, Codex, and Gemini agents across GitHub issues in isolated worktrees, with enforced validation/review gates, crash recovery, and human merge authority.
• ix - Autonomous GPT-4 agent platform.
• lagent - A lightweight framework for building LLM-based agents.
• openagent - Microservices approach to AGI. Modular components for AI apps or AGI agents. (... and solving some wicked LLM problems like ⚡ 2X faster LLaMA 2)
• rivet - AI agent and prompt chaining IDE and library.
• semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps.
• smart_agent - An open-source project offering a comprehensive library for deconstructing complex tasks and dispatching functions within a toolkit.
• toolformer-pytorch - Language Models That Can Use Tools, by MetaAI.
• workgpt - A GPT agent framework for invoking APIs.

App Generators

• GPT Pilot - Code out the entire app as you oversee the code being written.
• Literally anything - HTML and JavaScript web app generator.
• OpenCopilot - AI Copilot for your own SaaS product. Open source AI sidekick for everyone.
• Pico - End-to-end micro app generator with instant deployment.
• gpt-pilot - PoC for a scalable dev tool that writes entire apps from scratch while the developer oversees the implementation.
• react-agent - The open-source React.js Autonomous LLM Agent.
• textbase - A simple framework for building AI chatbots.
• wasp - The fastest way to develop full-stack web apps with React & Node.js.

Coding Assistants

• AI Code Convert — A web tool for translating code between programming languages.
• AI Code Playground — CodeChain is a web tool for refactoring and improving code.
• API Copilot — Assistant for backend API development.
• Adrenaline - Web-based chatbot using AI and ASTs to answer questions about your codebase.
• Amazon CodeWhisperer - An AI coding companion that generates whole line and full function code suggestions in your IDE to help you get more done faster.
• Bito AI — Bito is powered by OpenAI's ChatGPT and GPT-4, which revolutionizes the way developers write code. Generate high-quality AI-powered code, AI-assisted code completion, optimize code performance, explain complex code snippets, generate unit tests, and more – all effortlessly.
• Blackbox — VS Code extension with autocomplete and chat including links to online coding references.
• CodeApex - A bilingual programming evaluation benchmark for Large Language Models.
• CodeGeeX Open source assistant based on the CodeGeeX LLM with chat, completion, and refactoring. Extensions for 9 editors including VS Code, and PyCharm.
• CodeMate — VS Code extension for debugging and optimizing code.
• CodePal — A web tool for quickly generating or refactoring code.
• CodeSquire — Chrome extension that adds autocomplete to Google Colab, BigQuery, and JupyterLab.
• Codeium — Assistant with autocomplete, natural language search and chat. Extensions for 21 editors including VS Code, JetBrains, Neovim, Vim, Emacs, Eclipse, PyCharm, and Xcode. Enterprise version includes codebase-specific fine-tuning.
• Continue — VS Code extension with chat, refactor, and code generation. Edits multiple files and runs commands on your behalf.
• Genie AI — A Visual Studio Code - ChatGPT Integration. Supports GPT-4, GPT3.5, GPT3 and Codex models. Create new files, view diffs with one click; your copilot to learn code, add tests, find bugs and more.
• GitHub Copilot X — A VS Code extension with chat, pull request text generation, and unit test generation.
• Incognito Pilot — Open source assistant with built-in Python editor and interpreter.
• Magnet — Web-based chatbot with repositories and issues as context.
• Quack AI — VS Code extension for adhering to project coding guidelines. Waitlist.
• Refact — Open-Source Coding Assistant with Fine-Tuning on codebase, autocompletion, code refactoring, code analysis, integrated chat and more!
• Replit Ghostwriter Chat — Assistant built into Replit with chat, proactive debugging, and autocomplete. Uses OpenAI for chat and replit-code-v1-3b (OS) for autocomplete.
• Rift - An AI-native language server for your personal AI software engineer.
• Source Graph Cody - Assistant with chat, refactoring, and unit test generation. Extensions for VS Code and IntelliJ. Also available as a web app.
• Tabby — Open source, self-hosted code completion assistant. Extensions for VS Code and Vim.
• Tabnine (Source) — Open source, self-hosted code completion assistant. Extensions for 15 editors including VS Code, IntelliJ, Neovim, Eclipse, and PyCharm.
• ai-jsx - The AI Application Framework for Javascript.
• ax - A comprehensive AI framework for TypeScript.
• clippinator - AI programming assistant.
• codeinterpreter-api - Open source implementation of the ChatGPT Code Interpreter 👾
• cody - AI that knows your entire codebase.
• evalgpt - An code interpreter framework that utilizes large language models to automate the process of code-writing and execution, delivering precise results for user-defined tasks.
• gpt-migrate - Easily migrate your codebase from one framework or language to another.
• open-interpreter - OpenAI's Code Interpreter in your terminal, running locally.
• talk-codebase - CLI chatbot with repository as context. Supports OpenAI as well as locally running LLMs via GPT4All.

Cognitive Architectures

• ACT-R - Adaptive Control of Thought—Rational.
• CoALA - Cognitive Architectures for Language Agents.
• MemGPT - Teaching LLMs memory management for unbounded context 📚🦙
• Soar - A general cognitive architecture for systems that exhibit intelligent behavior.

Digital Humans

• GPT-vup - Live digital host for BIliBili/Tiktok.
• FaceChain - A deep-learning toolchain for generating your Digital-Twin.

Documentation

• Docify — A VS Code extension to generate docstrings.
• Mintlify Writer — A VS Code extension to generate docstrings.
• Trelent — A VS Code extension to generate docstrings. Uses proprietary models.
• gpt-author - Utilize a chain of GPT-4, Stable Diffusion, and Anthropic API calls to generate an original fantasy novel.

Embodied AI

• AgentSims - An easy-to-use infrastructure for researchers from all disciplines to test the specific capacities they are interested in.
• AgentVerse - A flexible framework that simplifies the process of building custom multi-agent environments for large language models (LLMs).
• ChatArena - A Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
• ChatDev - Create Customized Software using Natural Language Idea (through Multi-Agent Collaboration)
• GPTeam - An open-source multi-agent simulation.
• Generative Agents - Interactive Simulacra of Human Behavior.
• GeniA - Your Engineering Gen AI Team member 🧬🤖💻
• HumanoidAgents - Humanoid Agents: Platform for Simulating Human-like Generative Agents.
• LASER - LLM Agent with State-Space Exploration for Web Navigation.
• MetaGPT — The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo.
• Mind2Web - Towards a Generalist Agent for the Web.
• MindAgent - Emergent Gaming Interaction.
• RT-2 - Robotic Transformer 2 (RT-2): The Vision-Language-Action Model.
• RoboAgent - Towards Sample Efficient Robot Manipulation with Semantic Augmentations and Action Chunking.
• VoxPoser - Composable 3D Value Maps for Robotic Manipulation with Language Models
• Voyager - An Open-Ended Embodied Agent with Large Language Models.
• ai-town - A deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.
• aloha - A Low-cost Open-source Hardware System for Bimanual Teleoperation.
• dev-gpt - Your Virtual Development Team.

Evaluation

• ClawBench - A benchmark and harness for evaluating AI web agents on 283 real-world tasks across live websites with replayable execution traces.
• GPT-Fathom - Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond.
• InstructEval - Evaluation suite for the systematic evaluation of instruction selection methods.
• SmartPlay - A benchmark for Large Language Models (LLMs). It is designed to be easy to use, and to provide a wide variety of games to test agents on.
• YYLO Benchmark - Longitudinal evaluation and immutable evidence for agent runs: task prompts execute in private fresh-repository attempt workspaces, judged by deterministic commands and configurable LLM judges, with receipts, manifests, and provenance hashes retained as evidence.
• instruct-eval - Quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Foundation Models

• CodeGeeX2 - A More Powerful Multilingual Code Generation Model.
• CodeGen - A family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
• CodeLlama - A family of large language models for code based on Llama 2 providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks.
• DeepSeek-Coder - Let the Code Write Itself.
• LM Studio - Discover, download, and run local LLMs
• MAmmoTH - Building Math Generalist Models through Hybrid Instruction Tuning.
• MFTCoder - An open-source project of CodeFuse for multitasking Code-LLMs(large language model for code tasks), which includes models, datasets, training codebases and inference guides.
• Magic — Company promising two products, an assistant and LTM-1, an underlying foundation model trained on code. Waitlist.
• MathGLM - GPT Can Solve Mathematical Problems Without a Calculator.
• Mistral-7B-v0.1
• NExT-GPT - Any-to-Any Multimodal Large Language Model.
• OpenChat - Advancing Open-source Language Models with Imperfect Data
• Phind-CodeLlama-34B-v1 - Beating GPT-4 on HumanEval with a Fine-Tuned CodeLlama-34B.
• StarCoder - A helpful coding assistant.
• TinyLlama - An open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
• WizardCoder - Empowering Code Large Language Models with Evol-Instruct.
• gpt4all - open-source LLM chatbots that you can run anywhere.
• gpt4free - The official gpt4free repository | various collection of powerful language models.
• incoder - A Generative Model for Code Infilling and Synthesis.
• litellm - Call all LLM APIs using the OpenAI format. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
• privateGPT - Interact privately with your documents using the power of GPT, 100% privately, no data leaks.
• replit-code-v1-3b - A 2.7B Causal Language Model focused on Code Completion.
• streaming-llm - Efficient Streaming Language Models with Attention Sinks.
• viper - ViperGPT: Visual Inference via Python Execution for Reasoning

IDEs

• CodeStory — An IDE with chat, code explanations, auto-generated commits and PR summaries. Forked from VSCodium.
• Cursor — An IDE with chat, edit, generate and debug features. Forked from VSCodium, so the interface is similar to VS Code. Uses OpenAI.
• Mutable — Web-based IDE, integrated with a chatbot and GitHub.

Knowledge Bases

• ALCE - Enabling Large Language Models to Generate Text with Citations.
• Langchain-Chatchat - Local knowledge based LLM (like ChatGLM) QA app with langchain.
• PDFTriage - Question Answering over Long, Structured Documents.
• Robby-chatbot - AI chatbot 🤖 for chat with CSV, PDF, TXT files 📄 and YTB videos 🎥 | using Langchain🦜 | OpenAI | Streamlit ⚡
• Verba - Retrieval Augmented Generation (RAG) chatbot powered by Weaviate.
• embedchain - Framework to easily create LLM powered bots over any dataset.
• gpt-runner - Conversations with your files! Manage and run your AI presets!
• khoj - An AI personal assistant for your digital brain. Khoj provides you with an easy way to setup the infrastructure to search and chat with your personal knowledge base, be it markdown, org, image, or PDF files.
• txtai - All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows.

LLMOps

• AGiXT - A dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers.
• Agent QA - Source-available QA agent for natural-language web and mobile tests, with persistent test memory, self-healing flows, and CLI/MCP interfaces.
• BrowserGPT - Command your browser with GPT.
• Carbonate — End-to-end testing using natural language. Integrates into your existing test suite (currently Jest, PHPUnit and Python's unittest).
• DiffBlue - Automatically generated unit tests for Java.
• LLMStack - No-code platform to build generative AI apps, chatbots and agents with your data.
• LocalAI - 🤖 Self-hosted, community-driven, local OpenAI compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. Free Open Source OpenAI alternative. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, gpt4all, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others.
• Meticulous.ai - Automatically generated, automatically maintained end-to-end tests: as your app evolves so does your test suite.
• OctoMind - Auto-maintenance and generated browser-based end-to-end-tests integrated into Github Actions, Azure DevOps and more.
• TaxyAI browser-extension - Automate your browser with GPT-4.
• Traceloop - Uses OpenTelemetry tracing data with generative AI to improve system reliability.
• haystack - 🔍 LLM orchestration framework to build customizable, production-ready LLM applications.
• helicone - An open-source observability platform for Language Learning Models (LLMs).
• langfuse - Open source observability and analytics for LLM applications.
• pezzo - 🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
• promptflow - Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
• zeno - AI Data Management & Evaluation Platform.

OpenAI Plugins

• ChatWithGit — Enables ChatGPT to search GitHub and return links to relevant repositories.
• Code ChatGPT Plugin — Open source example of a ChatGPT plugin that pulls context from a directory of files.

PR Agents

• AutoPR - Fix issues with AI-generated pull requests, powered by ChatGPT.
• BitBuilder — A GitHub integration to generate pull requests from issues.
• Code Review GPT — An open source tool for reviewing PRs. Works as GitHub action, Gitlab CLI or locally.
• CodeRabbit — Customizable CI to add summaries and code suggestions to PRs.
• Codeium PR Agent — Open source tool for automated code reviews.
• Nova - CI bot to add actions such as summaries and tests to new PRs.
• Sweep — AI junior dev: GitHub integration to generate, test, and self-review pull requests from issues.

Prompts Tuning

• Analogical Prompting - A new prompting approach designed to automatically guide the reasoning process of large language models.
• EvoPrompt - Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers.
• Fooocus - Focus on prompting and generating.
• LangGPT - LangGPT: Empowering everyone to become a prompt expert!🚀 Structured Prompt，结构化提示词。
• Prompt-Engineering-Guide - 🐙 Guides, papers, lecture, notebooks and resources for prompt engineering.
• YiVal - 🚀 From Demo to Production.🚀 YiVal is an open source GenAI-Ops framework that allows you to iteratively tune and evaluate your AIGC prompts, model metadata, model params, and retrieval configs all at once with your preferred choices of test dataset generation, evaluation algorithms and improvement strategies.
• guidance - A guidance language for controlling large language models.
• outlines - Generative Model Programming.
• prompttools - Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Reasoning and Planning

• AoT - Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models.
• CoD - From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting.
• CoT - Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.
• GoT - Graph of Thoughts: Solving Elaborate Problems with Large Language Models.
• ReAct - Synergizing Reasoning and Acting in Language Models.
• ReWOO - Decoupling Reasoning from Observations for Efficient Augmented Language Models.
• SCoT - Structured Chain-of-Thought Prompting for Code Generation.
• Screws -A Modular Framework for Reasoning with Revisions.
• SwiftSage - A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks.
• ToT - Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%.
• llm-reasoners - reasoning as planning (RAP), a library for advanced large language model reasoning.
• reflexion - Reflexion: Language Agents with Verbal Reinforcement Learning.
• saycan - Do As I Can, Not As I Say: Grounding Language in Robotic Affordances.
• self-ask - Measuring and Narrowing the Compositionality Gap in Language Models.

Research

• ArxivGPT - A Google Chrome plug-in that helps you quickly understand the content of arXiv papers.
• ChatPDF - Chat with any PDF using the new ChatGPT API.
• ChatPaper - Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用 chatgpt 进行论文全文总结+专业翻译+润色+审稿+审稿回复.
• ChemCrow - An open source package for the accurate solution of reasoning-intensive chemical tasks.
• OpenBBTerminal - OpenBB is committed to build the future of investment research by focusing on an open source infrastructure accessible to everyone, everywhere.
• gpt-researcher - GPT based autonomous agent that does online comprehensive research on any given topic.
• qlib - An AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions.
• Agon - Autonomous research system built on Prompt Economy, scaling scientist/coder/auditor loops across more than ten domains.

Security

• NeMo-Guardrails - An open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
• guardrails - An open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs).

Shell Assistants

• Aider — CLI assistant and agent that generates changes and commits to repositories. Uses OpenAI.
• AskCommand - Web based tool to generate Unix commands from text automatically using AI.
• Butterfish - CLI tool that embeds ChatGPT in your shell for easy access. Includes simple agentic capabilities.
• Mentat — CLI assistant and agent that makes changes to repositories.
• Shell-AI - LangChain powered shell command generate and run CLI.

Search

• Bloop — Natural language search for repositories.
• Buildt — Natural language search for repositories.
• Metaphor - A search engine designed from scratch using AI.
• PandasAI - A Python library that integrates generative artificial intelligence capabilities into pandas, making dataframes conversational.
• Perplexity - Unlock the power of knowledge with information discovery and sharing.

Training & Deployment

• HCP-Diffusion - A universal Stable-Diffusion toolbox.
• LMDeploy - A toolkit for compressing, deploying, and serving LLMs.
• Medusa - Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads.
• langchain-production-starter - Deploy LangChain Agents and connect them to Telegram.
• llm-applications - A comprehensive guide to building RAG-based LLM applications for production.
• ludwig - Low-code framework for building custom LLMs, neural networks, and other AI models.
• onprem - A tool for running on-premises large language models with non-public data.
• prompt2model - Generate Deployable Models from Natural Language Instructions.
• vllm - A high-throughput and memory-efficient inference and serving engine for LLMs.