break-into-data/ai-engineer-toolkit

Projects & Resources to help you become a better AI Developer.

TypeScript

2,192

75 commits

updated Sep 15, 2025

See the code

README

AI Engineer Toolkit 🛠️

Welcome to the AI Engineer Toolkit!

Designed to help software engineers and non-engineers build production-grade AI applications from scratch.

You will find every popular framework, tool, and resource to ship one AI project at a time!

Getting Started

If you want to learn Agent Engineering Fundamentals, check out Full stack Agent Engineer Fundementals
If you are new to AI engineering check out AI Engineering Fundementals
If you are new to software engineering check out SWE Fundamentals
If you need inspiration, check out example projects inside the sandbox.
If you are ready to build, check out the table below.
If you want more guidance, check out the upcoming Agent Engineering Bootcamp that starts on June 12th, 2025.

Tools & Resources for AI Engineers 🏗️

Explore the table below to find the right tools for your AI projects.
Each category includes cost details, use cases, and links to official documentation.

Category	Tool Name	Cost Model	Use Case	Link
😎 Model Providers
	OpenAI API	Paid API	GPT models	OpenAI
	Grok (xAI)	Paid API	Human-like reasoning for complex queries	Grok
	Google Gemini	Paid API	Multimodal AI for text and images	Gemini
	Hugging Face	Freemium	Open-source models and hosted inference	Hugging Face
	Anthropic Claude	Paid API	Safe, interpretable language models	Claude
📝 Prompt Engineering
	DSPy	Open-Source	Automate prompt optimization with code	DSPy
	LangChain	Open-Source	Build prompt-driven AI workflows	LangChain
	Haystack	Open-Source	Optimize prompts for RAG pipelines	Haystack
	Agenta	Open-Source	Experiment and deploy prompt variants	Agenta
⚙️ Backend
	FastAPI	Open-Source	Fast, modern Python APIs	FastAPI
	Flask	Open-Source	Lightweight web apps and APIs	Flask
	Django	Open-Source	Robust web framework with ORM	Django
	Node.js (Express)	Open-Source	Scalable backend with JavaScript	Express
💻 Frontend
	AI SDK (Vercel)	Open-Source	AI-ready UI components for React	AI SDK
	Streamlit	Open-Source	Rapid prototyping for data apps	Streamlit
	Gradio	Open-Source	Interactive ML model interfaces	Gradio
	Dash	Open-Source	Data-driven dashboards with Python	Dash
🎈 Fullstack
	Next.js	Open-Source	React with SSR and built-in API routes	Next.js
	SvelteKit	Open-Source	Lightweight full-stack with Svelte	SvelteKit
	Nuxt.js	Open-Source	Vue.js with server-side rendering	Nuxt.js
	Meteor	Open-Source	Full-stack JavaScript framework	Meteor
📀 Databases
	Supabase	Freemium	Open-source Firebase alternative	Supabase
	PostgreSQL	Open-Source	Reliable relational database	PostgreSQL
	MongoDB	Open-Source	Flexible NoSQL for unstructured data	MongoDB
	SQLite	Open-Source	Lightweight, serverless database	SQLite
🔢 Vector Databases
	ChromaDB	Open-Source	Simple vector store for embeddings	ChromaDB
	Pinecone	Paid API	Scalable, hosted vector search	Pinecone
	Weaviate	Open-Source	GraphQL-based vector database	Weaviate
	Qdrant	Open-Source	High-performance vector search	Qdrant
📻 Fine-tuning
	OpenAI Fine-Tuning	Paid API	Customize GPT models for your needs	OpenAI Fine-Tuning
	Hugging Face Trainer	Open-Source	Fine-tune transformers easily	Hugging Face Trainer
	Ludwig	Open-Source	Declarative fine-tuning for ML models	Ludwig
	PyTorch Lightning	Open-Source	Structured fine-tuning with PyTorch	PyTorch Lightning
🤖 Agent Development
	LangGraph	Open-Source	Stateful agents with LangChain	LangGraph
	AG2 (AgentGraph)	Open-Source	Multi-agent orchestrators	AG2
	CrewAI	Open-Source	Multi-agent workflows for automation	CrewAI
	AutoGen	Open-Source	Conversational agents with flexibility	AutoGen
	Wetrocloud	Paid API	RAG development with any resource type (YouTube, web, doc, json, etc.)	Wetrocloud
	Contextual AI	Paid API	End-to-end RAG including document understanding, retrieval, grounded generation, and evaluation	Contextual AI
🕸️ Web Data Access
	Firecrawl	Freemium	Web scraping with caching	Firecrawl
	Jina AI Reader API	Freemium	Extract structured data from web pages	Jina AI
	Puppeteer	Open-Source	Dynamic content scraping via browser	Puppeteer
	Crawlee-Python	Open-Source	A web scraping and browser automation library to build reliable crawlers in Python	Crawlee-Python
🤔 Evaluation Frameworks
	RAGAS	Open-Source	Evaluate RAG pipelines	RAGAS
	DeepEval	Open-Source	Custom metrics for LLM evaluation	DeepEval
	LangSmith	Freemium	Debug and evaluate LLM apps	LangSmith
	TruLens	Open-Source	Ground truth evaluation for LLMs	TruLens
	AgentEvals	Open-source	A collection of evaluators for agent steps	AgentEvals
	LMUnit	Open-source	Language model optimized for evaluating natural language unit tests	LMUnit
📊 Monitoring & Logging
	LangSmith	Freemium	Monitor and trace LLM applications	LangSmith
	Sentry	Freemium	Real-time error tracking	Sentry
	Prometheus	Open-Source	Metrics and alerting for systems	Prometheus
	Grafana	Open-Source	Visualize logs and metrics	Grafana
🔊 Audio
	Whisper (OpenAI)	Open-Source	High-accuracy speech-to-text	Whisper
	DeepSpeech	Open-Source	End-to-end speech recognition	DeepSpeech
	Coqui TTS	Open-Source	Text-to-speech with diverse voices	Coqui TTS
	SpeechBrain	Open-Source	All-in-one audio processing toolkit	SpeechBrain
👀 Vision
	YOLO	Open-Source	Real-time object detection	YOLO
	OpenCV	Open-Source	Versatile computer vision library	OpenCV
	Detectron2	Open-Source	Advanced detection and segmentation	Detectron2
	CLIP (OpenAI)	Open-Source	Image-text understanding and search	CLIP
🚀 Deployment Tools
	Vercel	Freemium	Deploy full-stack apps with ease	Vercel
	Docker	Open-Source	Containerize apps for consistent deployment	Docker
	Kubernetes	Open-Source	Orchestrate and scale containerized apps	Kubernetes
	Heroku	Freemium	Quick deployment for prototypes and MVPs	Heroku
	Render	Freemium	Build, deploy, and scale your apps with ease	Render

Significant stargazers

Bharat Raghunathan

129 followers · starred Mar 2025

Gyan Prakash

634 followers · starred May 2025

Argenis De La Rosa

298 followers · starred Mar 2025

Shu xian

271 followers · starred Jun 2025

Similar repos

Sumanth077/ai-engineering-toolkit

A curated list of 100+ libraries and frameworks for AI engineers building with LLMs

3,396

hades217/awesome-ai

A curated list of artificial intelligence resources (Courses, Tools, App, Open Source Project)

554

fahimar/awesome-ai-engineering

Curated AI Agents, Automation & Engineering resources — each with a concrete first step on how to…

business-science/awesome-generative-ai-data-scientist

A curated list of 100+ resources for building and deploying generative AI specifically focusing on…

1,601

eudk/awesome-ai-tools

🔴 VERY LARGE AI TOOL LIST! 🔴 Curated list of AI Tools - Updated 2026

599

caramaschiHG/awesome-ai-agents-2026

🤖 The most comprehensive list of AI agents, frameworks & tools in 2026. 300+ resources · 20+…

1,943

potpie-ai/AI-COSS

List of Agentic commercial and open-source software in 2025

178

tayyabimam1/awesome-ai-agent-stack

Curated map of 3,000+ open-source AI agent tools: coding agents, agent frameworks, MCP servers,…