---

A curated, phase-based roadmap for mastering generative AI -- from mathematical foundations to production systems. Every resource has been hand-picked for quality and organized so you know exactly what to learn next.

Features

• Phase-based progression -- 4 color-coded phases, 16 tracks, each building on the last
• Level filtering -- Filter by Beginner, Intermediate, or Advanced to find your entry point
• Integrated doc viewer -- Click any doc link to read guides in a slide-over sidebar with prev/next navigation
• Progress tracking -- Check off resources as you complete them; all data is saved to localStorage
• Dashboard -- See tracks started, completion percentage, and resume your last-accessed track
• Dark mode -- Automatic system preference detection with manual toggle
• Responsive -- Works on desktop, tablet, and mobile

Quick start

1. Open the interactive app in your browser
2. Browse the four phases, expand a phase to see its tracks
3. Click a track card to reveal its resources
4. Use the level filter (All / Beginner / Intermediate / Advanced) to narrow down
5. Click doc links to read guides in the built-in viewer
6. Check off resources as you complete them

The four phases

Preview

Phase 1: Foundations           Phase 2: Core LLM Engineering
  [Introduction] ▸ 7 resources   [LLM Engineering] ▸ 28 resources
  [Scientific Foundations] ▸ 13  [RAG Systems] ▸ 16
  [Machine Learning] ▸ 24        [AI Agents] ▸ 16
  [Deep Learning] ▸ 23

Phase 3: Production            Phase 4: Applied AI
  [LLMOps & Infrastructure] ▸14  [Multimodal AI] ▸ 16
  [Open Source AI Ecosystem] ▸10 [AI Product Engineering] ▸ 9
  [Enterprise AI Governance] ▸12 [Real-World Use Cases] ▸ 11
                                  [Tools & Frameworks] ▸ 18

+ Reasoning Models (Advanced, 8) | Coding AI & Dev Tools (Intermediate, 8)

Structure

data/
  resources.js          # Single source of truth for all tracks and resources
assets/
  app.js                # Application logic (sidebar viewer, progress, filters, theme)
  styles.css            # Styles with light + dark theme support
  hero-banner.svg       # README header image
docs/                   # Deep-dive guides for each track
index.html              # Interactive web app

---

Full resource catalog

Below is the original comprehensive resource listing for offline reference. All resources are also available in the interactive app with progress tracking, filters, and the built-in doc viewer.

🏁 Introduction

Welcome to the Generative AI Learning Roadmap! 🎉 This guide is a comprehensive resource, covering free courses, videos, articles, and books that will take you from the fundamentals of Machine Learning and NLP to the advanced world of Generative AI. Whether you're a beginner or an experienced AI enthusiast, this roadmap provides a structured path for deep learning.

🔗 Credits

This guide is curated from a collection of resources shared on LinkedIn, Twitter, and other social media channels, as well as suggestions from renowned educational institutions and leading AI organizations including Microsoft, OpenAI, Google, IBM, AWS, Stanford, Harvard, and more.

---

📚 Table of Contents

• Documentation Hub
• Beginner Level
• Intermediate Level
• Advanced Level
• Specialized Generative AI Courses
• LangChain and Prompt Engineering
• Advanced Reading & Research
• Additional Resources
  • A-Z of Machine Learning
  • Courses from DeepLearning.AI
  • Extra Resources
  • Books 📖
  • Articles 📝
• Contributing to this Guide
• Closing Notes

---

🧭 Documentation Hub

This README is the broad resource catalog. For a deeper, modular learning path, use the new docs folder:

• Docs Index
• README Deep Analysis
• Documentation Contribution Guide
• Roadmap v2 Overview

Recommended starting points:

• New learners: How to Use This Roadmap
• ML foundations: Machine Learning Foundations
• LLM builders: Transformers and Embeddings
• RAG builders: Retrieval-Augmented Generation
• Agent builders: AI Agents
• Production engineers: LLMOps and AI Infrastructure
• Enterprise teams: Enterprise AI Governance

---

🧑‍🏫 Beginner Level

Courses

• Python for Data Science, AI & Development -- IBM
  🔗 Course Link
  Description: Learn Python basics, data types, and functions for Data Science.

• Machine Learning Fundamentals -- Stanford University
  🔗 Course Link
  Description: Covers ML basics like linear regression, decision trees, and model evaluation.

• AI for Everyone -- DeepLearning.AI
  🔗 Course Link
  Description: An introduction to AI concepts, ethics, and applications, perfect for non-technical learners.

• Introduction to AI with Python -- Harvard University
  🔗 Course Link
  Description: A 7-week course covering AI technologies and machine learning basics.

Videos

• Mathematics for ML
  🎬 Watch Video
  Topics Covered: Linear algebra, calculus, and foundational math for ML.

• Data Science Basics
  🎬 Watch Video
  Topics Covered: Core concepts in data science and ML fundamentals.

Books 📖

• "Python Crash Course" by Eric Matthes
  Description: A beginner-friendly introduction to Python, suitable for data science and AI applications.

---

🧑‍💻 Intermediate Level

Courses

• Neural Networks & Deep Learning -- DeepLearning.AI
  🔗 Course Link
  Description: Understand core architectures of neural networks and deep learning models.

• Data Science & ML -- Harvard University
  🔗 Course Link
  Description: Covers intermediate machine learning concepts, probability, and statistics.

• Generative AI with Large Language Models -- AWS
  🔗 Course Link
  Description: Build and deploy large language models (LLMs) with AWS resources.

Videos

• Training Embeddings for Recommendation Systems
  🎬 Watch Video
  Topics Covered: Key concepts in embeddings and their use in recommendation engines.

• Data Science: Visualization
  🎬 Watch Video
  Topics Covered: Visualizing data with Python libraries.

Books 📖

• "Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow" by Aurelien Geron
  Description: A practical guide for machine learning and deep learning with Python libraries.

---

🧑‍🔬 Advanced Level

Courses

• Advanced Machine Learning on Google Cloud Specialization -- Google
  🔗 Course Link
  Description: Covers advanced ML techniques, including model optimization and hyperparameter tuning.

• AI Workflow: Feature Engineering and Bias Detection -- IBM
  🔗 Course Link
  Description: Focuses on data preparation, bias detection, and model validation techniques.

• Supervised Machine Learning: Regression and Classification
  🔗 Course Link
  Description: An in-depth course on supervised ML techniques with applications in regression and classification.

Videos

• Deep Residual Learning for Image Recognition
  🎬 Watch Video
  Topics Covered: Understanding deep residual networks for image recognition tasks.

• Attention Mechanisms and Transformers
  🎬 Watch Video
  Topics Covered: Deep dive into attention mechanisms and transformer models.

Books 📖

• "Deep Learning" by Ian Goodfellow, Yoshua Bengio, and Aaron Courville
  Description: A comprehensive resource for deep learning concepts, covering theory and applications.

---

🌟 Specialized Generative AI Courses

Google

• LLMOps -- Google Cloud & DeepLearning.AI
  🔗 Course Link
  Description: Learn LLM operations, from pre-processing to model deployment.

Microsoft

• Generative AI for Data Analysis Professional Certificate
  🔗 Course Link
  Description: Covering data analysis and generative AI with real-world applications.

OpenAI

• ChatGPT Prompt Engineering for Devs
  🔗 Course Link
  Description: OpenAI's specialized course on prompt engineering for conversational AI models.

Gemini

• Understanding Responsible AI -- Gemini AI Lab
  🔗 Course Link
  Description: Focuses on responsible and ethical AI practices.

GitHub - Awesome Generative AI

• Awesome Generative AI Guide -- Aishwarya Reganti
  🔗 Course Link
  Description: A curated list of resources, tools, papers, and tutorials on generative AI. This guide covers topics like large language models (LLMs), prompt engineering, diffusion models, and more. Perfect for learners at all levels seeking structured and high-quality AI content.

GitHub - LLM Mastery

• LLM Mastery In 30 Days -- Vasanth51430
  🔗 Course Link
  Description: A comprehensive 30-day roadmap to master Large Language Models (LLMs). This resource guides learners through NLP fundamentals, transformer models, fine-tuning, and deploying LLMs in real-world applications. Perfect for those looking for structured learning on LLMs and prompt engineering.

---

💡 LangChain and Prompt Engineering

• LangChain Prompt Templates
  🔗 Course Link
  Description: Building and applying prompt templates in LangChain.

• LangChain ChatBots Memory
  🔗 Docs Link
  Description: Official LangChain and LangGraph memory concepts for short-term and long-term agent memory.

---

📚 Advanced Reading & Research

Ilya Sutskever's Top 30 Reading List

This section includes influential research papers and readings recommended by Ilya Sutskever, a pioneer in the AI and machine learning field. These papers are foundational for understanding neural networks, LSTMs, and other advanced AI concepts.

1. The First Law of Complexodynamics -- Scott Aaronson
2. The Unreasonable Effectiveness of Recurrent Neural Networks -- Andrej Karpathy
3. Understanding LSTM Networks -- Christopher Olah
4. Recurrent Neural Network Regularization -- Zaremba et al.
5. Keeping Neural Networks Simple by Minimizing the Description Length of the Weights -- Hinton & van Camp
6. Pointer Networks -- Vinyals et al.
7. ImageNet Classification with Deep Convolutional Neural Networks -- Krizhevsky et al. (AlexNet)
8. Order Matters: Sequence to Sequence for Sets -- Vinyals et al.
9. GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism -- Huang et al.
10. Deep Residual Learning for Image Recognition -- He et al. (ResNet)
11. Multi-Scale Context Aggregation by Dilated Convolutions -- Yu & Koltun
12. Neural Message Passing for Quantum Chemistry -- Gilmer et al.
13. Attention is All You Need -- Vaswani et al. (Transformer)
14. Neural Machine Translation by Jointly Learning to Align and Translate -- Bahdanau et al. (Attention)
15. Identity Mappings in Deep Residual Networks -- He et al.
16. A Simple Neural Network Module for Relational Reasoning -- Santoro et al.
17. Variational Lossy Autoencoder -- Chen et al.
18. Relational Recurrent Neural Networks -- Santoro et al.
19. Quantifying the Rise and Fall of Complexity in Closed Systems: the Coffee Automaton -- Aaronson et al.
20. Neural Turing Machines -- Graves et al.
21. Deep Speech 2: End-to-End Speech Recognition in English and Mandarin -- Amodei et al.
22. Scaling Laws for Neural Language Models -- Kaplan et al.
23. A Tutorial Introduction to the Minimum Description Length Principle -- Grunwald
24. Machine Super Intelligence -- Shane Legg (PhD thesis)
25. Kolmogorov Complexity and Algorithmic Randomness -- Shen, Uspensky, Vereshchagin
26. Stanford's CS231n Convolutional Neural Networks for Visual Recognition -- Stanford / Fei-Fei Li et al.
27. Dense Passage Retriever (DPR) -- Karpukhin et al.
28. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks -- Lewis et al. (RAG)
29. Zephyr: Direct Distillation of LM Alignment -- Tunstall et al.
30. Lost in the Middle: How Language Models Use Long Contexts -- Liu et al.

---

📘 Additional Resources

🔹 A-Z of Machine Learning

• 🎯 Mathematics for ML
• 🎯 Linear Regression
• 🎯 Logistic Regression
• 🎯 Data Science Basics, Alternative Link
• 🎯 Isotonic Regression
• 🎯 ML Metrics for Classification
• 🎯 Categorical Variable Encoding Strategies
• 🎯 Naive Bayes Classifier
• 🎯 Dimensionality Reduction (PCA, AutoEncoders)
• 🎯 Entropy, Cross-Entropy, KL-Divergence
• 🎯 Probability, Model Calibration
• 🎯 Data Drift Detection, Model Monitoring
• 🎯 Dynamic Pricing in Ecommerce
• 🎯 Training Embeddings for Recommendation Systems
• 🎯 ANN in Recsys (Annoy)
• 🎯 ANN in Recsys (Product Quantizer)
• 🎯 Model-Based Recommendations @ Twitter
• 🎯 PID Controller for Diversity in Recommender Systems
• 🎯 Instagram's Recommendation System
• 🎯 Train Neural Networks to Approximate Any Function
• 🎯 BERT for Embeddings
• 🎯 Twitter's Recommendation Algorithm
• 🎯 Model Compression with Knowledge Distillation
• 🎯 Conversational AI (Chat-GPT)
• 🎯 Dual Nature of Conversational LLMs
• 🎯 Enhancing LLMs
• 🎯 Falcon & LLAMA-2, Second Video
• 🎯 Supercharging LLama-2 & Falcon, Alternate Link
• 🎯 SRKGPT AI with Shahrukh Khan's Style
• 🎯 LinkedIn's CTR Modeling
• 🎯 Meituan's Two-Tower Recsys Model
• 🎯 Twitter & Instagram Recommender Systems
• 🎯 Scalable Query-Item Two-Tower Model
• 🎯 Overcoming Biases in Recsys
• 🎯 Evolution of Recsys
• 🎯 Multi-Armed Bandit Strategies
• 🎯 Uplift Modeling to Detect Causal Effect
• 🎯 Netflix's Unified Recommendation ML Model
• 🎯 Netflix's Calibrated Recommendations
• 🎯 Intro to GANs & Stable Diffusion
• 🎯 PySpark Essentials
• 🎯 LinkedIn's Budget Pacing for Targeted Ads
• 🎯 Detecting Buyer-side Returns Fraud
• 🎯 ML System to Combat Counterfeit Fraud in E-Commerce
• 🎯 Transparent Machine Learning with GenAI
• 🎯 Pinterest Ranking: GBDT to Deep Learning

🔹 Courses from DeepLearning.AI

• AI for Everyone
• Generative AI with Large Language Models
• Deep Learning Specialization
• Structuring Machine Learning Projects
• Improving Deep Neural Networks
• AI for Medicine
• Natural Language Processing Specialization
• Generative Adversarial Networks
• AI for Good

🔹 Extra Resources

• 📚 Stanford CS229: Building Large Language Models
• 🎓 Learn Generative AI in 21 Hours
• 🎥 NVIDIA Online Courses
• 🧠 LLM Evaluation
• 📝 Awesome Generative AI Guide

---

📖 Books 📖

1. "Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play" by David Foster
   Description: A guide to generative models and their applications in creative fields.

2. "Natural Language Processing with Transformers" by Lewis Tunstall, Leandro von Werra, and Thomas Wolf
   Description: Practical guide to working with transformer-based NLP models.

3. "The Hundred-Page Machine Learning Book" by Andriy Burkov
   Description: A concise yet comprehensive overview of machine learning concepts.

4. "Machine Learning Yearning" by Andrew Ng
   Description: Free book offering insights into how to structure ML projects effectively.

---

📝 Articles 📝

• "Attention is All You Need"
  📄 Read Article
  Description: Foundational paper on the Transformer model, revolutionizing NLP.

• "Understanding LSTMs" by Christopher Olah
  📄 Read Article
  Description: An illustrated guide to Long Short-Term Memory (LSTM) networks.

• "Scaling Laws for Neural Language Models"
  📄 Read Article
  Description: Research on scaling language models and their impacts on performance.

---

📊 Categorized Resources

Machine Learning

Statistics

Generative AI

Programming

LangChain and Prompt Engineering

Other Specialized Topics

---

📈 Closing Notes

This roadmap is designed to help learners advance through different levels of understanding in Generative AI. Be consistent in your learning, practice regularly, and make the most of the amazing free resources available. Enjoy your journey toward becoming a Generative AI expert! 😄

---

Contributing

Contributions are welcome -- whether it is adding a resource, fixing a link, or improving the documentation.

See the contribution guide to get started.

---