The Analytics Engineering Handbook

This repo has all the resources you need to become an amazing analytics engineer!

Getting Started

If you are new to analytics engineering, start by understanding what the role entails: analytics engineers sit at the intersection of data engineering and data analysis, building clean, tested, and documented data models that power business decisions.

For more applied learning:

• Check out the projects section for hands-on examples!
• Check out the interviews section for advice on how to pass analytics engineering interviews!
• Check out the books section for a list of high quality analytics engineering books
• Check out the communities section for a list of high quality analytics engineering communities to join
• Check out the newsletters section to learn via email

Resources

Great list of over 20 books

Top 3 must read books are:

• Analytics Engineering with SQL and dbt by Rui Machado & Hélder Russa
• The Data Warehouse Toolkit by Ralph Kimball
• Fundamentals of Data Engineering by Joe Reis & Matt Housley

Great list of communities to join:

Top must-join communities for Analytics Engineering:

• dbt Community Slack
• DataExpert.io Community Discord
• Locally Optimistic Slack
• Data Talks Club Slack

Companies:

• Transformation & Modeling
  • dbt Labs
  • Coalesce
  • SQLMesh
  • Dataform (Google)
  • SDF
• Data Warehouses
  • Snowflake
  • Google BigQuery
  • Amazon Redshift
  • Databricks
  • Firebolt
  • DuckDB
  • ClickHouse
  • MotherDuck
• Semantic / Metrics Layers
  • dbt Semantic Layer (MetricFlow)
  • Cube
  • Lightdash
  • Transform (acquired by dbt Labs)
• Analytics / Visualization
  • Looker (Google)
  • Tableau
  • Power BI
  • Preset / Apache Superset
  • Metabase
  • Hex
  • Mode
  • Sigma Computing
  • Evidence
  • Lightdash
  • Redash
  • ThoughtSpot
  • Streamlit
• Data Quality & Testing
  • dbt Tests
  • Great Expectations
  • Elementary Data
  • Soda
  • Monte Carlo
  • Metaplane
  • Gable
  • DQOps
• Data Integration / ELT
  • Fivetran
  • Airbyte
  • Stitch
  • dlt
  • Meltano
  • Sling
• Orchestration
  • Dagster
  • Prefect
  • Astronomer / Airflow
  • Mage
  • Kestra
• Data Cataloging & Documentation
  • Atlan
  • Alation
  • DataHub
  • Secoda
  • Select Star
  • Castor
• Data Lineage
  • OpenLineage
  • Monte Carlo
  • Stemma
• Education Companies
  • DataExpert.io
  • LearnDataEngineering.com
  • DataCamp
  • ByteByteGo
• LLM Application Libraries
  • AdalFlow
  • LangChain
  • LlamaIndex

Analytics Engineering Blogs:

• dbt Developer Blog
• Locally Optimistic
• Benn Stancil's Blog
• Netflix Data Blog
• Airbnb Data Blog
• Spotify Engineering (Data)
• Uber Data Blog
• GitLab Data Team Handbook
• Brooklyn Data Co. Blog
• Databricks Blog
• Snowflake Blog
• The Data Warehouse Insiders
• Simon Späti's Data Blog
• Start Data Engineering
• Preset Blog
• Hex Blog

Analytics Engineering Papers & Whitepapers:

• A Five-Layered Business Intelligence Architecture
• Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics
• The Data Lakehouse: Data Warehousing and More
• Big Data Quality: A Data Quality Profiling Model
• Tidy Data by Hadley Wickham
• Data Engineering Whitepapers Collection
• The Metrics Layer by dbt Labs
• Building a Mature Analytics Workflow

Social Media Accounts

Here's a mostly comprehensive list of analytics engineering creators:

YouTube

LinkedIn

X/Twitter

Great Podcasts

• The Analytics Engineering Podcast
• The Data Engineering Show
• Data Engineering Podcast
• Analytics Power Hour
• The Data Coffee Break Podcast
• The Datastack Show
• Catalog & Cocktails
• DataTopics
• Drill to Detail with Mark Rittman
• The Data Chief by ThoughtSpot
• Monday Morning Data Chat
• The Joe Reis Show
• Super Data Science: ML & AI Podcast with Jon Krohn
• MLOps.community Podcast

Great list of 20+ newsletters

Top must follow newsletters for analytics engineering:

• Learn Analytics Engineering
• The Analytics Engineering Roundup by dbt Labs
• DataEngineer.io Newsletter
• Benn Stancil's Newsletter
• Locally Optimistic Blog

Glossaries:

• dbt Glossary
• Data Engineering Vault
• Airbyte Data Glossary
• Data Engineering Wiki by Reddit
• Secoda Glossary
• Glossary Databricks
• Data Engineering Glossary by Dagster
• Kimball Group Techniques

Design Patterns

• How We Structure Our dbt Projects (dbt Labs)
• dbt Best Practices
• dbt Style Guide by dbt Labs
• GitLab dbt Guide
• Cumulative Table Design
• Kimball Dimensional Modeling Techniques
• The Little Book of Pipelines
• Data Developer Platform Architecture
• Medallion Architecture by Databricks
• The Metrics Layer Explained

Courses / Academies

• DataExpert.io course use code HANDBOOK10 for a discount!
• dbt Learn (dbt Fundamentals) — Free official dbt course
• Technical Freelancer Academy Use code zwtech for a discount!
• Analytics Engineering with dbt (Coursera)
• The Complete dbt Bootcamp (Udemy)
• DataCamp
• LearnDataEngineering.com
• Data Engineering Zoomcamp by DataTalksClub
• IBM Data Engineering for Everyone (edX)
• Rock the JVM — Teaches Spark, Flink, and more
• DeepLearning.AI Data Engineering Professional Certificate

Certification Courses

• dbt Analytics Engineering Certification
• Google Cloud Certified - Professional Data Engineer
• Snowflake SnowPro Core Certification
• Snowflake SnowPro Advanced: Data Engineer
• Databricks - Data Engineer Associate
• Microsoft DP-203: Data Engineering on Microsoft Azure
• Microsoft DP-600: Fabric Analytics Engineer Associate
• AWS Certified Data Engineer - Associate
• Tableau Desktop Specialist
• Google Looker Business Analyst Certificate