Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
1,702
stars
8,189
commits
Go
primary language
Sep 10, 2026
updated
README
Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL, Python & R, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.
Bruin is packed with features:
- 📥 ingest data with ingestr / Python
- ✨ run SQL, Python & R transformations on many platforms
- 📐 table/view materializations, incremental tables
- 🐍 run Python in isolated environments using uv
- 💅 built-in data quality checks
- 🚀 Jinja templating to avoid repetition
- ✅ validate pipelines end-to-end via dry-run
- 👷 run on your local machine, an EC2 instance, or GitHub Actions
- 🔒 secrets injection via environment variables
- VS Code extension for a better developer experience
- ⚡ written in Golang
- 📦 easy to install and use
Installation
Please see the installation instructions here.
Community
Join our Slack community here.
Quickstart
Take a look at our quickstart guide here.
Contributors
(top 30 of 39)
See what people are saying
Similar repos
Languages
Go
92.1%
HTML
3.2%
Python
2.1%
Rust
1.0%
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
1,702
stars
8,189
commits
Go
primary language
Sep 10, 2026
updated
README
Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL, Python & R, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.
Bruin is packed with features:
- 📥 ingest data with ingestr / Python
- ✨ run SQL, Python & R transformations on many platforms
- 📐 table/view materializations, incremental tables
- 🐍 run Python in isolated environments using uv
- 💅 built-in data quality checks
- 🚀 Jinja templating to avoid repetition
- ✅ validate pipelines end-to-end via dry-run
- 👷 run on your local machine, an EC2 instance, or GitHub Actions
- 🔒 secrets injection via environment variables
- VS Code extension for a better developer experience
- ⚡ written in Golang
- 📦 easy to install and use
Installation
Please see the installation instructions here.
Community
Join our Slack community here.
Quickstart
Take a look at our quickstart guide here.
See what people are saying
Similar repos
Contributors
(top 30 of 39)
Languages
Go
92.1%
HTML
3.2%
Python
2.1%
Rust
1.0%