Correia-jpv/fucking-awesome-datascience

๐Ÿ“ An awesome Data Science repository to learn and apply for real world problems. With repository starsโญ and forks๐Ÿด

14

1,241 commits

updated Sep 22, 2026

See the code

README

AWESOME DATA SCIENCE

Awesome

Contributions are welcome - see CONTRIBUTING.md.

An open-source Data Science repository to learn and apply concepts toward solving real- world problems.

This is a shortcut path to start studying Data Science. Just follow the steps to answer the questions, "What is Data Science, and what should I study to learn Data Science?"


$ ๐ŸŒŽ academic

$ brew tap academic/tap
$ brew install academic

Sponsors

Creavit Studio: recording, editing, and motion in one app

Graphyn: visualize specialized agent workflows

Become a sponsor! github@academic.io

Table of Contents

What is Data Science?

^ back to top ^

Data Science is one of the hottest topics on the Computer and Internet farmland nowadays. People have gathered data from applications and systems until today and now is the time to analyze them. The next steps are producing suggestions from the data and creating predictions about the future. ๐ŸŒŽ Here you can find the biggest question for Data Science and hundreds of answers from experts.

LinkPreview
ย 37237โญ ย ย 7524๐Ÿด Data Science For Beginners)Microsoft are pleased to offer a 10-week, 20-lesson curriculum all about Data Science.
๐ŸŒŽ What is Data Science @ O'reillyData scientists combine entrepreneurship with patience, the willingness to build data products incrementally, the ability to explore, and the ability to iterate over a solution. They are inherently interdisciplinary. They can tackle all aspects of a problem, from initial data collection and data conditioning to drawing conclusions. They can think outside the box to come up with new ways to view the problem, or to work with very broadly defined problems: โ€œhereโ€™s a lot of data, what can you make from it?โ€
๐ŸŒŽ What is Data Science @ QuoraData Science is a combination of a number of aspects of Data such as Technology, Algorithm development, and data interference to study the data, analyse it, and find innovative solutions to difficult problems. Basically Data Science is all about Analysing data and driving for business growth by finding creative ways.
๐ŸŒŽ The sexiest job of 21st centuryData scientists today are akin to Wall Street โ€œquantsโ€ of the 1980s and 1990s. In those days people with backgrounds in physics and math streamed to investment banks and hedge funds, where they could devise entirely new algorithms and data strategies. Then a variety of universities developed masterโ€™s programs in financial engineering, which churned out a second generation of talent that was more accessible to mainstream firms. The pattern was repeated later in the 1990s with search engineers, whose rarefied skills soon came to be taught in computer science programs.
๐ŸŒŽ WikipediaData science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from many structural and unstructured data. Data science is related to data mining, machine learning and big data.
๐ŸŒŽ How to Become a Data ScientistData scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientistโ€™s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
๐ŸŒŽ a very short history of #datascienceThe story of how data scientists became sexy is mostly the story of the coupling of the mature discipline of statistics with a very young one--computer science. The term โ€œData Scienceโ€ has emerged only recently to specifically designate a new profession that is expected to make sense of the vast stores of big data. But making sense of data has a long history and has been discussed by scientists, statisticians, librarians, computer scientists and others for years. The following timeline traces the evolution of the term โ€œData Scienceโ€ and its use, attempts to define it, and related terms.
๐ŸŒŽ Software Development Resources for Data ScientistsData scientists concentrate on making sense of data through exploratory analysis, statistics, and models. Software developers apply a separate set of knowledge with different tools. Although their focus may seem unrelated, data science teams can benefit from adopting software development best practices. Version control, automated testing, and other dev skills help create reproducible, production-ready code and tools.
๐ŸŒŽ Data Scientist RoadmapData science is an excellent career choice in todayโ€™s data-driven world where approx 328.77 million terabytes of data are generated daily. And this number is only increasing day by day, which in turn increases the demand for skilled data scientists who can utilize this data to drive business growth.
๐ŸŒŽ Navigating Your Path to Becoming a Data Scientist_Data science is one of the most in-demand careers today. With businesses increasingly relying on data to make decisions, the need for skilled data scientists has grown rapidly. Whether itโ€™s tech companies, healthcare organizations, or even government institutions, data scientists play a crucial role in turning raw data into valuable insights. But how do you become a data scientist, especially if youโ€™re just starting out? _

Where do I Start?

^ back to top ^

While not strictly necessary, having a programming language is a crucial skill to be effective as a data scientist. Currently, the most popular language is Python, closely followed by R. Python is a general-purpose scripting language that sees applications in a wide variety of fields. R is a domain-specific language for statistics, which contains a lot of common statistics tools out of the box. ๐ŸŒŽ Python is by far the most popular language in science, due in no small part to the ease at which it can be used and the vibrant ecosystem of user-generated packages. To install packages, there are two main methods: Pip (invoked as pip install), the package manager that comes bundled with Python, and ๐ŸŒŽ Anaconda (invoked as conda install), a powerful package manager that can install packages for Python, R, and can download executables like Git.

Unlike R, Python was not built from the ground up with data science in mind, but there are plenty of third party libraries to make up for this. A much more exhaustive list of packages can be found later in this document, but these four packages are a good set of choices to start your data science journey with: ๐ŸŒŽ Scikit-Learn is a general-purpose data science package which implements the most popular algorithms - it also includes rich documentation, tutorials, and examples of the models it implements. Even if you prefer to write your own implementations, Scikit-Learn is a valuable reference to the nuts-and-bolts behind many of the common algorithms you'll find. With ๐ŸŒŽ Pandas, one can collect and analyze their data into a convenient table format. ๐ŸŒŽ Numpy provides very fast tooling for mathematical operations, with a focus on vectors and matrices. ๐ŸŒŽ Seaborn, itself based on the ๐ŸŒŽ Matplotlib package, is a quick way to generate beautiful visualizations of your data, with many good defaults available out of the box, as well as a gallery showing how to produce many common visualizations of your data.

When embarking on your journey to becoming a data scientist, the choice of language isn't particularly important, and both Python and R have their pros and cons. Pick a language you like, and check out one of the Free courses we've listed below!

Beginner Roadmap

If you're just starting out, here's a simple recommended path:

  1. Learn Python โ€“ Start with basics: variables, loops, functions
  2. Learn core libraries โ€“ Pandas, NumPy, Matplotlib, Scikit-Learn
  3. Practice with beginner projects โ€“ Try Titanic survival or house price prediction on Kaggle
  4. Learn Math basics โ€“ Statistics, Linear Algebra, Probability
  5. Move into ML โ€“ Supervised learning โ†’ Unsupervised โ†’ Deep Learning

Agents

This section contains agent frameworks and tools that are useful for data science workflows.

Frameworks

  • ย ย ย 679โญ ย ย ย 105๐Ÿด ADK-Rust) - Production-ready AI agent development kit for Rust with model-agnostic design (Gemini, OpenAI, Anthropic), multiple agent types (LLM, Graph, Workflow), MCP support, and built-in telemetry.
  • ย ย ย 312โญ ย ย ย ย 44๐Ÿด Lumen) - Agent framework for chatting with data, turning natural language into SQL, transformation pipelines and visualizations. Outputs are declarative specs that can be inspected, edited, reopened in a notebook or composed into a dashboard.

Tools

  • ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Frostbyte MCP) - MCP server providing 13 data tools for AI agents: real-time crypto prices, IP geolocation, DNS lookups, web scraping to markdown, code execution, and screenshots. One API key for 40+ services.
  • ๐ŸŒŽ Arch Tools - 61 production-ready AI API tools for data science workflows: code analysis, web scraping, NLP, image generation, crypto data, and search. REST API and MCP protocol support. ย ย ย ย ย 1โญ ย ย ย ย ย 1๐Ÿด GitHub)
  • ๐ŸŒŽ Not Human Search - Search engine for AI agents that indexes 9,000+ AI tools and APIs, scoring each on agentic readiness (llms.txt, OpenAPI, MCP, ai-plugin.json). REST API and MCP server for programmatic tool discovery. ย ย ย ย ย 8โญ ย ย ย ย ย 1๐Ÿด GitHub)
  • ย ย ย ย 46โญ ย ย ย ย 16๐Ÿด DeepAlpha) - AI crypto trading framework using LightGBM + XGBoost ensemble with 72 ML features. 70.9% walk-forward validated accuracy on out-of-sample data. Supports Bybit and Binance. MIT licensed, available on ๐ŸŒŽ PyPI.
  • ย ย ย ย 21โญ ย ย ย ย ย 4๐Ÿด CAJAL) - Local AI agent for generating publication-ready scientific papers with real arXiv citations, IMRaD structure, and tribunal scoring. Runs 100% offline via Ollama with 4B-9B models. MIT licensed. ๐ŸŒŽ HuggingFace
  • ย ย ย 120โญ ย ย ย ย 44๐Ÿด ai-evaluation) - Open-source LLM and agent evaluation framework with 50+ metrics, LLM-as-Judge augmentation, and guardrail scanners (jailbreak, PII, prompt-injection). Useful for scoring RAG outputs, agent trajectories, and function-calling behavior in data-science workflows.
  • ย ย ย 292โญ ย ย ย ย 22๐Ÿด Kitaru) - Open-source platform that records real AI agent runs, replays them against changes, and evaluates outcomes before deployment.

Research & Knowledge Retrieval

  • ๐ŸŒŽ BGPT MCP - MCP server that gives AI agents access to a database of scientific papers built from raw experimental data extracted from full-text studies. Returns 25+ structured fields per paper including methods, results, sample sizes, and quality scores. ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด GitHub)

  • ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด Chunk Tuner) - Open-source Python library and MCP server to benchmark document chunking strategies for RAG, score retrieval quality, and recommend configurations for a corpus.

  • ย ย ย ย 16โญ ย ย ย ย ย 0๐Ÿด II-Commons) - Daily-updated skill and CLI for deterministic retrieval across arXiv, PubMed/PMC, and supported US policy corpora.

  • ๐ŸŒŽ Spraay x402 Gateway - x402 payment gateway with 23 Research & Reference endpoints for AI agents: Wikipedia, arXiv, PubMed, Wikidata, academic citation lookup, entity extraction, and more. Pay-per-call in USDC on Base & Solana โ€” no API keys or subscriptions. Also serves 150+ endpoints across 39 categories including geospatial, AI inference, DeFi, and compute. GitHub

  • ๐ŸŒŽ Suppr - AI literature search, document translation, and deep-research workspace for researchers.

Workflow

^ back to top ^

  • ๐ŸŒŽ sim - Sim Studio's interface is a lightweight, intuitive way to quickly build and deploy LLMs that connect with your favorite tools.

Training Resources

^ back to top ^

How do you learn data science? By doing data science, of course! Okay, okay - that might not be particularly helpful when you're first starting out. In this section, we've listed some learning resources, in rough order from least to greatest commitment - Tutorials, Massively Open Online Courses (MOOCs), Intensive Programs, and Colleges.

Tutorials

^ back to top ^

Free Courses

^ back to top ^

  • ย 21975โญ ย ย 4256๐Ÿด Data Science) - Open Source Society University
  • ๐ŸŒŽ Data Scientist with R
  • ๐ŸŒŽ Data Scientist with Python
  • ๐ŸŒŽ Genetic Algorithms OCW Course
  • ย 31248โญ ย ย 2585๐Ÿด AI Expert Roadmap) - Roadmap to becoming an Artificial Intelligence Expert
  • ๐ŸŒŽ Convex Optimization - Convex Optimization (basics of convex analysis; least-squares, linear and quadratic programs, semidefinite programming, minimax, extremal volume, and other problems; optimality conditions, duality theory...)
  • ๐ŸŒŽ Learning from Data - Introduction to machine learning covering basic theory, algorithms and applications
  • ๐ŸŒŽ Kaggle - Learn about Data Science, Machine Learning, Python etc
  • ๐ŸŒŽ ML Observability Fundamentals - Learn how to monitor and root-cause production ML issues.
  • ๐ŸŒŽ Weights & Biases Effective MLOps: Model Development - Free Course and Certification for building an end-to-end machine using W&B
  • ๐ŸŒŽ Python for Data Science by Scaler - This course is designed to empower beginners with the essential skills to excel in today's data-driven world. The comprehensive curriculum will give you a solid foundation in statistics, programming, data visualization, and machine learning.
  • ย ย ย 559โญ ย ย ย ย 63๐Ÿด MLSys-NYU-2022) - Slides, scripts and materials for the Machine Learning in Finance course at NYU Tandon, 2022.
  • ย ย ย 889โญ ย ย ย 133๐Ÿด Hands-on Train and Deploy ML) - A hands-on course to train and deploy a serverless API that predicts crypto prices.
  • ๐ŸŒŽ LLMOps: Building Real-World Applications With Large Language Models - Learn to build modern software with LLMs using the newest tools and techniques in the field.
  • ๐ŸŒŽ Prompt Engineering for Vision Models - Learn to prompt cutting-edge computer vision models with natural language, coordinate points, bounding boxes, segmentation masks, and even other images in this free course from DeepLearning.AI.
  • ๐ŸŒŽ Data Science Course By IBM - Free resources and learn what data science is and how itโ€™s used in different industries.
  • ๐ŸŒŽ Neural Networks: Zero to Hero - A free video series by Andrej Karpathy covering neural networks from scratch โ€” backpropagation, makemore, GPT, and more.

MOOC's

^ back to top ^

Intensive Programs

^ back to top ^

Colleges

^ back to top ^

The Data Science Toolbox

^ back to top ^

This section is a collection of packages, tools, algorithms, and other useful items in the data science world.

Algorithms

^ back to top ^

These are some Machine Learning and Data Mining algorithms and models help you to understand your data and derive meaning from it.

Three kinds of Machine Learning Systems

  • Based on training with human supervision
  • Based on learning incrementally on fly
  • Based on data points comparison and pattern detection

Comparison

  • ย ย ย 658โญ ย ย ย 167๐Ÿด datacompy) - DataComPy is a package to compare two Pandas DataFrames.

Supervised Learning

Unsupervised Learning

Semi-Supervised Learning

Reinforcement Learning

Data Mining Algorithms

Modern Data Mining Algorithms

Deep Learning architectures

General Machine Learning Packages

^ back to top ^

  • ๐ŸŒŽ scikit-learn
  • ย ย ย 955โญ ย ย ย 177๐Ÿด scikit-multilearn)
  • ย ย ย 491โญ ย ย ย ย 71๐Ÿด sklearn-expertsys)
  • ย ย 1586โญ ย ย ย 438๐Ÿด scikit-feature)
  • ย ย ย 421โญ ย ย ย ย 72๐Ÿด scikit-rebate)
  • ย ย ย 706โญ ย ย ย 102๐Ÿด seqlearn)
  • ย ย ย 520โญ ย ย ย 117๐Ÿด sklearn-bayes)
  • ย ย ย 440โญ ย ย ย 206๐Ÿด sklearn-crfsuite)
  • ย ย ย 771โญ ย ย ย 128๐Ÿด sklearn-deap)
  • ย ย ย ย 75โญ ย ย ย ย 11๐Ÿด sigopt_sklearn)
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด sklearn-evaluation)
  • ย ย 6594โญ ย ย 2414๐Ÿด scikit-image)
  • ย ย 6715โญ ย ย 1107๐Ÿด scikit-opt)
  • ย ย ย 388โญ ย ย ย ย 46๐Ÿด scikit-posthocs)
  • ๐ŸŒŽ feature-engine
  • ย ย ย ย ย 1โญ ย ย ย ย ย 0๐Ÿด me_fasttext) - Memory-efficient FastText variant with exact trie n-gram IDs, structure-aware row sharing, and mmap serving for large-vocabulary NLP.
  • ย ย ย 667โญ ย ย ย 174๐Ÿด pystruct)
  • ๐ŸŒŽ Shogun
  • ย ย 3089โญ ย ย ย 516๐Ÿด xLearn)
  • ย ย 5286โญ ย ย ย 682๐Ÿด cuML)
  • ย ย 6005โญ ย ย ย 877๐Ÿด causalml)
  • ย ย 5710โญ ย ย 1720๐Ÿด mlpack)
  • ย ย 5175โญ ย ย ย 916๐Ÿด MLxtend)
  • ย ย 2365โญ ย ย ย 322๐Ÿด modAL)
  • ย ย 1150โญ ย ย ย 254๐Ÿด Sparkit-learn)
  • ย ย 2517โญ ย ย ย 168๐Ÿด hyperlearn)
  • ย 14445โญ ย ย 3438๐Ÿด dlib)
  • ย ย 1619โญ ย ย ย 142๐Ÿด imodels)
  • ย ย ย ย 23โญ ย ย ย ย ย 1๐Ÿด jSciPy) - A Java port of SciPy's signal processing module, offering filters, transformations, and other scientific computing utilities.
  • ย ย ย 443โญ ย ย ย 122๐Ÿด RuleFit)
  • ย ย 1015โญ ย ย ย 291๐Ÿด pyGAM)
  • ย ย 4056โญ ย ย ย 302๐Ÿด Deepchecks)
  • ๐ŸŒŽ scikit-survival
  • ๐ŸŒŽ interpretable
  • ย 28784โญ ย ย 8902๐Ÿด XGBoost)
  • ย 18794โญ ย ย 4070๐Ÿด LightGBM)
  • ย ย 9111โญ ย ย 1335๐Ÿด CatBoost)
  • ย ย ย 708โญ ย ย ย ย 42๐Ÿด PerpetualBooster)
  • ย 36321โญ ย ย 3794๐Ÿด JAX)
  • ย ย ย ย 11โญ ย ย ย ย 22๐Ÿด PhilanthroPy) - Scikit-learn native toolkit for nonprofit fundraising analytics: leakage-safe donor propensity, lapse, planned-giving, wealth-screening and revenue-forecasting estimators.

Deep Learning Packages

PyTorch Ecosystem

  • 103162โญ ย 30013๐Ÿด PyTorch)
  • ย ย ย 215โญ ย ย ย ย 15๐Ÿด TorchDR) - GPU and multi-GPU dimensionality reduction with a scikit-learn-compatible API.
  • ย 17925โญ ย ย 7265๐Ÿด torchvision)
  • ย ย 3554โญ ย ย ย 807๐Ÿด torchtext)
  • ย ย 2943โญ ย ย ย 800๐Ÿด torchaudio)
  • ย ย 4786โญ ย ย ย 726๐Ÿด ignite)
  • ย ย 1723โญ ย ย ย 310๐Ÿด PyTorchNet)
  • ย ย ย 578โญ ย ย ย ย 63๐Ÿด PyToune)
  • ย ย 6179โญ ย ย ย 417๐Ÿด skorch)
  • ย ย ย 362โญ ย ย ย ย 51๐Ÿด PyVarInf)
  • ย 24098โญ ย ย 4058๐Ÿด pytorch_geometric)
  • ย ย 3915โญ ย ย ย 602๐Ÿด GPyTorch)
  • ย ย 9057โญ ย ย 1021๐Ÿด pyro)
  • ย ย 3385โญ ย ย ย 397๐Ÿด Catalyst)
  • ย ย 1687โญ ย ย ย 179๐Ÿด pytorch_tabular)
  • ย 10609โญ ย ย 3423๐Ÿด Yolov3)
  • ย 58064โญ ย 17466๐Ÿด Yolov5)
  • ย 61883โญ ย 11790๐Ÿด Yolov8)

TensorFlow Ecosystem

  • 200233โญ ย 77037๐Ÿด TensorFlow)
  • ย ย 7380โญ ย ย 1582๐Ÿด TensorLayer)
  • ย ย 9575โญ ย ย 2352๐Ÿด TFLearn)
  • ย ย 9970โญ ย ย 1305๐Ÿด Sonnet)
  • ย ย 6284โญ ย ย 1778๐Ÿด tensorpack)
  • ย ย 3130โญ ย ย ย 386๐Ÿด TRFL)
  • ย ย 3733โญ ย ย ย 330๐Ÿด Polyaxon)
  • ย ย ย 735โญ ย ย ย 158๐Ÿด NeuPy)
  • ย ย ย 353โญ ย ย ย ย 35๐Ÿด tfdeploy)
  • ย ย ย 706โญ ย ย ย 101๐Ÿด tensorflow-upstream)
  • ย ย 1816โญ ย ย ย 262๐Ÿด TensorFlow Fold)
  • ย ย ย ย 60โญ ย ย ย ย 27๐Ÿด tensorlm)
  • ย ย ย ย 11โญ ย ย ย ย ย 5๐Ÿด TensorLight)
  • ย ย 1629โญ ย ย ย 255๐Ÿด Mesh TensorFlow)
  • ย 11762โญ ย ย 1217๐Ÿด Ludwig)
  • ย ย 3027โญ ย ย ย 753๐Ÿด TF-Agents)
  • ย ย 3305โญ ย ย ย 523๐Ÿด TensorForce)

Keras Ecosystem

  • ๐ŸŒŽ Keras
  • ย ย 1585โญ ย ย ย 635๐Ÿด keras-contrib)
  • ย ย 2173โญ ย ย ย 314๐Ÿด Hyperas)
  • ย ย 1574โญ ย ย ย 303๐Ÿด Elephas)
  • ย ย ย 486โญ ย ย ย ย 47๐Ÿด Hera)
  • ย ย 2397โญ ย ย ย 344๐Ÿด Spektral)
  • ย ย ย 584โญ ย ย ย 108๐Ÿด qkeras)
  • ย ย 5548โญ ย ย 1343๐Ÿด keras-rl)
  • ย ย 1636โญ ย ย ย 264๐Ÿด Talos)

Visualization Tools

^ back to top ^

Miscellaneous Tools

^ back to top ^

LinkDescription
ย ย ย 529โญ ย ย ย ย 75๐Ÿด The Data Science Lifecycle Process)The Data Science Lifecycle Process is a process for taking data science teams from Idea to Value repeatedly and sustainably. The process is documented in this repo
ย ย ย 205โญ ย ย ย ย 60๐Ÿด Data Science Lifecycle Template Repo)Template repository for data science lifecycle project
ย ย ย 570โญ ย ย ย ย 82๐Ÿด TabGAN)Synthetic tabular data generation using GANs, Diffusion Models, and LLMs with adversarial filtering and privacy metrics.
ย ย ย 277โญ ย ย ย ย 24๐Ÿด RexMex)A general purpose recommender metrics library for fair evaluation.
ย ย ย 785โญ ย ย ย 100๐Ÿด ChemicalX)A PyTorch based deep learning library for drug pair scoring.
ย ย ย ย 30โญ ย ย ย ย ย 5๐Ÿด FileShot.io)Secure zero-knowledge encrypted file sharing (AES-256-GCM in-browser). No account required, MIT licensed, self-hostable, optional link expiry.
๐ŸŒŽ CorpusExplorerSoftware for corpus linguists and text/data mining enthusiasts. Build your own corpora in over 60 languages. Use over 50 tools/visualizations.
ย ย 2990โญ ย ย ย 402๐Ÿด PyTorch Geometric Temporal)Representation learning on dynamic graphs.
ย ย ย 715โญ ย ย ย ย 54๐Ÿด Little Ball of Fur)A graph sampling library for NetworkX with a Scikit-Learn like API.
ย ย 2286โญ ย ย ย 254๐Ÿด Karate Club)An unsupervised machine learning extension library for NetworkX with a Scikit-Learn like API.
ย ย 3546โญ ย ย ย 456๐Ÿด ML Workspace)All-in-one web-based IDE for machine learning and data science. The workspace is deployed as a Docker container and is preloaded with a variety of popular data science libraries (e.g., Tensorflow, PyTorch) and dev tools (e.g., Jupyter, VS Code)
ย ย 9649โญ ย ย ย 742๐Ÿด xonsh shell)A Python-powered shell that enables integration, management and orchestration of data science libraries mostly written in Python, allowing you to build pipelines, code and command-based workflows. It can also be used as a kernel for Jupyter Notebook.
๐ŸŒŽ Neptune.aiCommunity-friendly platform supporting data scientists in creating and sharing machine learning models. Neptune facilitates teamwork, infrastructure management, models comparison and reproducibility.
ย ย ย 136โญ ย ย ย ย 32๐Ÿด steppy)Lightweight, Python library for fast and reproducible machine learning experimentation. Introduces very simple interface that enables clean machine learning pipeline design.
ย ย ย ย 23โญ ย ย ย ย ย 9๐Ÿด steppy-toolkit)Curated collection of the neural networks, transformers and models that make your machine learning work faster and more effective.
๐ŸŒŽ Datalab from Googleeasily explore, visualize, analyze, and transform data using familiar languages, such as Python and SQL, interactively.
๐ŸŒŽ Hortonworks Sandboxis a personal, portable Hadoop environment that comes with a dozen interactive Hadoop tutorials.
๐ŸŒŽ Ris a free software environment for statistical computing and graphics.
๐ŸŒŽ Tidyverseis an opinionated collection of R packages designed for data science. All packages share an underlying design philosophy, grammar, and data structures.
๐ŸŒŽ RStudioIDE โ€“ powerful user interface for R. Itโ€™s free and open source, and works on Windows, Mac, and Linux.
๐ŸŒŽ Python - Pandas - AnacondaCompletely free enterprise-ready Python distribution for large-scale data processing, predictive analytics, and scientific computing
ย ย 3256โญ ย ย ย 239๐Ÿด Pandas GUI)Pandas GUI
ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด NuriStat)Free open-source SPSS alternative โ€” menu-driven desktop statistics (t-tests, ANOVA, regression, survival analysis, ROC) with SPSS .sav import/export
ย 39834โญ ย ย 3121๐Ÿด Polars)Fast DataFrame library for Rust and Python, designed as a faster alternative to Pandas
๐ŸŒŽ CiteMefree academic citation generator with a built-in reference checker that flags fabricated or hallucinated references. Searches 11+ scholarly databases (OpenAlex, PubMed, Semantic Scholar, CrossRef, SciELO), formats 40+ citation styles, and offers a public API. No sign-up; available in English, Spanish, Portuguese, French, and German.
๐ŸŒŽ Scikit-LearnMachine Learning in Python
๐ŸŒŽ NumPyNumPy is fundamental for scientific computing with Python. It supports large, multi-dimensional arrays and matrices and includes an assortment of high-level mathematical functions to operate on these arrays.
๐ŸŒŽ VaexVaex is a Python library that allows you to visualize large datasets and calculate statistics at high speeds.
๐ŸŒŽ SciPySciPy works with NumPy arrays and provides efficient routines for numerical integration and optimization.
๐ŸŒŽ Data Science ToolboxCoursera Course
๐ŸŒŽ Data Science ToolboxBlog
๐ŸŒŽ Wolfram Data Science PlatformTake numerical, textual, image, GIS or other data and give it the Wolfram treatment, carrying out a full spectrum of data science analysis and visualization and automatically generate rich interactive reportsโ€”all powered by the revolutionary knowledge-based Wolfram Language.
๐ŸŒŽ DatadogSolutions, code, and devops for high-scale data science.
๐ŸŒŽ VarianceBuild powerful data visualizations for the web without writing JavaScript
๐ŸŒŽ Kite Development KitThe Kite Software Development Kit (Apache License, Version 2.0), or Kite for short, is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.
๐ŸŒŽ Domino Data LabsRun, scale, share, and deploy your models โ€” without any infrastructure or setup.
๐ŸŒŽ Apache FlinkA platform for efficient, distributed, general-purpose data processing.
๐ŸŒŽ Apache HamaApache Hama is an Apache Top-Level open source project, allowing you to do advanced analytics beyond MapReduce.
๐ŸŒŽ WekaWeka is a collection of machine learning algorithms for data mining tasks.
๐ŸŒŽ OctaveGNU Octave is a high-level interpreted language, primarily intended for numerical computations.(Free Matlab)
๐ŸŒŽ Apache SparkLightning-fast cluster computing
ย ย ย 326โญ ย ย ย ย 69๐Ÿด Hydrosphere Mist)a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services.
๐ŸŒŽ Data MechanicsA data science and engineering platform making Apache Spark more developer-friendly and cost-effective.
๐ŸŒŽ CaffeDeep Learning Framework
๐ŸŒŽ TorchA SCIENTIFIC COMPUTING FRAMEWORK FOR LUAJIT
ย ย 3860โญ ย ย ย 804๐Ÿด Nervana's python based Deep Learning Framework)Intelยฎ Nervanaโ„ข reference deep learning framework committed to best performance on all hardware.
ย ย ย 396โญ ย ย ย ย 52๐Ÿด Skale)High performance distributed data processing in NodeJS
๐ŸŒŽ AerosolveA machine learning package built for humans.
ย ย ย 312โญ ย ย ย ย 80๐Ÿด Intel framework)Intelยฎ Deep Learning Framework
๐ŸŒŽ DatawrapperAn open source data visualization platform helping everyone to create simple, correct and embeddable charts. Also at ย ย 1458โญ ย ย ย 279๐Ÿด github.com)
๐ŸŒŽ Tensor FlowTensorFlow is an Open Source Software Library for Machine Intelligence
๐ŸŒŽ Natural Language ToolkitAn introductory yet powerful toolkit for natural language processing and classification
ย 20466โญ ย ย 2043๐Ÿด FunASR)Industrial-grade speech recognition toolkit supporting 50+ languages with built-in VAD, punctuation, speaker diarization, and emotion detection. OpenAI-compatible API server included.
๐ŸŒŽ Annotation LabFree End-to-End No-Code platform for text annotation and DL model training/tuning. Out-of-the-box support for Named Entity Recognition, Classification, Relation extraction and Assertion Status Spark NLP models. Unlimited support for users, teams, projects, documents.
๐ŸŒŽ nlp-toolkit for node.jsThis module covers some basic nlp principles and implementations. The main focus is performance. When we deal with sample or training data in nlp, we quickly run out of memory. Therefore every implementation in this module is written as stream to only hold that data in memory that is currently processed at any step.
๐ŸŒŽ Juliahigh-level, high-performance dynamic programming language for technical computing
ย ย 2905โญ ย ย ย 426๐Ÿด IJulia)a Julia-language backend combined with the Jupyter interactive environment
๐ŸŒŽ Apache ZeppelinWeb-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more
ย ย 7683โญ ย ย ย 915๐Ÿด Featuretools)An open source framework for automated feature engineering written in python
ย ย 1536โญ ย ย ย 229๐Ÿด Optimus)Cleansing, pre-processing, feature engineering, exploratory data analysis and easy ML with PySpark backend.
ย 15309โญ ย ย 1706๐Ÿด Albumentations)ะ fast and framework agnostic image augmentation library that implements a diverse set of augmentation techniques. Supports classification, segmentation, and detection out of the box. Was used to win a number of Deep Learning competitions at Kaggle, Topcoder and those that were a part of the CVPR workshops.
ย 15881โญ ย ย 1329๐Ÿด DVC)An open-source data science version control system. It helps track, organize and make data science projects reproducible. In its very basic scenario it helps version control and share large data and model files.
ย ย ย ย 26โญ ย ย ย ย ย 5๐Ÿด Lambdo)is a workflow engine that significantly simplifies data analysis by combining in one analysis pipeline (i) feature engineering and machine learning (ii) model training and prediction (iii) table population and column evaluation.
ย ย 7301โญ ย ย 1442๐Ÿด Feast)A feature store for the management, discovery, and access of machine learning features. Feast provides a consistent view of feature data for both model training and model serving.
ย ย 3733โญ ย ย ย 330๐Ÿด Polyaxon)A platform for reproducible and scalable machine learning and deep learning.
๐ŸŒŽ UBIAIEasy-to-use text annotation tool for teams with most comprehensive auto-annotation features. Supports NER, relations and document classification as well as OCR annotation for invoice labeling
ย ย 6883โญ ย ย ย 801๐Ÿด Trains)Auto-Magical Experiment Manager, Version Control & DevOps for AI
ย ย 1307โญ ย ย ย 159๐Ÿด Hopsworks)Open-source data-intensive machine learning platform with a feature store. Ingest and manage features for both online (MySQL Cluster) and offline (Apache Hive) access, train and serve models at scale.
ย 39763โญ ย ย 6244๐Ÿด MindsDB)MindsDB is an Explainable AutoML framework for developers. With MindsDB you can build, train and use state of the art ML models in as simple as one line of code.
ย ย ย 510โญ ย ย ย 101๐Ÿด Lightwood)A Pytorch based framework that breaks down machine learning problems into smaller blocks that can be glued together seamlessly with an objective to build predictive models with one line of code.
ย ย 4119โญ ย ย ย 749๐Ÿด AWS Data Wrangler)An open-source Python package that extends the power of Pandas library to AWS connecting DataFrames and AWS data related services (Amazon Redshift, AWS Glue, Amazon Athena, Amazon EMR, etc).
๐ŸŒŽ Amazon RekognitionAWS Rekognition is a service that lets developers working with Amazon Web Services add image analysis to their applications. Catalog assets, automate workflows, and extract meaning from your media and applications.
๐ŸŒŽ Amazon TextractAutomatically extract printed text, handwriting, and data from any document.
๐ŸŒŽ Amazon Lookout for VisionSpot product defects using computer vision to automate quality inspection. Identify missing product components, vehicle and structure damage, and irregularities for comprehensive quality control.
๐ŸŒŽ Amazon CodeGuruAutomate code reviews and optimize application performance with ML-powered recommendations.
ย ย 4187โญ ย ย ย 345๐Ÿด CML)An open source toolkit for using continuous integration in data science projects. Automatically train and test models in production-like environments with GitHub Actions & GitLab CI, and autogenerate visual reports on pull/merge requests.
๐ŸŒŽ DaskAn open source Python library to painlessly transition your analytics code to distributed computing systems (Big Data)
ย 41617โญ ย ย 3814๐Ÿด DuckDB)An in-process SQL OLAP database management system
๐ŸŒŽ StatsmodelsA Python-based inferential statistics, hypothesis testing and regression framework
๐ŸŒŽ GensimAn open-source library for topic modeling of natural language text
๐ŸŒŽ spaCyA performant natural language processing toolkit
ย ย 8809โญ ย ย 1477๐Ÿด Grid Studio)Grid studio is a web-based spreadsheet application with full integration of the Python programming language.
ย 49968โญ ย 19121๐Ÿด Python Data Science Handbook)Python Data Science Handbook: full text in Jupyter Notebooks
ย ย ย 228โญ ย ย ย ย 34๐Ÿด Shapley)A data-driven framework to quantify the value of classifiers in a machine learning ensemble.
๐ŸŒŽ DAGsHubA platform built on open source tools for data, model and pipeline management.
๐ŸŒŽ DeepnoteA new kind of data science notebook. Jupyter-compatible, with real-time collaboration and running in the cloud.
๐ŸŒŽ ValohaiAn MLOps platform that handles machine orchestration, automatic reproducibility and deployment.
๐ŸŒŽ PyMC3A Python Library for Probabalistic Programming (Bayesian Inference and Machine Learning)
๐ŸŒŽ PyStanPython interface to Stan (Bayesian inference and modeling)
๐ŸŒŽ hmmlearnUnsupervised learning and inference of Hidden Markov Models
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Chaos Genius)ML powered analytics engine for outlier/anomaly detection and root cause analysis
๐ŸŒŽ NimbleboxA full-stack MLOps platform designed to help data scientists and machine learning practitioners around the world discover, create, and launch multi-cloud apps from their web browser.
ย ย 3450โญ ย ย ย 257๐Ÿด Towhee)A Python library that helps you encode your unstructured data into embeddings.
ย ย ย 672โญ ย ย ย ย 58๐Ÿด LineaPy)Ever been frustrated with cleaning up long, messy Jupyter notebooks? With LineaPy, an open source Python library, it takes as little as two lines of code to transform messy development code into production pipelines.
ย ย 2233โญ ย ย ย 168๐Ÿด envd)๐Ÿ•๏ธ machine learning development environment for data science and AI/ML engineering teams
๐ŸŒŽ Explore Data Science LibrariesA search engine ๐Ÿ”Ž tool to discover & find a curated list of popular & new libraries, top authors, trending project kits, discussions, tutorials & learning resources
ย ย ย 718โญ ย ย ย ย 42๐Ÿด MLEM)๐Ÿถ Version and deploy your ML models following GitOps principles
๐ŸŒŽ MLflowMLOps framework for managing ML models across their full lifecycle
ย 11669โญ ย ย ย 919๐Ÿด cleanlab)Python library for data-centric AI and automatically detecting various issues in ML datasets
ย 10728โญ ย ย 1195๐Ÿด AutoGluon)AutoML to easily produce accurate predictions for image, text, tabular, time-series, and multi-modal data
๐ŸŒŽ Arize AIArize AI community tier observability tool for monitoring machine learning models in production and root-causing issues such as data quality and performance drift.
๐ŸŒŽ Aureo.ioAureo.io is a low-code platform that focuses on building artificial intelligence. It provides users with the capability to create pipelines, automations and integrate them with artificial intelligence models โ€“ all with their basic data.
๐ŸŒŽ ERD LabFree cloud based entity relationship diagram (ERD) tool made for developers.
๐ŸŒŽ Arize-PhoenixMLOps in a notebook - uncover insights, surface problems, monitor, and fine tune your models.
ย ย ย 176โญ ย ย ย ย 70๐Ÿด Comet)An MLOps platform with experiment tracking, model production management, a model registry, and full data lineage to support your ML workflow from training straight through to production.
ย 22188โญ ย ย 1817๐Ÿด Opik)Evaluate, test, and ship LLM applications across your dev and production lifecycles.
๐ŸŒŽ SynthicalAI-powered collaborative environment for research. Find relevant papers, create collections to manage bibliography, and summarize content โ€” all in one place
ย ย ย ย 13โญ ย ย ย ย ย 0๐Ÿด teeplot)Workflow tool to automatically organize data visualization output
ย 45814โญ ย ย 4387๐Ÿด Streamlit)App framework for Machine Learning and Data Science projects
ย 43596โญ ย ย 3608๐Ÿด Gradio)Create customizable UI components around machine learning models
ย 11258โญ ย ย ย 900๐Ÿด Weights & Biases)Experiment tracking, dataset versioning, and model management
ย 15881โญ ย ย 1329๐Ÿด DVC)Open-source version control system for machine learning projects
ย 14830โญ ย ย 1391๐Ÿด Optuna)Automatic hyperparameter optimization software framework
ย 43889โญ ย ย 8068๐Ÿด Ray Tune)Scalable hyperparameter tuning library
ย 46932โญ ย 17892๐Ÿด Apache Airflow)Platform to programmatically author, schedule, and monitor workflows
ย 23893โญ ย ย 2534๐Ÿด Prefect)Workflow management system for modern data stacks
ย 11006โญ ย ย 1079๐Ÿด Kedro)Open-source Python framework for creating reproducible, maintainable data science code
ย ย 2595โญ ย ย ย 216๐Ÿด Hamilton)Lightweight library to author and manage reliable data transformations
ย 25772โญ ย ย 3750๐Ÿด SHAP)Game theoretic approach to explain the output of any machine learning model
ย ย 6946โญ ย ย ย 787๐Ÿด InterpretML)InterpretML implements the Explainable Boosting Machine (EBM), a modern, fully interpretable machine learning model based on Generalized Additive Models (GAMs). This open-source package also provides visualization tools for EBMs, other glass-box models, and black-box explanations
ย 12163โญ ย ย 1846๐Ÿด LIME)Explaining the predictions of any machine learning classifier
ย ย 7547โญ ย ย ย 890๐Ÿด flyte)Workflow automation platform for machine learning
ย 13899โญ ย ย 2574๐Ÿด dbt)Data build tool
ย ย 2342โญ ย ย ย ย 75๐Ÿด zasper)Supercharged IDE for Data Science
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด skrub)A Python library to ease preprocessing and feature engineering for tabular machine learning
ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด Glyph)Framework-agnostic TypeScript library for generating, searching, and comparing MinHash fingerprints for fast text similarity, deduplication, and retrieval.
๐ŸŒŽ CodeflashShip Blazing-Fast Python Code โ€” Every Time
๐ŸŒŽ Hugging FacePopular open platform for sharing ML models, datasets, and collaborating on NLP and generative AI projects.
ย ย ย ย 73โญ ย ย ย ย ย 6๐Ÿด Chinese-Elite)An open-source project that automatically maps relationship networks by parsing public data using LLMs and visualizes it as an interactive graph.
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Desbordante)An open-source data profiler specifically focused on discovery and validation of complex patterns, such as ๐ŸŒŽ numerical association rules, ๐ŸŒŽ differential dependencies, ๐ŸŒŽ denial constraints, and more.
ย ย ย ย 57โญ ย ย ย ย ย 8๐Ÿด dna-claude-analysis)Personal genome analysis toolkit with Python scripts analyzing raw DNA data across 17 categories (health risks, ancestry, pharmacogenomics, nutrition, psychology, and more) and generating a terminal-style single-page HTML visualization.
ย ย ย 257โญ ย ย ย ย 10๐Ÿด RunMat)Fast MATLAB-syntax runtime with automatic CPU/GPU execution and fused array kernels.
ย ย ย ย 17โญ ย ย ย ย ย 2๐Ÿด Turbostream)A terminal UI for experimenting with custom rule engines and selective LLM analysis on real-time data streams, without worrying about streaming infra or backpressure.
ย ย 1792โญ ย ย ย 166๐Ÿด WFGY ProblemMap)Open source โ€œfailure atlasโ€ of 16 recurring issues in LLM and RAG pipelines, with observable symptoms and suggested fixes for data science teams.
๐ŸŒŽ DeploybaseTrack real-time GPU and LLM pricing across all cloud and inference providers.
ย ย 4647โญ ย ย ย 736๐Ÿด DeepAnalyze)An agentic LLM for autonomous data science, which can autonomously complete a wide range of data science tasks without human intervention.
ย ย ย ย ย 7โญ ย ย ย ย ย 0๐Ÿด Disco)Superhuman exploratory data analysis. Finds the feature interactions and subgroup effects in tabular data that LLMs and manual exploration miss โ€” with p-values, effect sizes, and literature citations. Free for public data.
๐ŸŒŽ AI for DatabaseChat with your database in natural language โ€” no SQL needed. Get instant insights, build self-refreshing dashboards, and trigger automated workflows based on database changes.
ย ย ย ย 46โญ ย ย ย ย 16๐Ÿด Crypto Pump Scanner)AI-powered cryptocurrency trading bot with LSTM neural network (84.6% accuracy). Real-time pump detection, walk-forward validated models, multi-exchange support (Bybit, Binance, OKX, Gate.io). Open source.
ย ย 2050โญ ย ย ย 632๐Ÿด Future AGI)Open-source platform to simulate, evaluate, trace, guardrail, route, and optimize LLM and AI agent apps in one feedback loop, so agents don't just get monitored, they self-improve. Self-hostable. Apache-2.0.

Literature and Media

^ back to top ^

This section includes some additional reading material, channels to watch, and talks to listen to.

Books

^ back to top ^

Book Deals (Affiliated)

Journals, Publications and Magazines

^ back to top ^

Newsletters

^ back to top ^

  • ๐ŸŒŽ AI Weekly - Curated AI intelligence briefing from industry leaders covering models, funding, policy, and applications. 3x/week since 2017, 40K+ subscribers.
  • ๐ŸŒŽ DataTalks.Club. A weekly newsletter about data-related things. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ The Analytics Engineering Roundup. A newsletter about data science. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ Techpresso. A free daily newsletter covering the most impactful developments in AI, ML, and tech. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ DiamantAI. Practical AI engineering and generative AI explained simply: RAG, agents, and LLM application patterns for builders.
  • ๐ŸŒŽ Bamboo Weekly - Weekly pandas exercises based on current events and real-world public data, with fully worked solutions. Issues older than two years are free, as are the first two questions + answers in current issues. ๐ŸŒŽ Archive.

Mailing lists

^ back to top ^

Bloggers

^ back to top ^

Presentations

^ back to top ^

Podcasts

^ back to top ^

YouTube Videos & Channels

^ back to top ^

Socialize

^ back to top ^

Below are some Social Media links. Connect with other data scientists!

Facebook Accounts

^ back to top ^

Twitter Accounts

^ back to top ^

TwitterDescription
๐ŸŒŽ Big Data CombineRapid-fire, live tryouts for data scientists seeking to monetize their models as trading strategies
Big Data ManiaData Viz Wiz, Data Journalist, Growth Hacker, Author of Data Science for Dummies (2015)
๐ŸŒŽ Big Data ScienceBig Data, Data Science, Predictive Modeling, Business Analytics, Hadoop, Decision and Operations Research.
Charlie GreenbackerDirector of Data Science at @ExploreAltamira
๐ŸŒŽ Chris SaidData scientist at Twitter
๐ŸŒŽ Clare CorthellDev, Design, Data Science @mattermark #hackerei
๐ŸŒŽ DADI Charles-Abner#datascientist @Ekimetrics. , #machinelearning #dataviz #DynamicCharts #Hadoop #R #Python #NLP #Bitcoin #dataenthousiast
๐ŸŒŽ Data Science CentralData Science Central is the industry's single resource for Big Data practitioners.
๐ŸŒŽ Data Science LondonData Science. Big Data. Data Hacks. Data Junkies. Data Startups. Open Data
๐ŸŒŽ Data Science ReneeDocumenting my path from SQL Data Analyst pursuing an Engineering Master's Degree to Data Scientist
๐ŸŒŽ Data Science ReportMission is to help guide & advance careers in Data Science & Analytics
๐ŸŒŽ Data Science TipsTips and Tricks for Data Scientists around the world! #datascience #bigdata
๐ŸŒŽ Data VizzardDataViz, Security, Military
๐ŸŒŽ DataScienceX
deeplearning4j
๐ŸŒŽ DJ PatilWhite House Data Chief, VP @ RelateIQ.
๐ŸŒŽ Domino Data Lab
๐ŸŒŽ Drew ConwayData nerd, hacker, student of conflict.
Emilio Ferrara#Networks, #MachineLearning and #DataScience. I work on #Social Media. Postdoc at @IndianaUniv
๐ŸŒŽ Erin BartoloRunning with #BigData--enjoying a love/hate relationship with its hype. @iSchoolSU #DataScience Program Mgr.
๐ŸŒŽ Greg RedaWorking @ GrubHub about data and pandas
๐ŸŒŽ Gregory PiatetskyKDnuggets President, Analytics/Big Data/Data Mining/Data Science expert, KDD & SIGKDD co-founder, was Chief Scientist at 2 startups, part-time philosopher.
๐ŸŒŽ Hadley WickhamChief Scientist at RStudio, and an Adjunct Professor of Statistics at the University of Auckland, Stanford University, and Rice University.
๐ŸŒŽ Hakan KardasData Scientist
๐ŸŒŽ Hilary MasonData Scientist in Residence at @accel.
๐ŸŒŽ Jeff HammerbacherReTweeting about data science
๐ŸŒŽ John Myles WhiteScientist at Facebook and Julia developer. Author of Machine Learning for Hackers and Bandit Algorithms for Website Optimization. Tweets reflect my views only.
๐ŸŒŽ Juan Miguel LavistaPrincipal Data Scientist @ Microsoft Data Science Team
๐ŸŒŽ Julia EvansHacker - Pandas - Data Analyze
๐ŸŒŽ Kenneth CukierThe Economist's Data Editor and co-author of Big Data (https://www.big-data-book.com/).
Kevin DavenportOrganizer of https://www.meetup.com/San-Diego-Data-Science-R-Users-Group/
๐ŸŒŽ Kevin MarkhamData science instructor, and founder of ๐ŸŒŽ Data School
๐ŸŒŽ Kim ReesInteractive data visualization and tools. Data flaneur.
๐ŸŒŽ Kirk BorneDataScientist, PhD Astrophysicist, Top #BigData Influencer.
Linda RegberData storyteller, visualizations.
๐ŸŒŽ Luis ReiPhD Student. Programming, Mobile, Web. Artificial Intelligence, Intelligent Robotics Machine Learning, Data Mining, Natural Language Processing, Data Science.
Mark StevensonData Analytics Recruitment Specialist at Salt (@SaltJobs) Analytics - Insight - Big Data - Data science
๐ŸŒŽ Matt HarrisonOpinions of full-stack Python guy, author, instructor, currently playing Data Scientist. Occasional fathering, husbanding, organic gardening.
๐ŸŒŽ Matthew RussellMining the Social Web.
๐ŸŒŽ Mert NuhoฤŸluData Scientist at BizQualify, Developer
๐ŸŒŽ Monica RogatiData @ Jawbone. Turned data into stories & products at LinkedIn. Text mining, applied machine learning, recommender systems. Ex-gamer, ex-machine coder; namer.
๐ŸŒŽ Noah IliinskyVisualization & interaction designer. Practical cyclist. Author of vis books: https://www.oreilly.com/pub/au/4419
๐ŸŒŽ Paul MillerCloud Computing/ Big Data/ Open Data Analyst & Consultant. Writer, Speaker & Moderator. Gigaom Research Analyst.
๐ŸŒŽ Peter SkomorochCreating intelligent systems to automate tasks & improve decisions. Entrepreneur, ex-Principal Data Scientist @LinkedIn. Machine Learning, ProductRei, Networks
๐ŸŒŽ Prash ChanSolution Architect @ IBM, Master Data Management, Data Quality & Data Governance Blogger. Data Science, Hadoop, Big Data & Cloud.
๐ŸŒŽ Quora Data ScienceQuora's data science topic
๐ŸŒŽ R-BloggersTweet blog posts from the R blogosphere, data science conferences, and (!) open jobs for data scientists.
๐ŸŒŽ Rand Hindi
๐ŸŒŽ Randy OlsonComputer scientist researching artificial intelligence. Data tinkerer. Community leader for @DataIsBeautiful. #OpenScience advocate.
๐ŸŒŽ Recep ErolData Science geek @ UALR
๐ŸŒŽ Ryan OrbanData scientist, genetic origamist, hardware aficionado
๐ŸŒŽ Sean J. TaylorSocial Scientist. Hacker. Facebook Data Science Team. Keywords: Experiments, Causal Inference, Statistics, Machine Learning, Economics.
๐ŸŒŽ Silvia K. Spiva#DataScience at Cisco
๐ŸŒŽ Harsh B. GuptaData Scientist at BBVA Compass
๐ŸŒŽ Spencer NelsonData nerd
๐ŸŒŽ Talha OzEnjoys ABM, SNA, DM, ML, NLP, HI, Python, Java. Top percentile Kaggler/data scientist
๐ŸŒŽ Tasos SkarlatidisComplex Event Processing, Big Data, Artificial Intelligence and Machine Learning. Passionate about programming and open-source.
๐ŸŒŽ Terry TimkoInfoGov; Bigdata; Data as a Service; Data Science; Open, Social & Business Data Convergence
๐ŸŒŽ Tony BaerIT analyst with Ovum covering Big Data & data management with some systems engineering thrown in.
๐ŸŒŽ Tony OjedaData Scientist , Author , Entrepreneur. Co-founder @DataCommunityDC. Founder @DistrictDataLab. #DataScience #BigData #DataDC
๐ŸŒŽ Vamshi AmbatiData Science @ PayPal. #NLP, #machinelearning; PhD, Carnegie Mellon alumni (Blog: https://allthingsds.wordpress.com )
๐ŸŒŽ Wes McKinneyPandas (Python Data Analysis library).
๐ŸŒŽ WileyEdSenior Manager - @Seagate Big Data Analytics @McKinsey Alum #BigData + #Analytics Evangelist #Hadoop, #Cloud, #Digital, & #R Enthusiast
๐ŸŒŽ WNYC Data News TeamThe data news crew at @WNYC. Practicing data-driven journalism, making it visual, and showing our work.
๐ŸŒŽ Alexey GrigorevData science author
๐ŸŒŽ ฤฐlker ArslanData science author. Shares mostly about Julia programming
๐ŸŒŽ INEVITABLEAI & Data Science Start-up Company based in England, UK
๐ŸŒŽ Jan Oliver RรผdigerML, DL and Data Science - with a focus on text-/data-mining

Telegram Channels

^ back to top ^

  • ๐ŸŒŽ Open Data Science โ€“ First Telegram Data Science channel. Covering all technical and popular staff about anything related to Data Science: AI, Big Data, Machine Learning, Statistics, general Math and the applications of former.
  • ๐ŸŒŽ Loss function porn โ€” Beautiful posts on DS/ML theme with video or graphic visualization.
  • ๐ŸŒŽ Machinelearning โ€“ Daily ML news.

Slack Communities

top

GitHub Groups

Data Science Competitions

Some data mining competition platforms

Fun

Infographics

^ back to top ^

PreviewDescription
๐ŸŒŽ ๐ŸŒŽ Key differences of a data scientist vs. data engineer
๐ŸŒŽ A visual guide to Becoming a Data Scientist in 8 Steps by ๐ŸŒŽ DataCamp ๐ŸŒŽ (img)
๐ŸŒŽ Mindmap on required skills ๐ŸŒŽ img)
๐ŸŒŽ Swami Chandrasekaran made a ๐ŸŒŽ Curriculum via Metro map.
๐ŸŒŽ by ๐ŸŒŽ @kzawadz via ๐ŸŒŽ twitter
๐ŸŒŽ By ๐ŸŒŽ Data Science Central
๐ŸŒŽ Data Science Wars: R vs Python
๐ŸŒŽ How to select statistical or machine learning techniques
๐ŸŒŽ ๐ŸŒŽ Choosing the Right Estimator
๐ŸŒŽ The Data Science Industry: Who Does What
๐ŸŒŽ Data Science Venn Euler Diagram
๐ŸŒŽ Different Data Science Skills and Roles from ๐ŸŒŽ Springboard
๐ŸŒŽ Data Fallacies To AvoidA simple and friendly way of teaching your non-data scientist/non-statistician colleagues ๐ŸŒŽ how to avoid mistakes with data. From Geckoboard's ๐ŸŒŽ Data Literacy Lessons.

Datasets

^ back to top ^

  • ๐ŸŒŽ Academic Torrents
  • ๐ŸŒŽ ADS-B Exchange - Specific datasets for aircraft and Automatic Dependent Surveillance-Broadcast (ADS-B) sources.
  • ๐ŸŒŽ Chinese Tea Dataset - Curated open dataset of 100+ Chinese teas with category, origin, caffeine level, flavor notes, oxidation, and brewing parameters. Available as JSON and CSV.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด College ROI Dataset) - Lifetime return-on-investment estimates for ~30K US bachelor's programs across 1,775 institutions, built from FREOPP, IPEDS, and BEA regional price data. 5 CSVs with data dictionary, CC BY 4.0, Zenodo DOI.
  • ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด AI Displacement Tracker) - Structured dataset tracking 92 AI-attributed workforce reduction events affecting 453,748 workers across 12 countries and 11 sectors. JSON and CSV formats. CC-BY-4.0 licensed.
  • ๐ŸŒŽ Packrift Packaging Optimization Benchmark Corpus - Public packaging product dataset generated from 1,000 exact-spec SKU records, with downloadable CSV and JSON files for ecommerce fulfillment and warehouse analysis.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด Pokemon Card Centering Measurements) - 320 measured PSA-style centering annotations (left/right and top/bottom border percentages, tilt) across 302 real eBay-listed Pokemon cards. CSV, CC BY 4.0, Zenodo DOI.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด Pokemon Card Sold-Price Reference by Grade) - Median sold price by grade (raw, PSA 9, PSA 10) for 486 Pokemon cards, with sample size and confidence flag per card. CSV, CC BY 4.0, Zenodo DOI.
  • ๐ŸŒŽ Evidaxis Momentum Snapshots - Weekly snapshots of public development and citation activity for open-source and research-native AI systems, content-addressed and byte-reproducible from public inputs. JSON and CSV per snapshot date, CC0, DOI 10.5281/zenodo.21076011.
  • ๐ŸŒŽ hadoopilluminated.com
  • ๐ŸŒŽ data.gov - The home of the U.S. Government's open data
  • ๐ŸŒŽ United States Census Bureau
  • ๐ŸŒŽ enigma.com - Navigate the world of public data - Quickly search and analyze billions of public records published by governments, companies and organizations.
  • ๐ŸŒŽ datahub.io
  • ๐ŸŒŽ aws.amazon.com/datasets
  • ๐ŸŒŽ datacite.org
  • ๐ŸŒŽ The official portal for European data
  • ๐ŸŒŽ NASDAQ:DATA - Nasdaq Data Link A premier source for financial, economic and alternative datasets.
  • ๐ŸŒŽ Congressional Stock Brain - Free AI-powered tool that scores U.S. congressional STOCK Act trade disclosures by significance. Machine-scored signals from 537 lawmakers's public trade filings.
  • ๐ŸŒŽ figshare.com
  • ๐ŸŒŽ GeoLite Legacy Downloadable Databases
  • ๐ŸŒŽ Hugging Face Datasets
  • ๐ŸŒŽ Japan Neighborhoods - English dataset of Tokyo crime statistics across 5,078 neighborhoods ร— 7 years (36,222 records, 2018-2024), sourced from Tokyo Metropolitan Police open data. Includes interactive crime map, safety grading, and cost-of-living index. CC BY licensed.
  • ๐ŸŒŽ The Quiet-Broke Index - A 30-metro composite ranking of how much of a $400K household income gets consumed by housing, taxes, childcare, healthcare, and transport. Open methodology, free, no email gate.
  • ๐ŸŒŽ Crime Brasil - Open-data platform for Brazilian crime statistics. Neighborhood-level in Rio Grande do Sul (2.99M incidents across 79,024 neighborhoods, 2022โ€“2025), municipality-level for MG and RJ, plus national PRF highway and DATASUS interpersonal-violence data. Free REST API, CSV/Parquet, daily updates, CC BY 4.0.
  • ๐ŸŒŽ US Truck-Involved Fatal Crashes (FARS) 2018-2024 - Filtered subset of NHTSA Fatality Analysis Reporting System covering 33,898 fatal crashes involving medium and heavy commercial trucks across all 50 US states, 2018-2024. Includes interactive ๐ŸŒŽ Vision Zero Report Card comparing 19 cities, reproducible Python pipeline on ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด GitHub), and HuggingFace mirror. Permanent DOI, CC BY 4.0.
  • ๐ŸŒŽ State of Peptides 2026 - Structured reference dataset of 156 peptide and peptide-adjacent compounds, each with a regulatory status bucket, category, route, half-life, molecular weight, CAS number, reference count, and PubChem/DrugBank/Wikidata IDs. CSV and JSON, no login, CC BY 4.0.
  • ๐ŸŒŽ Quora's Big Datasets Answer
  • ๐ŸŒŽ Public Big Data Sets
  • ๐ŸŒŽ Kaggle Datasets
  • ๐ŸŒŽ A Deep Catalog of Human Genetic Variation
  • ๐ŸŒŽ A community-curated database of well-known people, places, and things
  • ๐ŸŒŽ Google Public Data
  • ๐ŸŒŽ World Bank Data
  • ๐ŸŒŽ NYC Taxi data
  • ๐ŸŒŽ Open Data Philly Connecting people with data for Philadelphia
  • ๐ŸŒŽ grouplens.org Sample movie (with ratings), book and wiki datasets
  • ๐ŸŒŽ UC Irvine Machine Learning Repository - contains data sets good for machine learning
  • ๐ŸŒŽ research-quality data sets by ๐ŸŒŽ Hilary Mason
  • ๐ŸŒŽ National Centers for Environmental Information
  • ๐ŸŒŽ ClimateData.us (related: ๐ŸŒŽ U.S. Climate Resilience Toolkit)
  • ๐ŸŒŽ r/datasets
  • ๐ŸŒŽ MapLight - provides a variety of data free of charge for uses that are freely available to the general public. Click on a data set below to learn more
  • ๐ŸŒŽ GHDx - Institute for Health Metrics and Evaluation - a catalog of health and demographic datasets from around the world and including IHME results
  • ๐ŸŒŽ St. Louis Federal Reserve Economic Data - FRED
  • ๐ŸŒŽ New Zealand Institute of Economic Research โ€“ Data1850
  • ย ย ย 523โญ ย ย ย 192๐Ÿด Open Data Sources)
  • ๐ŸŒŽ UNICEF Data
  • ๐ŸŒŽ undata
  • ๐ŸŒŽ NASA SocioEconomic Data and Applications Center - SEDAC
  • ๐ŸŒŽ The GDELT Project
  • ๐ŸŒŽ Sweden, Statistics
  • ๐ŸŒŽ StackExchange Data Explorer - an open source tool for running arbitrary queries against public data from the Stack Exchange network.
  • ๐ŸŒŽ San Fransisco Government Open Data
  • ๐ŸŒŽ IBM Asset Dataset
  • ๐ŸŒŽ Open data Index
  • ย ย ย 349โญ ย ย ย ย 82๐Ÿด Public Git Archive)
  • ๐ŸŒŽ GHTorrent
  • ๐ŸŒŽ Microsoft Research Open Data
  • ๐ŸŒŽ Open Government Data Platform India
  • ๐ŸŒŽ Google Dataset Search (beta)
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด NAYN.CO Turkish News with categories)
  • ย ย 1166โญ ย ย ย 596๐Ÿด Covid-19)
  • ย ย ย 117โญ ย ย ย ย 68๐Ÿด Covid-19 Google)
  • ๐ŸŒŽ Enron Email Dataset
  • ย ย ย 119โญ ย ย ย ย 43๐Ÿด 5000 Images of Clothes)
  • ๐ŸŒŽ IBB Open Portal
  • ๐ŸŒŽ The Humanitarian Data Exchange
  • ๐ŸŒŽ 250k+ Job Postings - An expanding dataset of historical job postings from Luxembourg from 2020 to today. Free with 250k+ job postings hosted on AWS Data Exchange.
  • ๐ŸŒŽ FinancialData.Net - Financial datasets (stock market data, financial statements, sustainability data, and more).
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด HDD Price Index) - Daily open dataset of the cheapest new internal 3.5" SATA hard-drive price per terabyte (USD/TB) by capacity tier on Amazon US, with a historical time series. CSV, JSON and JSONL, no login, CC BY 4.0.
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด BDE Score) - AI-powered multi-market stock analysis with transparent BDE scoring across 73 stocks (US/HK/A-share). EU AI Act Art.50 compliant. MIT license.
  • ๐ŸŒŽ Google Dataset Search โ€“ Find datasets across the web.
  • ๐ŸŒŽ notesjor corpus-collection - Free corpora (over 6 billion tokens) mostly German (both historically and in contemporary German).
  • ๐ŸŒŽ CLARIN-Repository - CLARIN is a European repository for scientific datasets.
  • ๐ŸŒŽ GBIF - Global Biodiversity Information Facility: 2.4B+ species occurrence records. Free, open API for ecological modeling and ML research.
  • ๐ŸŒŽ FAOSTAT - UN FAO statistics on food production, trade, land use, and emissions for 245+ countries. Free API and bulk download.
  • ๐ŸŒŽ Movebank - Free platform archiving 6B+ animal movement records from GPS and satellite telemetry. Open REST API, useful for spatiotemporal modeling and trajectory ML.
  • ๐ŸŒŽ Encyclopedia of Life - Open structured data on 1.9M+ species, including traits, classification, and media. Free API and bulk downloads for biodiversity and species-classification tasks.
  • ย ย ย 183โญ ย ย ย ย 33๐Ÿด FirstData) - The world's most comprehensive authoritative data source knowledge base. 210+ curated sources from governments, international organizations, and research institutions. MCP integration for AI agents. MIT licensed.
  • ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด latamdata-py) - Python package for one-line access to 38 open research datasets from Latin America (health, neuroscience, mental health, economics). pip install latamdata-py.
  • ย ย ย ย ย 4โญ ย ย ย ย ย 0๐Ÿด ZipCheckup) - Free ZIP-level environmental safety data for 42,000+ US ZIP codes: water quality, air quality, PFAS contamination, radon, lead, flood risk, and 11 more verticals. Public REST API, npm/PyPI packages, CC BY 4.0.
  • ๐ŸŒŽ Helium - Real-time news corpus with structured bias features across 15+ dimensions (3.2M+ articles, 5,000+ sources), live financial market data (stocks, ETFs, crypto) with AI-generated analysis, ML options pricing with probability metrics and full Greeks, historical options chain data for quantitative research; available via MCP server or REST API.
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด Verified Supplement Evidence) - Evidence-graded dietary-supplement dataset covering dosing, bioavailability by form, drug-nutrient interactions, NHANES deficiency prevalence, FDA FAERS adverse-event signals, and cost-per-effective-dose, with every clinical claim citing a PubMed PMID. CC BY 4.0, DOI 10.57967/hf/9356.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด WhatFontIs-Bench) - Synthetic benchmark for font family identification with 11,995 images of words set in 600 known fonts, annotated with word and per-letter boxes.

Comics

^ back to top ^

Other Awesome Lists

Hobby

Source

ย 30046โญ ย ย 6641๐Ÿด academic/awesome-datascience)

analytics
awesome
awesome-list
data-mining
data-science
data-scientists
data-visualization
deep-learning
hacktoberfest
machine-learning
science

Contributors

(top 30 of 314)

hmert

555 commits

z00rat

68 commits

erolrecep

65 commits

fakturk

43 commits

Correia-jpv/fucking-awesome-datascience

๐Ÿ“ An awesome Data Science repository to learn and apply for real world problems. With repository starsโญ and forks๐Ÿด

14

1,241 commits

updated Sep 22, 2026

See the code

README

AWESOME DATA SCIENCE

Awesome

Contributions are welcome - see CONTRIBUTING.md.

An open-source Data Science repository to learn and apply concepts toward solving real- world problems.

This is a shortcut path to start studying Data Science. Just follow the steps to answer the questions, "What is Data Science, and what should I study to learn Data Science?"


$ ๐ŸŒŽ academic

$ brew tap academic/tap
$ brew install academic

Sponsors

Creavit Studio: recording, editing, and motion in one app

Graphyn: visualize specialized agent workflows

Become a sponsor! github@academic.io

Table of Contents

What is Data Science?

^ back to top ^

Data Science is one of the hottest topics on the Computer and Internet farmland nowadays. People have gathered data from applications and systems until today and now is the time to analyze them. The next steps are producing suggestions from the data and creating predictions about the future. ๐ŸŒŽ Here you can find the biggest question for Data Science and hundreds of answers from experts.

LinkPreview
ย 37237โญ ย ย 7524๐Ÿด Data Science For Beginners)Microsoft are pleased to offer a 10-week, 20-lesson curriculum all about Data Science.
๐ŸŒŽ What is Data Science @ O'reillyData scientists combine entrepreneurship with patience, the willingness to build data products incrementally, the ability to explore, and the ability to iterate over a solution. They are inherently interdisciplinary. They can tackle all aspects of a problem, from initial data collection and data conditioning to drawing conclusions. They can think outside the box to come up with new ways to view the problem, or to work with very broadly defined problems: โ€œhereโ€™s a lot of data, what can you make from it?โ€
๐ŸŒŽ What is Data Science @ QuoraData Science is a combination of a number of aspects of Data such as Technology, Algorithm development, and data interference to study the data, analyse it, and find innovative solutions to difficult problems. Basically Data Science is all about Analysing data and driving for business growth by finding creative ways.
๐ŸŒŽ The sexiest job of 21st centuryData scientists today are akin to Wall Street โ€œquantsโ€ of the 1980s and 1990s. In those days people with backgrounds in physics and math streamed to investment banks and hedge funds, where they could devise entirely new algorithms and data strategies. Then a variety of universities developed masterโ€™s programs in financial engineering, which churned out a second generation of talent that was more accessible to mainstream firms. The pattern was repeated later in the 1990s with search engineers, whose rarefied skills soon came to be taught in computer science programs.
๐ŸŒŽ WikipediaData science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from many structural and unstructured data. Data science is related to data mining, machine learning and big data.
๐ŸŒŽ How to Become a Data ScientistData scientists are big data wranglers, gathering and analyzing large sets of structured and unstructured data. A data scientistโ€™s role combines computer science, statistics, and mathematics. They analyze, process, and model data then interpret the results to create actionable plans for companies and other organizations.
๐ŸŒŽ a very short history of #datascienceThe story of how data scientists became sexy is mostly the story of the coupling of the mature discipline of statistics with a very young one--computer science. The term โ€œData Scienceโ€ has emerged only recently to specifically designate a new profession that is expected to make sense of the vast stores of big data. But making sense of data has a long history and has been discussed by scientists, statisticians, librarians, computer scientists and others for years. The following timeline traces the evolution of the term โ€œData Scienceโ€ and its use, attempts to define it, and related terms.
๐ŸŒŽ Software Development Resources for Data ScientistsData scientists concentrate on making sense of data through exploratory analysis, statistics, and models. Software developers apply a separate set of knowledge with different tools. Although their focus may seem unrelated, data science teams can benefit from adopting software development best practices. Version control, automated testing, and other dev skills help create reproducible, production-ready code and tools.
๐ŸŒŽ Data Scientist RoadmapData science is an excellent career choice in todayโ€™s data-driven world where approx 328.77 million terabytes of data are generated daily. And this number is only increasing day by day, which in turn increases the demand for skilled data scientists who can utilize this data to drive business growth.
๐ŸŒŽ Navigating Your Path to Becoming a Data Scientist_Data science is one of the most in-demand careers today. With businesses increasingly relying on data to make decisions, the need for skilled data scientists has grown rapidly. Whether itโ€™s tech companies, healthcare organizations, or even government institutions, data scientists play a crucial role in turning raw data into valuable insights. But how do you become a data scientist, especially if youโ€™re just starting out? _

Where do I Start?

^ back to top ^

While not strictly necessary, having a programming language is a crucial skill to be effective as a data scientist. Currently, the most popular language is Python, closely followed by R. Python is a general-purpose scripting language that sees applications in a wide variety of fields. R is a domain-specific language for statistics, which contains a lot of common statistics tools out of the box. ๐ŸŒŽ Python is by far the most popular language in science, due in no small part to the ease at which it can be used and the vibrant ecosystem of user-generated packages. To install packages, there are two main methods: Pip (invoked as pip install), the package manager that comes bundled with Python, and ๐ŸŒŽ Anaconda (invoked as conda install), a powerful package manager that can install packages for Python, R, and can download executables like Git.

Unlike R, Python was not built from the ground up with data science in mind, but there are plenty of third party libraries to make up for this. A much more exhaustive list of packages can be found later in this document, but these four packages are a good set of choices to start your data science journey with: ๐ŸŒŽ Scikit-Learn is a general-purpose data science package which implements the most popular algorithms - it also includes rich documentation, tutorials, and examples of the models it implements. Even if you prefer to write your own implementations, Scikit-Learn is a valuable reference to the nuts-and-bolts behind many of the common algorithms you'll find. With ๐ŸŒŽ Pandas, one can collect and analyze their data into a convenient table format. ๐ŸŒŽ Numpy provides very fast tooling for mathematical operations, with a focus on vectors and matrices. ๐ŸŒŽ Seaborn, itself based on the ๐ŸŒŽ Matplotlib package, is a quick way to generate beautiful visualizations of your data, with many good defaults available out of the box, as well as a gallery showing how to produce many common visualizations of your data.

When embarking on your journey to becoming a data scientist, the choice of language isn't particularly important, and both Python and R have their pros and cons. Pick a language you like, and check out one of the Free courses we've listed below!

Beginner Roadmap

If you're just starting out, here's a simple recommended path:

  1. Learn Python โ€“ Start with basics: variables, loops, functions
  2. Learn core libraries โ€“ Pandas, NumPy, Matplotlib, Scikit-Learn
  3. Practice with beginner projects โ€“ Try Titanic survival or house price prediction on Kaggle
  4. Learn Math basics โ€“ Statistics, Linear Algebra, Probability
  5. Move into ML โ€“ Supervised learning โ†’ Unsupervised โ†’ Deep Learning

Agents

This section contains agent frameworks and tools that are useful for data science workflows.

Frameworks

  • ย ย ย 679โญ ย ย ย 105๐Ÿด ADK-Rust) - Production-ready AI agent development kit for Rust with model-agnostic design (Gemini, OpenAI, Anthropic), multiple agent types (LLM, Graph, Workflow), MCP support, and built-in telemetry.
  • ย ย ย 312โญ ย ย ย ย 44๐Ÿด Lumen) - Agent framework for chatting with data, turning natural language into SQL, transformation pipelines and visualizations. Outputs are declarative specs that can be inspected, edited, reopened in a notebook or composed into a dashboard.

Tools

  • ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Frostbyte MCP) - MCP server providing 13 data tools for AI agents: real-time crypto prices, IP geolocation, DNS lookups, web scraping to markdown, code execution, and screenshots. One API key for 40+ services.
  • ๐ŸŒŽ Arch Tools - 61 production-ready AI API tools for data science workflows: code analysis, web scraping, NLP, image generation, crypto data, and search. REST API and MCP protocol support. ย ย ย ย ย 1โญ ย ย ย ย ย 1๐Ÿด GitHub)
  • ๐ŸŒŽ Not Human Search - Search engine for AI agents that indexes 9,000+ AI tools and APIs, scoring each on agentic readiness (llms.txt, OpenAPI, MCP, ai-plugin.json). REST API and MCP server for programmatic tool discovery. ย ย ย ย ย 8โญ ย ย ย ย ย 1๐Ÿด GitHub)
  • ย ย ย ย 46โญ ย ย ย ย 16๐Ÿด DeepAlpha) - AI crypto trading framework using LightGBM + XGBoost ensemble with 72 ML features. 70.9% walk-forward validated accuracy on out-of-sample data. Supports Bybit and Binance. MIT licensed, available on ๐ŸŒŽ PyPI.
  • ย ย ย ย 21โญ ย ย ย ย ย 4๐Ÿด CAJAL) - Local AI agent for generating publication-ready scientific papers with real arXiv citations, IMRaD structure, and tribunal scoring. Runs 100% offline via Ollama with 4B-9B models. MIT licensed. ๐ŸŒŽ HuggingFace
  • ย ย ย 120โญ ย ย ย ย 44๐Ÿด ai-evaluation) - Open-source LLM and agent evaluation framework with 50+ metrics, LLM-as-Judge augmentation, and guardrail scanners (jailbreak, PII, prompt-injection). Useful for scoring RAG outputs, agent trajectories, and function-calling behavior in data-science workflows.
  • ย ย ย 292โญ ย ย ย ย 22๐Ÿด Kitaru) - Open-source platform that records real AI agent runs, replays them against changes, and evaluates outcomes before deployment.

Research & Knowledge Retrieval

  • ๐ŸŒŽ BGPT MCP - MCP server that gives AI agents access to a database of scientific papers built from raw experimental data extracted from full-text studies. Returns 25+ structured fields per paper including methods, results, sample sizes, and quality scores. ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด GitHub)

  • ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด Chunk Tuner) - Open-source Python library and MCP server to benchmark document chunking strategies for RAG, score retrieval quality, and recommend configurations for a corpus.

  • ย ย ย ย 16โญ ย ย ย ย ย 0๐Ÿด II-Commons) - Daily-updated skill and CLI for deterministic retrieval across arXiv, PubMed/PMC, and supported US policy corpora.

  • ๐ŸŒŽ Spraay x402 Gateway - x402 payment gateway with 23 Research & Reference endpoints for AI agents: Wikipedia, arXiv, PubMed, Wikidata, academic citation lookup, entity extraction, and more. Pay-per-call in USDC on Base & Solana โ€” no API keys or subscriptions. Also serves 150+ endpoints across 39 categories including geospatial, AI inference, DeFi, and compute. GitHub

  • ๐ŸŒŽ Suppr - AI literature search, document translation, and deep-research workspace for researchers.

Workflow

^ back to top ^

  • ๐ŸŒŽ sim - Sim Studio's interface is a lightweight, intuitive way to quickly build and deploy LLMs that connect with your favorite tools.

Training Resources

^ back to top ^

How do you learn data science? By doing data science, of course! Okay, okay - that might not be particularly helpful when you're first starting out. In this section, we've listed some learning resources, in rough order from least to greatest commitment - Tutorials, Massively Open Online Courses (MOOCs), Intensive Programs, and Colleges.

Tutorials

^ back to top ^

Free Courses

^ back to top ^

  • ย 21975โญ ย ย 4256๐Ÿด Data Science) - Open Source Society University
  • ๐ŸŒŽ Data Scientist with R
  • ๐ŸŒŽ Data Scientist with Python
  • ๐ŸŒŽ Genetic Algorithms OCW Course
  • ย 31248โญ ย ย 2585๐Ÿด AI Expert Roadmap) - Roadmap to becoming an Artificial Intelligence Expert
  • ๐ŸŒŽ Convex Optimization - Convex Optimization (basics of convex analysis; least-squares, linear and quadratic programs, semidefinite programming, minimax, extremal volume, and other problems; optimality conditions, duality theory...)
  • ๐ŸŒŽ Learning from Data - Introduction to machine learning covering basic theory, algorithms and applications
  • ๐ŸŒŽ Kaggle - Learn about Data Science, Machine Learning, Python etc
  • ๐ŸŒŽ ML Observability Fundamentals - Learn how to monitor and root-cause production ML issues.
  • ๐ŸŒŽ Weights & Biases Effective MLOps: Model Development - Free Course and Certification for building an end-to-end machine using W&B
  • ๐ŸŒŽ Python for Data Science by Scaler - This course is designed to empower beginners with the essential skills to excel in today's data-driven world. The comprehensive curriculum will give you a solid foundation in statistics, programming, data visualization, and machine learning.
  • ย ย ย 559โญ ย ย ย ย 63๐Ÿด MLSys-NYU-2022) - Slides, scripts and materials for the Machine Learning in Finance course at NYU Tandon, 2022.
  • ย ย ย 889โญ ย ย ย 133๐Ÿด Hands-on Train and Deploy ML) - A hands-on course to train and deploy a serverless API that predicts crypto prices.
  • ๐ŸŒŽ LLMOps: Building Real-World Applications With Large Language Models - Learn to build modern software with LLMs using the newest tools and techniques in the field.
  • ๐ŸŒŽ Prompt Engineering for Vision Models - Learn to prompt cutting-edge computer vision models with natural language, coordinate points, bounding boxes, segmentation masks, and even other images in this free course from DeepLearning.AI.
  • ๐ŸŒŽ Data Science Course By IBM - Free resources and learn what data science is and how itโ€™s used in different industries.
  • ๐ŸŒŽ Neural Networks: Zero to Hero - A free video series by Andrej Karpathy covering neural networks from scratch โ€” backpropagation, makemore, GPT, and more.

MOOC's

^ back to top ^

Intensive Programs

^ back to top ^

Colleges

^ back to top ^

The Data Science Toolbox

^ back to top ^

This section is a collection of packages, tools, algorithms, and other useful items in the data science world.

Algorithms

^ back to top ^

These are some Machine Learning and Data Mining algorithms and models help you to understand your data and derive meaning from it.

Three kinds of Machine Learning Systems

  • Based on training with human supervision
  • Based on learning incrementally on fly
  • Based on data points comparison and pattern detection

Comparison

  • ย ย ย 658โญ ย ย ย 167๐Ÿด datacompy) - DataComPy is a package to compare two Pandas DataFrames.

Supervised Learning

Unsupervised Learning

Semi-Supervised Learning

Reinforcement Learning

Data Mining Algorithms

Modern Data Mining Algorithms

Deep Learning architectures

General Machine Learning Packages

^ back to top ^

  • ๐ŸŒŽ scikit-learn
  • ย ย ย 955โญ ย ย ย 177๐Ÿด scikit-multilearn)
  • ย ย ย 491โญ ย ย ย ย 71๐Ÿด sklearn-expertsys)
  • ย ย 1586โญ ย ย ย 438๐Ÿด scikit-feature)
  • ย ย ย 421โญ ย ย ย ย 72๐Ÿด scikit-rebate)
  • ย ย ย 706โญ ย ย ย 102๐Ÿด seqlearn)
  • ย ย ย 520โญ ย ย ย 117๐Ÿด sklearn-bayes)
  • ย ย ย 440โญ ย ย ย 206๐Ÿด sklearn-crfsuite)
  • ย ย ย 771โญ ย ย ย 128๐Ÿด sklearn-deap)
  • ย ย ย ย 75โญ ย ย ย ย 11๐Ÿด sigopt_sklearn)
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด sklearn-evaluation)
  • ย ย 6594โญ ย ย 2414๐Ÿด scikit-image)
  • ย ย 6715โญ ย ย 1107๐Ÿด scikit-opt)
  • ย ย ย 388โญ ย ย ย ย 46๐Ÿด scikit-posthocs)
  • ๐ŸŒŽ feature-engine
  • ย ย ย ย ย 1โญ ย ย ย ย ย 0๐Ÿด me_fasttext) - Memory-efficient FastText variant with exact trie n-gram IDs, structure-aware row sharing, and mmap serving for large-vocabulary NLP.
  • ย ย ย 667โญ ย ย ย 174๐Ÿด pystruct)
  • ๐ŸŒŽ Shogun
  • ย ย 3089โญ ย ย ย 516๐Ÿด xLearn)
  • ย ย 5286โญ ย ย ย 682๐Ÿด cuML)
  • ย ย 6005โญ ย ย ย 877๐Ÿด causalml)
  • ย ย 5710โญ ย ย 1720๐Ÿด mlpack)
  • ย ย 5175โญ ย ย ย 916๐Ÿด MLxtend)
  • ย ย 2365โญ ย ย ย 322๐Ÿด modAL)
  • ย ย 1150โญ ย ย ย 254๐Ÿด Sparkit-learn)
  • ย ย 2517โญ ย ย ย 168๐Ÿด hyperlearn)
  • ย 14445โญ ย ย 3438๐Ÿด dlib)
  • ย ย 1619โญ ย ย ย 142๐Ÿด imodels)
  • ย ย ย ย 23โญ ย ย ย ย ย 1๐Ÿด jSciPy) - A Java port of SciPy's signal processing module, offering filters, transformations, and other scientific computing utilities.
  • ย ย ย 443โญ ย ย ย 122๐Ÿด RuleFit)
  • ย ย 1015โญ ย ย ย 291๐Ÿด pyGAM)
  • ย ย 4056โญ ย ย ย 302๐Ÿด Deepchecks)
  • ๐ŸŒŽ scikit-survival
  • ๐ŸŒŽ interpretable
  • ย 28784โญ ย ย 8902๐Ÿด XGBoost)
  • ย 18794โญ ย ย 4070๐Ÿด LightGBM)
  • ย ย 9111โญ ย ย 1335๐Ÿด CatBoost)
  • ย ย ย 708โญ ย ย ย ย 42๐Ÿด PerpetualBooster)
  • ย 36321โญ ย ย 3794๐Ÿด JAX)
  • ย ย ย ย 11โญ ย ย ย ย 22๐Ÿด PhilanthroPy) - Scikit-learn native toolkit for nonprofit fundraising analytics: leakage-safe donor propensity, lapse, planned-giving, wealth-screening and revenue-forecasting estimators.

Deep Learning Packages

PyTorch Ecosystem

  • 103162โญ ย 30013๐Ÿด PyTorch)
  • ย ย ย 215โญ ย ย ย ย 15๐Ÿด TorchDR) - GPU and multi-GPU dimensionality reduction with a scikit-learn-compatible API.
  • ย 17925โญ ย ย 7265๐Ÿด torchvision)
  • ย ย 3554โญ ย ย ย 807๐Ÿด torchtext)
  • ย ย 2943โญ ย ย ย 800๐Ÿด torchaudio)
  • ย ย 4786โญ ย ย ย 726๐Ÿด ignite)
  • ย ย 1723โญ ย ย ย 310๐Ÿด PyTorchNet)
  • ย ย ย 578โญ ย ย ย ย 63๐Ÿด PyToune)
  • ย ย 6179โญ ย ย ย 417๐Ÿด skorch)
  • ย ย ย 362โญ ย ย ย ย 51๐Ÿด PyVarInf)
  • ย 24098โญ ย ย 4058๐Ÿด pytorch_geometric)
  • ย ย 3915โญ ย ย ย 602๐Ÿด GPyTorch)
  • ย ย 9057โญ ย ย 1021๐Ÿด pyro)
  • ย ย 3385โญ ย ย ย 397๐Ÿด Catalyst)
  • ย ย 1687โญ ย ย ย 179๐Ÿด pytorch_tabular)
  • ย 10609โญ ย ย 3423๐Ÿด Yolov3)
  • ย 58064โญ ย 17466๐Ÿด Yolov5)
  • ย 61883โญ ย 11790๐Ÿด Yolov8)

TensorFlow Ecosystem

  • 200233โญ ย 77037๐Ÿด TensorFlow)
  • ย ย 7380โญ ย ย 1582๐Ÿด TensorLayer)
  • ย ย 9575โญ ย ย 2352๐Ÿด TFLearn)
  • ย ย 9970โญ ย ย 1305๐Ÿด Sonnet)
  • ย ย 6284โญ ย ย 1778๐Ÿด tensorpack)
  • ย ย 3130โญ ย ย ย 386๐Ÿด TRFL)
  • ย ย 3733โญ ย ย ย 330๐Ÿด Polyaxon)
  • ย ย ย 735โญ ย ย ย 158๐Ÿด NeuPy)
  • ย ย ย 353โญ ย ย ย ย 35๐Ÿด tfdeploy)
  • ย ย ย 706โญ ย ย ย 101๐Ÿด tensorflow-upstream)
  • ย ย 1816โญ ย ย ย 262๐Ÿด TensorFlow Fold)
  • ย ย ย ย 60โญ ย ย ย ย 27๐Ÿด tensorlm)
  • ย ย ย ย 11โญ ย ย ย ย ย 5๐Ÿด TensorLight)
  • ย ย 1629โญ ย ย ย 255๐Ÿด Mesh TensorFlow)
  • ย 11762โญ ย ย 1217๐Ÿด Ludwig)
  • ย ย 3027โญ ย ย ย 753๐Ÿด TF-Agents)
  • ย ย 3305โญ ย ย ย 523๐Ÿด TensorForce)

Keras Ecosystem

  • ๐ŸŒŽ Keras
  • ย ย 1585โญ ย ย ย 635๐Ÿด keras-contrib)
  • ย ย 2173โญ ย ย ย 314๐Ÿด Hyperas)
  • ย ย 1574โญ ย ย ย 303๐Ÿด Elephas)
  • ย ย ย 486โญ ย ย ย ย 47๐Ÿด Hera)
  • ย ย 2397โญ ย ย ย 344๐Ÿด Spektral)
  • ย ย ย 584โญ ย ย ย 108๐Ÿด qkeras)
  • ย ย 5548โญ ย ย 1343๐Ÿด keras-rl)
  • ย ย 1636โญ ย ย ย 264๐Ÿด Talos)

Visualization Tools

^ back to top ^

Miscellaneous Tools

^ back to top ^

LinkDescription
ย ย ย 529โญ ย ย ย ย 75๐Ÿด The Data Science Lifecycle Process)The Data Science Lifecycle Process is a process for taking data science teams from Idea to Value repeatedly and sustainably. The process is documented in this repo
ย ย ย 205โญ ย ย ย ย 60๐Ÿด Data Science Lifecycle Template Repo)Template repository for data science lifecycle project
ย ย ย 570โญ ย ย ย ย 82๐Ÿด TabGAN)Synthetic tabular data generation using GANs, Diffusion Models, and LLMs with adversarial filtering and privacy metrics.
ย ย ย 277โญ ย ย ย ย 24๐Ÿด RexMex)A general purpose recommender metrics library for fair evaluation.
ย ย ย 785โญ ย ย ย 100๐Ÿด ChemicalX)A PyTorch based deep learning library for drug pair scoring.
ย ย ย ย 30โญ ย ย ย ย ย 5๐Ÿด FileShot.io)Secure zero-knowledge encrypted file sharing (AES-256-GCM in-browser). No account required, MIT licensed, self-hostable, optional link expiry.
๐ŸŒŽ CorpusExplorerSoftware for corpus linguists and text/data mining enthusiasts. Build your own corpora in over 60 languages. Use over 50 tools/visualizations.
ย ย 2990โญ ย ย ย 402๐Ÿด PyTorch Geometric Temporal)Representation learning on dynamic graphs.
ย ย ย 715โญ ย ย ย ย 54๐Ÿด Little Ball of Fur)A graph sampling library for NetworkX with a Scikit-Learn like API.
ย ย 2286โญ ย ย ย 254๐Ÿด Karate Club)An unsupervised machine learning extension library for NetworkX with a Scikit-Learn like API.
ย ย 3546โญ ย ย ย 456๐Ÿด ML Workspace)All-in-one web-based IDE for machine learning and data science. The workspace is deployed as a Docker container and is preloaded with a variety of popular data science libraries (e.g., Tensorflow, PyTorch) and dev tools (e.g., Jupyter, VS Code)
ย ย 9649โญ ย ย ย 742๐Ÿด xonsh shell)A Python-powered shell that enables integration, management and orchestration of data science libraries mostly written in Python, allowing you to build pipelines, code and command-based workflows. It can also be used as a kernel for Jupyter Notebook.
๐ŸŒŽ Neptune.aiCommunity-friendly platform supporting data scientists in creating and sharing machine learning models. Neptune facilitates teamwork, infrastructure management, models comparison and reproducibility.
ย ย ย 136โญ ย ย ย ย 32๐Ÿด steppy)Lightweight, Python library for fast and reproducible machine learning experimentation. Introduces very simple interface that enables clean machine learning pipeline design.
ย ย ย ย 23โญ ย ย ย ย ย 9๐Ÿด steppy-toolkit)Curated collection of the neural networks, transformers and models that make your machine learning work faster and more effective.
๐ŸŒŽ Datalab from Googleeasily explore, visualize, analyze, and transform data using familiar languages, such as Python and SQL, interactively.
๐ŸŒŽ Hortonworks Sandboxis a personal, portable Hadoop environment that comes with a dozen interactive Hadoop tutorials.
๐ŸŒŽ Ris a free software environment for statistical computing and graphics.
๐ŸŒŽ Tidyverseis an opinionated collection of R packages designed for data science. All packages share an underlying design philosophy, grammar, and data structures.
๐ŸŒŽ RStudioIDE โ€“ powerful user interface for R. Itโ€™s free and open source, and works on Windows, Mac, and Linux.
๐ŸŒŽ Python - Pandas - AnacondaCompletely free enterprise-ready Python distribution for large-scale data processing, predictive analytics, and scientific computing
ย ย 3256โญ ย ย ย 239๐Ÿด Pandas GUI)Pandas GUI
ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด NuriStat)Free open-source SPSS alternative โ€” menu-driven desktop statistics (t-tests, ANOVA, regression, survival analysis, ROC) with SPSS .sav import/export
ย 39834โญ ย ย 3121๐Ÿด Polars)Fast DataFrame library for Rust and Python, designed as a faster alternative to Pandas
๐ŸŒŽ CiteMefree academic citation generator with a built-in reference checker that flags fabricated or hallucinated references. Searches 11+ scholarly databases (OpenAlex, PubMed, Semantic Scholar, CrossRef, SciELO), formats 40+ citation styles, and offers a public API. No sign-up; available in English, Spanish, Portuguese, French, and German.
๐ŸŒŽ Scikit-LearnMachine Learning in Python
๐ŸŒŽ NumPyNumPy is fundamental for scientific computing with Python. It supports large, multi-dimensional arrays and matrices and includes an assortment of high-level mathematical functions to operate on these arrays.
๐ŸŒŽ VaexVaex is a Python library that allows you to visualize large datasets and calculate statistics at high speeds.
๐ŸŒŽ SciPySciPy works with NumPy arrays and provides efficient routines for numerical integration and optimization.
๐ŸŒŽ Data Science ToolboxCoursera Course
๐ŸŒŽ Data Science ToolboxBlog
๐ŸŒŽ Wolfram Data Science PlatformTake numerical, textual, image, GIS or other data and give it the Wolfram treatment, carrying out a full spectrum of data science analysis and visualization and automatically generate rich interactive reportsโ€”all powered by the revolutionary knowledge-based Wolfram Language.
๐ŸŒŽ DatadogSolutions, code, and devops for high-scale data science.
๐ŸŒŽ VarianceBuild powerful data visualizations for the web without writing JavaScript
๐ŸŒŽ Kite Development KitThe Kite Software Development Kit (Apache License, Version 2.0), or Kite for short, is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.
๐ŸŒŽ Domino Data LabsRun, scale, share, and deploy your models โ€” without any infrastructure or setup.
๐ŸŒŽ Apache FlinkA platform for efficient, distributed, general-purpose data processing.
๐ŸŒŽ Apache HamaApache Hama is an Apache Top-Level open source project, allowing you to do advanced analytics beyond MapReduce.
๐ŸŒŽ WekaWeka is a collection of machine learning algorithms for data mining tasks.
๐ŸŒŽ OctaveGNU Octave is a high-level interpreted language, primarily intended for numerical computations.(Free Matlab)
๐ŸŒŽ Apache SparkLightning-fast cluster computing
ย ย ย 326โญ ย ย ย ย 69๐Ÿด Hydrosphere Mist)a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services.
๐ŸŒŽ Data MechanicsA data science and engineering platform making Apache Spark more developer-friendly and cost-effective.
๐ŸŒŽ CaffeDeep Learning Framework
๐ŸŒŽ TorchA SCIENTIFIC COMPUTING FRAMEWORK FOR LUAJIT
ย ย 3860โญ ย ย ย 804๐Ÿด Nervana's python based Deep Learning Framework)Intelยฎ Nervanaโ„ข reference deep learning framework committed to best performance on all hardware.
ย ย ย 396โญ ย ย ย ย 52๐Ÿด Skale)High performance distributed data processing in NodeJS
๐ŸŒŽ AerosolveA machine learning package built for humans.
ย ย ย 312โญ ย ย ย ย 80๐Ÿด Intel framework)Intelยฎ Deep Learning Framework
๐ŸŒŽ DatawrapperAn open source data visualization platform helping everyone to create simple, correct and embeddable charts. Also at ย ย 1458โญ ย ย ย 279๐Ÿด github.com)
๐ŸŒŽ Tensor FlowTensorFlow is an Open Source Software Library for Machine Intelligence
๐ŸŒŽ Natural Language ToolkitAn introductory yet powerful toolkit for natural language processing and classification
ย 20466โญ ย ย 2043๐Ÿด FunASR)Industrial-grade speech recognition toolkit supporting 50+ languages with built-in VAD, punctuation, speaker diarization, and emotion detection. OpenAI-compatible API server included.
๐ŸŒŽ Annotation LabFree End-to-End No-Code platform for text annotation and DL model training/tuning. Out-of-the-box support for Named Entity Recognition, Classification, Relation extraction and Assertion Status Spark NLP models. Unlimited support for users, teams, projects, documents.
๐ŸŒŽ nlp-toolkit for node.jsThis module covers some basic nlp principles and implementations. The main focus is performance. When we deal with sample or training data in nlp, we quickly run out of memory. Therefore every implementation in this module is written as stream to only hold that data in memory that is currently processed at any step.
๐ŸŒŽ Juliahigh-level, high-performance dynamic programming language for technical computing
ย ย 2905โญ ย ย ย 426๐Ÿด IJulia)a Julia-language backend combined with the Jupyter interactive environment
๐ŸŒŽ Apache ZeppelinWeb-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more
ย ย 7683โญ ย ย ย 915๐Ÿด Featuretools)An open source framework for automated feature engineering written in python
ย ย 1536โญ ย ย ย 229๐Ÿด Optimus)Cleansing, pre-processing, feature engineering, exploratory data analysis and easy ML with PySpark backend.
ย 15309โญ ย ย 1706๐Ÿด Albumentations)ะ fast and framework agnostic image augmentation library that implements a diverse set of augmentation techniques. Supports classification, segmentation, and detection out of the box. Was used to win a number of Deep Learning competitions at Kaggle, Topcoder and those that were a part of the CVPR workshops.
ย 15881โญ ย ย 1329๐Ÿด DVC)An open-source data science version control system. It helps track, organize and make data science projects reproducible. In its very basic scenario it helps version control and share large data and model files.
ย ย ย ย 26โญ ย ย ย ย ย 5๐Ÿด Lambdo)is a workflow engine that significantly simplifies data analysis by combining in one analysis pipeline (i) feature engineering and machine learning (ii) model training and prediction (iii) table population and column evaluation.
ย ย 7301โญ ย ย 1442๐Ÿด Feast)A feature store for the management, discovery, and access of machine learning features. Feast provides a consistent view of feature data for both model training and model serving.
ย ย 3733โญ ย ย ย 330๐Ÿด Polyaxon)A platform for reproducible and scalable machine learning and deep learning.
๐ŸŒŽ UBIAIEasy-to-use text annotation tool for teams with most comprehensive auto-annotation features. Supports NER, relations and document classification as well as OCR annotation for invoice labeling
ย ย 6883โญ ย ย ย 801๐Ÿด Trains)Auto-Magical Experiment Manager, Version Control & DevOps for AI
ย ย 1307โญ ย ย ย 159๐Ÿด Hopsworks)Open-source data-intensive machine learning platform with a feature store. Ingest and manage features for both online (MySQL Cluster) and offline (Apache Hive) access, train and serve models at scale.
ย 39763โญ ย ย 6244๐Ÿด MindsDB)MindsDB is an Explainable AutoML framework for developers. With MindsDB you can build, train and use state of the art ML models in as simple as one line of code.
ย ย ย 510โญ ย ย ย 101๐Ÿด Lightwood)A Pytorch based framework that breaks down machine learning problems into smaller blocks that can be glued together seamlessly with an objective to build predictive models with one line of code.
ย ย 4119โญ ย ย ย 749๐Ÿด AWS Data Wrangler)An open-source Python package that extends the power of Pandas library to AWS connecting DataFrames and AWS data related services (Amazon Redshift, AWS Glue, Amazon Athena, Amazon EMR, etc).
๐ŸŒŽ Amazon RekognitionAWS Rekognition is a service that lets developers working with Amazon Web Services add image analysis to their applications. Catalog assets, automate workflows, and extract meaning from your media and applications.
๐ŸŒŽ Amazon TextractAutomatically extract printed text, handwriting, and data from any document.
๐ŸŒŽ Amazon Lookout for VisionSpot product defects using computer vision to automate quality inspection. Identify missing product components, vehicle and structure damage, and irregularities for comprehensive quality control.
๐ŸŒŽ Amazon CodeGuruAutomate code reviews and optimize application performance with ML-powered recommendations.
ย ย 4187โญ ย ย ย 345๐Ÿด CML)An open source toolkit for using continuous integration in data science projects. Automatically train and test models in production-like environments with GitHub Actions & GitLab CI, and autogenerate visual reports on pull/merge requests.
๐ŸŒŽ DaskAn open source Python library to painlessly transition your analytics code to distributed computing systems (Big Data)
ย 41617โญ ย ย 3814๐Ÿด DuckDB)An in-process SQL OLAP database management system
๐ŸŒŽ StatsmodelsA Python-based inferential statistics, hypothesis testing and regression framework
๐ŸŒŽ GensimAn open-source library for topic modeling of natural language text
๐ŸŒŽ spaCyA performant natural language processing toolkit
ย ย 8809โญ ย ย 1477๐Ÿด Grid Studio)Grid studio is a web-based spreadsheet application with full integration of the Python programming language.
ย 49968โญ ย 19121๐Ÿด Python Data Science Handbook)Python Data Science Handbook: full text in Jupyter Notebooks
ย ย ย 228โญ ย ย ย ย 34๐Ÿด Shapley)A data-driven framework to quantify the value of classifiers in a machine learning ensemble.
๐ŸŒŽ DAGsHubA platform built on open source tools for data, model and pipeline management.
๐ŸŒŽ DeepnoteA new kind of data science notebook. Jupyter-compatible, with real-time collaboration and running in the cloud.
๐ŸŒŽ ValohaiAn MLOps platform that handles machine orchestration, automatic reproducibility and deployment.
๐ŸŒŽ PyMC3A Python Library for Probabalistic Programming (Bayesian Inference and Machine Learning)
๐ŸŒŽ PyStanPython interface to Stan (Bayesian inference and modeling)
๐ŸŒŽ hmmlearnUnsupervised learning and inference of Hidden Markov Models
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Chaos Genius)ML powered analytics engine for outlier/anomaly detection and root cause analysis
๐ŸŒŽ NimbleboxA full-stack MLOps platform designed to help data scientists and machine learning practitioners around the world discover, create, and launch multi-cloud apps from their web browser.
ย ย 3450โญ ย ย ย 257๐Ÿด Towhee)A Python library that helps you encode your unstructured data into embeddings.
ย ย ย 672โญ ย ย ย ย 58๐Ÿด LineaPy)Ever been frustrated with cleaning up long, messy Jupyter notebooks? With LineaPy, an open source Python library, it takes as little as two lines of code to transform messy development code into production pipelines.
ย ย 2233โญ ย ย ย 168๐Ÿด envd)๐Ÿ•๏ธ machine learning development environment for data science and AI/ML engineering teams
๐ŸŒŽ Explore Data Science LibrariesA search engine ๐Ÿ”Ž tool to discover & find a curated list of popular & new libraries, top authors, trending project kits, discussions, tutorials & learning resources
ย ย ย 718โญ ย ย ย ย 42๐Ÿด MLEM)๐Ÿถ Version and deploy your ML models following GitOps principles
๐ŸŒŽ MLflowMLOps framework for managing ML models across their full lifecycle
ย 11669โญ ย ย ย 919๐Ÿด cleanlab)Python library for data-centric AI and automatically detecting various issues in ML datasets
ย 10728โญ ย ย 1195๐Ÿด AutoGluon)AutoML to easily produce accurate predictions for image, text, tabular, time-series, and multi-modal data
๐ŸŒŽ Arize AIArize AI community tier observability tool for monitoring machine learning models in production and root-causing issues such as data quality and performance drift.
๐ŸŒŽ Aureo.ioAureo.io is a low-code platform that focuses on building artificial intelligence. It provides users with the capability to create pipelines, automations and integrate them with artificial intelligence models โ€“ all with their basic data.
๐ŸŒŽ ERD LabFree cloud based entity relationship diagram (ERD) tool made for developers.
๐ŸŒŽ Arize-PhoenixMLOps in a notebook - uncover insights, surface problems, monitor, and fine tune your models.
ย ย ย 176โญ ย ย ย ย 70๐Ÿด Comet)An MLOps platform with experiment tracking, model production management, a model registry, and full data lineage to support your ML workflow from training straight through to production.
ย 22188โญ ย ย 1817๐Ÿด Opik)Evaluate, test, and ship LLM applications across your dev and production lifecycles.
๐ŸŒŽ SynthicalAI-powered collaborative environment for research. Find relevant papers, create collections to manage bibliography, and summarize content โ€” all in one place
ย ย ย ย 13โญ ย ย ย ย ย 0๐Ÿด teeplot)Workflow tool to automatically organize data visualization output
ย 45814โญ ย ย 4387๐Ÿด Streamlit)App framework for Machine Learning and Data Science projects
ย 43596โญ ย ย 3608๐Ÿด Gradio)Create customizable UI components around machine learning models
ย 11258โญ ย ย ย 900๐Ÿด Weights & Biases)Experiment tracking, dataset versioning, and model management
ย 15881โญ ย ย 1329๐Ÿด DVC)Open-source version control system for machine learning projects
ย 14830โญ ย ย 1391๐Ÿด Optuna)Automatic hyperparameter optimization software framework
ย 43889โญ ย ย 8068๐Ÿด Ray Tune)Scalable hyperparameter tuning library
ย 46932โญ ย 17892๐Ÿด Apache Airflow)Platform to programmatically author, schedule, and monitor workflows
ย 23893โญ ย ย 2534๐Ÿด Prefect)Workflow management system for modern data stacks
ย 11006โญ ย ย 1079๐Ÿด Kedro)Open-source Python framework for creating reproducible, maintainable data science code
ย ย 2595โญ ย ย ย 216๐Ÿด Hamilton)Lightweight library to author and manage reliable data transformations
ย 25772โญ ย ย 3750๐Ÿด SHAP)Game theoretic approach to explain the output of any machine learning model
ย ย 6946โญ ย ย ย 787๐Ÿด InterpretML)InterpretML implements the Explainable Boosting Machine (EBM), a modern, fully interpretable machine learning model based on Generalized Additive Models (GAMs). This open-source package also provides visualization tools for EBMs, other glass-box models, and black-box explanations
ย 12163โญ ย ย 1846๐Ÿด LIME)Explaining the predictions of any machine learning classifier
ย ย 7547โญ ย ย ย 890๐Ÿด flyte)Workflow automation platform for machine learning
ย 13899โญ ย ย 2574๐Ÿด dbt)Data build tool
ย ย 2342โญ ย ย ย ย 75๐Ÿด zasper)Supercharged IDE for Data Science
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด skrub)A Python library to ease preprocessing and feature engineering for tabular machine learning
ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด Glyph)Framework-agnostic TypeScript library for generating, searching, and comparing MinHash fingerprints for fast text similarity, deduplication, and retrieval.
๐ŸŒŽ CodeflashShip Blazing-Fast Python Code โ€” Every Time
๐ŸŒŽ Hugging FacePopular open platform for sharing ML models, datasets, and collaborating on NLP and generative AI projects.
ย ย ย ย 73โญ ย ย ย ย ย 6๐Ÿด Chinese-Elite)An open-source project that automatically maps relationship networks by parsing public data using LLMs and visualizes it as an interactive graph.
ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด Desbordante)An open-source data profiler specifically focused on discovery and validation of complex patterns, such as ๐ŸŒŽ numerical association rules, ๐ŸŒŽ differential dependencies, ๐ŸŒŽ denial constraints, and more.
ย ย ย ย 57โญ ย ย ย ย ย 8๐Ÿด dna-claude-analysis)Personal genome analysis toolkit with Python scripts analyzing raw DNA data across 17 categories (health risks, ancestry, pharmacogenomics, nutrition, psychology, and more) and generating a terminal-style single-page HTML visualization.
ย ย ย 257โญ ย ย ย ย 10๐Ÿด RunMat)Fast MATLAB-syntax runtime with automatic CPU/GPU execution and fused array kernels.
ย ย ย ย 17โญ ย ย ย ย ย 2๐Ÿด Turbostream)A terminal UI for experimenting with custom rule engines and selective LLM analysis on real-time data streams, without worrying about streaming infra or backpressure.
ย ย 1792โญ ย ย ย 166๐Ÿด WFGY ProblemMap)Open source โ€œfailure atlasโ€ of 16 recurring issues in LLM and RAG pipelines, with observable symptoms and suggested fixes for data science teams.
๐ŸŒŽ DeploybaseTrack real-time GPU and LLM pricing across all cloud and inference providers.
ย ย 4647โญ ย ย ย 736๐Ÿด DeepAnalyze)An agentic LLM for autonomous data science, which can autonomously complete a wide range of data science tasks without human intervention.
ย ย ย ย ย 7โญ ย ย ย ย ย 0๐Ÿด Disco)Superhuman exploratory data analysis. Finds the feature interactions and subgroup effects in tabular data that LLMs and manual exploration miss โ€” with p-values, effect sizes, and literature citations. Free for public data.
๐ŸŒŽ AI for DatabaseChat with your database in natural language โ€” no SQL needed. Get instant insights, build self-refreshing dashboards, and trigger automated workflows based on database changes.
ย ย ย ย 46โญ ย ย ย ย 16๐Ÿด Crypto Pump Scanner)AI-powered cryptocurrency trading bot with LSTM neural network (84.6% accuracy). Real-time pump detection, walk-forward validated models, multi-exchange support (Bybit, Binance, OKX, Gate.io). Open source.
ย ย 2050โญ ย ย ย 632๐Ÿด Future AGI)Open-source platform to simulate, evaluate, trace, guardrail, route, and optimize LLM and AI agent apps in one feedback loop, so agents don't just get monitored, they self-improve. Self-hostable. Apache-2.0.

Literature and Media

^ back to top ^

This section includes some additional reading material, channels to watch, and talks to listen to.

Books

^ back to top ^

Book Deals (Affiliated)

Journals, Publications and Magazines

^ back to top ^

Newsletters

^ back to top ^

  • ๐ŸŒŽ AI Weekly - Curated AI intelligence briefing from industry leaders covering models, funding, policy, and applications. 3x/week since 2017, 40K+ subscribers.
  • ๐ŸŒŽ DataTalks.Club. A weekly newsletter about data-related things. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ The Analytics Engineering Roundup. A newsletter about data science. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ Techpresso. A free daily newsletter covering the most impactful developments in AI, ML, and tech. ๐ŸŒŽ Archive.
  • ๐ŸŒŽ DiamantAI. Practical AI engineering and generative AI explained simply: RAG, agents, and LLM application patterns for builders.
  • ๐ŸŒŽ Bamboo Weekly - Weekly pandas exercises based on current events and real-world public data, with fully worked solutions. Issues older than two years are free, as are the first two questions + answers in current issues. ๐ŸŒŽ Archive.

Mailing lists

^ back to top ^

Bloggers

^ back to top ^

Presentations

^ back to top ^

Podcasts

^ back to top ^

YouTube Videos & Channels

^ back to top ^

Socialize

^ back to top ^

Below are some Social Media links. Connect with other data scientists!

Facebook Accounts

^ back to top ^

Twitter Accounts

^ back to top ^

TwitterDescription
๐ŸŒŽ Big Data CombineRapid-fire, live tryouts for data scientists seeking to monetize their models as trading strategies
Big Data ManiaData Viz Wiz, Data Journalist, Growth Hacker, Author of Data Science for Dummies (2015)
๐ŸŒŽ Big Data ScienceBig Data, Data Science, Predictive Modeling, Business Analytics, Hadoop, Decision and Operations Research.
Charlie GreenbackerDirector of Data Science at @ExploreAltamira
๐ŸŒŽ Chris SaidData scientist at Twitter
๐ŸŒŽ Clare CorthellDev, Design, Data Science @mattermark #hackerei
๐ŸŒŽ DADI Charles-Abner#datascientist @Ekimetrics. , #machinelearning #dataviz #DynamicCharts #Hadoop #R #Python #NLP #Bitcoin #dataenthousiast
๐ŸŒŽ Data Science CentralData Science Central is the industry's single resource for Big Data practitioners.
๐ŸŒŽ Data Science LondonData Science. Big Data. Data Hacks. Data Junkies. Data Startups. Open Data
๐ŸŒŽ Data Science ReneeDocumenting my path from SQL Data Analyst pursuing an Engineering Master's Degree to Data Scientist
๐ŸŒŽ Data Science ReportMission is to help guide & advance careers in Data Science & Analytics
๐ŸŒŽ Data Science TipsTips and Tricks for Data Scientists around the world! #datascience #bigdata
๐ŸŒŽ Data VizzardDataViz, Security, Military
๐ŸŒŽ DataScienceX
deeplearning4j
๐ŸŒŽ DJ PatilWhite House Data Chief, VP @ RelateIQ.
๐ŸŒŽ Domino Data Lab
๐ŸŒŽ Drew ConwayData nerd, hacker, student of conflict.
Emilio Ferrara#Networks, #MachineLearning and #DataScience. I work on #Social Media. Postdoc at @IndianaUniv
๐ŸŒŽ Erin BartoloRunning with #BigData--enjoying a love/hate relationship with its hype. @iSchoolSU #DataScience Program Mgr.
๐ŸŒŽ Greg RedaWorking @ GrubHub about data and pandas
๐ŸŒŽ Gregory PiatetskyKDnuggets President, Analytics/Big Data/Data Mining/Data Science expert, KDD & SIGKDD co-founder, was Chief Scientist at 2 startups, part-time philosopher.
๐ŸŒŽ Hadley WickhamChief Scientist at RStudio, and an Adjunct Professor of Statistics at the University of Auckland, Stanford University, and Rice University.
๐ŸŒŽ Hakan KardasData Scientist
๐ŸŒŽ Hilary MasonData Scientist in Residence at @accel.
๐ŸŒŽ Jeff HammerbacherReTweeting about data science
๐ŸŒŽ John Myles WhiteScientist at Facebook and Julia developer. Author of Machine Learning for Hackers and Bandit Algorithms for Website Optimization. Tweets reflect my views only.
๐ŸŒŽ Juan Miguel LavistaPrincipal Data Scientist @ Microsoft Data Science Team
๐ŸŒŽ Julia EvansHacker - Pandas - Data Analyze
๐ŸŒŽ Kenneth CukierThe Economist's Data Editor and co-author of Big Data (https://www.big-data-book.com/).
Kevin DavenportOrganizer of https://www.meetup.com/San-Diego-Data-Science-R-Users-Group/
๐ŸŒŽ Kevin MarkhamData science instructor, and founder of ๐ŸŒŽ Data School
๐ŸŒŽ Kim ReesInteractive data visualization and tools. Data flaneur.
๐ŸŒŽ Kirk BorneDataScientist, PhD Astrophysicist, Top #BigData Influencer.
Linda RegberData storyteller, visualizations.
๐ŸŒŽ Luis ReiPhD Student. Programming, Mobile, Web. Artificial Intelligence, Intelligent Robotics Machine Learning, Data Mining, Natural Language Processing, Data Science.
Mark StevensonData Analytics Recruitment Specialist at Salt (@SaltJobs) Analytics - Insight - Big Data - Data science
๐ŸŒŽ Matt HarrisonOpinions of full-stack Python guy, author, instructor, currently playing Data Scientist. Occasional fathering, husbanding, organic gardening.
๐ŸŒŽ Matthew RussellMining the Social Web.
๐ŸŒŽ Mert NuhoฤŸluData Scientist at BizQualify, Developer
๐ŸŒŽ Monica RogatiData @ Jawbone. Turned data into stories & products at LinkedIn. Text mining, applied machine learning, recommender systems. Ex-gamer, ex-machine coder; namer.
๐ŸŒŽ Noah IliinskyVisualization & interaction designer. Practical cyclist. Author of vis books: https://www.oreilly.com/pub/au/4419
๐ŸŒŽ Paul MillerCloud Computing/ Big Data/ Open Data Analyst & Consultant. Writer, Speaker & Moderator. Gigaom Research Analyst.
๐ŸŒŽ Peter SkomorochCreating intelligent systems to automate tasks & improve decisions. Entrepreneur, ex-Principal Data Scientist @LinkedIn. Machine Learning, ProductRei, Networks
๐ŸŒŽ Prash ChanSolution Architect @ IBM, Master Data Management, Data Quality & Data Governance Blogger. Data Science, Hadoop, Big Data & Cloud.
๐ŸŒŽ Quora Data ScienceQuora's data science topic
๐ŸŒŽ R-BloggersTweet blog posts from the R blogosphere, data science conferences, and (!) open jobs for data scientists.
๐ŸŒŽ Rand Hindi
๐ŸŒŽ Randy OlsonComputer scientist researching artificial intelligence. Data tinkerer. Community leader for @DataIsBeautiful. #OpenScience advocate.
๐ŸŒŽ Recep ErolData Science geek @ UALR
๐ŸŒŽ Ryan OrbanData scientist, genetic origamist, hardware aficionado
๐ŸŒŽ Sean J. TaylorSocial Scientist. Hacker. Facebook Data Science Team. Keywords: Experiments, Causal Inference, Statistics, Machine Learning, Economics.
๐ŸŒŽ Silvia K. Spiva#DataScience at Cisco
๐ŸŒŽ Harsh B. GuptaData Scientist at BBVA Compass
๐ŸŒŽ Spencer NelsonData nerd
๐ŸŒŽ Talha OzEnjoys ABM, SNA, DM, ML, NLP, HI, Python, Java. Top percentile Kaggler/data scientist
๐ŸŒŽ Tasos SkarlatidisComplex Event Processing, Big Data, Artificial Intelligence and Machine Learning. Passionate about programming and open-source.
๐ŸŒŽ Terry TimkoInfoGov; Bigdata; Data as a Service; Data Science; Open, Social & Business Data Convergence
๐ŸŒŽ Tony BaerIT analyst with Ovum covering Big Data & data management with some systems engineering thrown in.
๐ŸŒŽ Tony OjedaData Scientist , Author , Entrepreneur. Co-founder @DataCommunityDC. Founder @DistrictDataLab. #DataScience #BigData #DataDC
๐ŸŒŽ Vamshi AmbatiData Science @ PayPal. #NLP, #machinelearning; PhD, Carnegie Mellon alumni (Blog: https://allthingsds.wordpress.com )
๐ŸŒŽ Wes McKinneyPandas (Python Data Analysis library).
๐ŸŒŽ WileyEdSenior Manager - @Seagate Big Data Analytics @McKinsey Alum #BigData + #Analytics Evangelist #Hadoop, #Cloud, #Digital, & #R Enthusiast
๐ŸŒŽ WNYC Data News TeamThe data news crew at @WNYC. Practicing data-driven journalism, making it visual, and showing our work.
๐ŸŒŽ Alexey GrigorevData science author
๐ŸŒŽ ฤฐlker ArslanData science author. Shares mostly about Julia programming
๐ŸŒŽ INEVITABLEAI & Data Science Start-up Company based in England, UK
๐ŸŒŽ Jan Oliver RรผdigerML, DL and Data Science - with a focus on text-/data-mining

Telegram Channels

^ back to top ^

  • ๐ŸŒŽ Open Data Science โ€“ First Telegram Data Science channel. Covering all technical and popular staff about anything related to Data Science: AI, Big Data, Machine Learning, Statistics, general Math and the applications of former.
  • ๐ŸŒŽ Loss function porn โ€” Beautiful posts on DS/ML theme with video or graphic visualization.
  • ๐ŸŒŽ Machinelearning โ€“ Daily ML news.

Slack Communities

top

GitHub Groups

Data Science Competitions

Some data mining competition platforms

Fun

Infographics

^ back to top ^

PreviewDescription
๐ŸŒŽ ๐ŸŒŽ Key differences of a data scientist vs. data engineer
๐ŸŒŽ A visual guide to Becoming a Data Scientist in 8 Steps by ๐ŸŒŽ DataCamp ๐ŸŒŽ (img)
๐ŸŒŽ Mindmap on required skills ๐ŸŒŽ img)
๐ŸŒŽ Swami Chandrasekaran made a ๐ŸŒŽ Curriculum via Metro map.
๐ŸŒŽ by ๐ŸŒŽ @kzawadz via ๐ŸŒŽ twitter
๐ŸŒŽ By ๐ŸŒŽ Data Science Central
๐ŸŒŽ Data Science Wars: R vs Python
๐ŸŒŽ How to select statistical or machine learning techniques
๐ŸŒŽ ๐ŸŒŽ Choosing the Right Estimator
๐ŸŒŽ The Data Science Industry: Who Does What
๐ŸŒŽ Data Science Venn Euler Diagram
๐ŸŒŽ Different Data Science Skills and Roles from ๐ŸŒŽ Springboard
๐ŸŒŽ Data Fallacies To AvoidA simple and friendly way of teaching your non-data scientist/non-statistician colleagues ๐ŸŒŽ how to avoid mistakes with data. From Geckoboard's ๐ŸŒŽ Data Literacy Lessons.

Datasets

^ back to top ^

  • ๐ŸŒŽ Academic Torrents
  • ๐ŸŒŽ ADS-B Exchange - Specific datasets for aircraft and Automatic Dependent Surveillance-Broadcast (ADS-B) sources.
  • ๐ŸŒŽ Chinese Tea Dataset - Curated open dataset of 100+ Chinese teas with category, origin, caffeine level, flavor notes, oxidation, and brewing parameters. Available as JSON and CSV.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด College ROI Dataset) - Lifetime return-on-investment estimates for ~30K US bachelor's programs across 1,775 institutions, built from FREOPP, IPEDS, and BEA regional price data. 5 CSVs with data dictionary, CC BY 4.0, Zenodo DOI.
  • ย ย ย ย ย ?โญ ย ย ย ย ย ?๐Ÿด AI Displacement Tracker) - Structured dataset tracking 92 AI-attributed workforce reduction events affecting 453,748 workers across 12 countries and 11 sectors. JSON and CSV formats. CC-BY-4.0 licensed.
  • ๐ŸŒŽ Packrift Packaging Optimization Benchmark Corpus - Public packaging product dataset generated from 1,000 exact-spec SKU records, with downloadable CSV and JSON files for ecommerce fulfillment and warehouse analysis.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด Pokemon Card Centering Measurements) - 320 measured PSA-style centering annotations (left/right and top/bottom border percentages, tilt) across 302 real eBay-listed Pokemon cards. CSV, CC BY 4.0, Zenodo DOI.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด Pokemon Card Sold-Price Reference by Grade) - Median sold price by grade (raw, PSA 9, PSA 10) for 486 Pokemon cards, with sample size and confidence flag per card. CSV, CC BY 4.0, Zenodo DOI.
  • ๐ŸŒŽ Evidaxis Momentum Snapshots - Weekly snapshots of public development and citation activity for open-source and research-native AI systems, content-addressed and byte-reproducible from public inputs. JSON and CSV per snapshot date, CC0, DOI 10.5281/zenodo.21076011.
  • ๐ŸŒŽ hadoopilluminated.com
  • ๐ŸŒŽ data.gov - The home of the U.S. Government's open data
  • ๐ŸŒŽ United States Census Bureau
  • ๐ŸŒŽ enigma.com - Navigate the world of public data - Quickly search and analyze billions of public records published by governments, companies and organizations.
  • ๐ŸŒŽ datahub.io
  • ๐ŸŒŽ aws.amazon.com/datasets
  • ๐ŸŒŽ datacite.org
  • ๐ŸŒŽ The official portal for European data
  • ๐ŸŒŽ NASDAQ:DATA - Nasdaq Data Link A premier source for financial, economic and alternative datasets.
  • ๐ŸŒŽ Congressional Stock Brain - Free AI-powered tool that scores U.S. congressional STOCK Act trade disclosures by significance. Machine-scored signals from 537 lawmakers's public trade filings.
  • ๐ŸŒŽ figshare.com
  • ๐ŸŒŽ GeoLite Legacy Downloadable Databases
  • ๐ŸŒŽ Hugging Face Datasets
  • ๐ŸŒŽ Japan Neighborhoods - English dataset of Tokyo crime statistics across 5,078 neighborhoods ร— 7 years (36,222 records, 2018-2024), sourced from Tokyo Metropolitan Police open data. Includes interactive crime map, safety grading, and cost-of-living index. CC BY licensed.
  • ๐ŸŒŽ The Quiet-Broke Index - A 30-metro composite ranking of how much of a $400K household income gets consumed by housing, taxes, childcare, healthcare, and transport. Open methodology, free, no email gate.
  • ๐ŸŒŽ Crime Brasil - Open-data platform for Brazilian crime statistics. Neighborhood-level in Rio Grande do Sul (2.99M incidents across 79,024 neighborhoods, 2022โ€“2025), municipality-level for MG and RJ, plus national PRF highway and DATASUS interpersonal-violence data. Free REST API, CSV/Parquet, daily updates, CC BY 4.0.
  • ๐ŸŒŽ US Truck-Involved Fatal Crashes (FARS) 2018-2024 - Filtered subset of NHTSA Fatality Analysis Reporting System covering 33,898 fatal crashes involving medium and heavy commercial trucks across all 50 US states, 2018-2024. Includes interactive ๐ŸŒŽ Vision Zero Report Card comparing 19 cities, reproducible Python pipeline on ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด GitHub), and HuggingFace mirror. Permanent DOI, CC BY 4.0.
  • ๐ŸŒŽ State of Peptides 2026 - Structured reference dataset of 156 peptide and peptide-adjacent compounds, each with a regulatory status bucket, category, route, half-life, molecular weight, CAS number, reference count, and PubChem/DrugBank/Wikidata IDs. CSV and JSON, no login, CC BY 4.0.
  • ๐ŸŒŽ Quora's Big Datasets Answer
  • ๐ŸŒŽ Public Big Data Sets
  • ๐ŸŒŽ Kaggle Datasets
  • ๐ŸŒŽ A Deep Catalog of Human Genetic Variation
  • ๐ŸŒŽ A community-curated database of well-known people, places, and things
  • ๐ŸŒŽ Google Public Data
  • ๐ŸŒŽ World Bank Data
  • ๐ŸŒŽ NYC Taxi data
  • ๐ŸŒŽ Open Data Philly Connecting people with data for Philadelphia
  • ๐ŸŒŽ grouplens.org Sample movie (with ratings), book and wiki datasets
  • ๐ŸŒŽ UC Irvine Machine Learning Repository - contains data sets good for machine learning
  • ๐ŸŒŽ research-quality data sets by ๐ŸŒŽ Hilary Mason
  • ๐ŸŒŽ National Centers for Environmental Information
  • ๐ŸŒŽ ClimateData.us (related: ๐ŸŒŽ U.S. Climate Resilience Toolkit)
  • ๐ŸŒŽ r/datasets
  • ๐ŸŒŽ MapLight - provides a variety of data free of charge for uses that are freely available to the general public. Click on a data set below to learn more
  • ๐ŸŒŽ GHDx - Institute for Health Metrics and Evaluation - a catalog of health and demographic datasets from around the world and including IHME results
  • ๐ŸŒŽ St. Louis Federal Reserve Economic Data - FRED
  • ๐ŸŒŽ New Zealand Institute of Economic Research โ€“ Data1850
  • ย ย ย 523โญ ย ย ย 192๐Ÿด Open Data Sources)
  • ๐ŸŒŽ UNICEF Data
  • ๐ŸŒŽ undata
  • ๐ŸŒŽ NASA SocioEconomic Data and Applications Center - SEDAC
  • ๐ŸŒŽ The GDELT Project
  • ๐ŸŒŽ Sweden, Statistics
  • ๐ŸŒŽ StackExchange Data Explorer - an open source tool for running arbitrary queries against public data from the Stack Exchange network.
  • ๐ŸŒŽ San Fransisco Government Open Data
  • ๐ŸŒŽ IBM Asset Dataset
  • ๐ŸŒŽ Open data Index
  • ย ย ย 349โญ ย ย ย ย 82๐Ÿด Public Git Archive)
  • ๐ŸŒŽ GHTorrent
  • ๐ŸŒŽ Microsoft Research Open Data
  • ๐ŸŒŽ Open Government Data Platform India
  • ๐ŸŒŽ Google Dataset Search (beta)
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด NAYN.CO Turkish News with categories)
  • ย ย 1166โญ ย ย ย 596๐Ÿด Covid-19)
  • ย ย ย 117โญ ย ย ย ย 68๐Ÿด Covid-19 Google)
  • ๐ŸŒŽ Enron Email Dataset
  • ย ย ย 119โญ ย ย ย ย 43๐Ÿด 5000 Images of Clothes)
  • ๐ŸŒŽ IBB Open Portal
  • ๐ŸŒŽ The Humanitarian Data Exchange
  • ๐ŸŒŽ 250k+ Job Postings - An expanding dataset of historical job postings from Luxembourg from 2020 to today. Free with 250k+ job postings hosted on AWS Data Exchange.
  • ๐ŸŒŽ FinancialData.Net - Financial datasets (stock market data, financial statements, sustainability data, and more).
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด HDD Price Index) - Daily open dataset of the cheapest new internal 3.5" SATA hard-drive price per terabyte (USD/TB) by capacity tier on Amazon US, with a historical time series. CSV, JSON and JSONL, no login, CC BY 4.0.
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด BDE Score) - AI-powered multi-market stock analysis with transparent BDE scoring across 73 stocks (US/HK/A-share). EU AI Act Art.50 compliant. MIT license.
  • ๐ŸŒŽ Google Dataset Search โ€“ Find datasets across the web.
  • ๐ŸŒŽ notesjor corpus-collection - Free corpora (over 6 billion tokens) mostly German (both historically and in contemporary German).
  • ๐ŸŒŽ CLARIN-Repository - CLARIN is a European repository for scientific datasets.
  • ๐ŸŒŽ GBIF - Global Biodiversity Information Facility: 2.4B+ species occurrence records. Free, open API for ecological modeling and ML research.
  • ๐ŸŒŽ FAOSTAT - UN FAO statistics on food production, trade, land use, and emissions for 245+ countries. Free API and bulk download.
  • ๐ŸŒŽ Movebank - Free platform archiving 6B+ animal movement records from GPS and satellite telemetry. Open REST API, useful for spatiotemporal modeling and trajectory ML.
  • ๐ŸŒŽ Encyclopedia of Life - Open structured data on 1.9M+ species, including traits, classification, and media. Free API and bulk downloads for biodiversity and species-classification tasks.
  • ย ย ย 183โญ ย ย ย ย 33๐Ÿด FirstData) - The world's most comprehensive authoritative data source knowledge base. 210+ curated sources from governments, international organizations, and research institutions. MCP integration for AI agents. MIT licensed.
  • ย ย ย ย ย 2โญ ย ย ย ย ย 0๐Ÿด latamdata-py) - Python package for one-line access to 38 open research datasets from Latin America (health, neuroscience, mental health, economics). pip install latamdata-py.
  • ย ย ย ย ย 4โญ ย ย ย ย ย 0๐Ÿด ZipCheckup) - Free ZIP-level environmental safety data for 42,000+ US ZIP codes: water quality, air quality, PFAS contamination, radon, lead, flood risk, and 11 more verticals. Public REST API, npm/PyPI packages, CC BY 4.0.
  • ๐ŸŒŽ Helium - Real-time news corpus with structured bias features across 15+ dimensions (3.2M+ articles, 5,000+ sources), live financial market data (stocks, ETFs, crypto) with AI-generated analysis, ML options pricing with probability metrics and full Greeks, historical options chain data for quantitative research; available via MCP server or REST API.
  • ย ย ย ย ย 3โญ ย ย ย ย ย 0๐Ÿด Verified Supplement Evidence) - Evidence-graded dietary-supplement dataset covering dosing, bioavailability by form, drug-nutrient interactions, NHANES deficiency prevalence, FDA FAERS adverse-event signals, and cost-per-effective-dose, with every clinical claim citing a PubMed PMID. CC BY 4.0, DOI 10.57967/hf/9356.
  • ย ย ย ย ย 0โญ ย ย ย ย ย 0๐Ÿด WhatFontIs-Bench) - Synthetic benchmark for font family identification with 11,995 images of words set in 600 known fonts, annotated with word and per-letter boxes.

Comics

^ back to top ^

Other Awesome Lists

Hobby

Source

ย 30046โญ ย ย 6641๐Ÿด academic/awesome-datascience)

analytics
awesome
awesome-list
data-mining
data-science
data-scientists
data-visualization
deep-learning
hacktoberfest
machine-learning
science

Contributors

(top 30 of 314)

hmert

555 commits

z00rat

68 commits

erolrecep

65 commits

fakturk

43 commits