modal-labs/gpu-glossary

GPU documentation for humans

Python

750

62 commits

updated Sep 4, 2026

modal.com/gpu-glossary

See the code

See what people are saying

Newest first

Most points

Message	Score	Date
GPU Glossary	2	Sep 28, 2026
GPU Glossary (Readable)	2	Sep 27, 2026
GPU Glossary	4	Sep 27, 2026
Groups of gpu threads are called warps. https://modal.com/gpu-glossary/device-software/warp on Rust Threads on the GPU	0	Apr 14, 2026
What Is Arithmetic Bandwidth?	2	Jan 9, 2026
CUDA Docs for Humans	2	Oct 14, 2025
GPU Glossary	1	Oct 14, 2025
GPU Glossary	4	Sep 22, 2025
The GPU Glossary: Performance	2	Sep 4, 2025
Modal's GPU glossary is a good overview about how GPUs work [0]. Karpathy's LLM overview is a good high level overview on LLMs [1]. 3b1b's video (and subsequent videos) on transformers was excellent at helping me understand the math at a high level [2]. This matrix multiplication optimization… on Show HN: TokenDagger – A tokenizer faster than OpenAI's Tiktoken	0	Jun 30, 2025

README

GPU Glossary

This repository contains the source content for the Modal GPU Glossary, a dictionary of terms related to programming GPUs, with a focus on the GPUs that run on the Modal platform, NVIDIA GPUs.

Licenses

All files in the gpu-glossary folder of this repository are licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) License. See gpu-glossary/LICENSE for details.

The remainder of the files in this repository are licensed under the MIT License. See LICENSE for details.

Translations

简体中文

documentation

gpu

Significant stargazers

(top 24 of 26)

Xiaoyu Zhang

2,858 followers · starred Nov 2025

Burak Varlı

75 followers · starred Aug 2026

willxxy

61 followers · starred Jul 2026

Ronen Schaffer

13 followers · starred Sep 2025

Similar repos

NVIDIA/nvapi

NVAPI is NVIDIA's core software development kit that allows direct access to NVIDIA GPUs and…

249

HeKun-NVIDIA/CUDA-Programming-Guide-in-Chinese

This is a Chinese translation of the CUDA programming guide

2,056

NVIDIA/open-gpu-doc

Documentation of NVIDIA chip/hardware interfaces

1,369

arpitingle/gpu-alpha

High Quality Resources on GPU Programming/Architecture

589

gpu-mode/resource-stream

GPU programming related news and material links

2,378

Rust-GPU/rust-cuda

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

5,408

ROCm/HIP

HIP: C++ Heterogeneous-Compute Interface for Portability

4,417

NVIDIA/go-nvlib

A collection of useful Go libraries for use with NVIDIA GPU management tools