Shadowgraph
About
Sign in

marcelbtec/transformer-visualizer

The inner working of a transformer

0

stars

6

commits

JavaScript

primary language

Nov 20, 2025

updated

transformer-visualizer.vercel.app

README

πŸ”¬ Transformer Architecture Visualizer

An interactive technical visualization of transformer model components built with Next.js and React.

πŸš€ Features

  • Technical Accuracy: Real token IDs, embeddings, and attention matrices
  • Interactive Components: Click attention matrices, explore different steps
  • Mathematical Foundations: Actual formulas and computations
  • Beautiful UI: Dark theme with artistic gradients and animations

πŸ› οΈ Components Visualized

  1. Input Text Processing
  2. Tokenization - WordPiece/BPE tokenization
  3. Token Embeddings - Dense vector representations
  4. Positional Encoding - Sinusoidal position information
  5. Self-Attention - Multi-head attention mechanism
  6. Feed Forward - Position-wise neural networks

πŸƒβ€β™‚οΈ Getting Started

Installation

npm install

πŸ“„ License MIT License - feel free to use for educational purposes!

Contributors

marcelbtec

6 commits

Similar repos

FateScript/token_visualizer

Token level visualization tools for large language models

91

devMuniz02/Image-Attention-Visualizer

Interactive Gradio app for visualizing image-to-text attention in multimodal models.

0

Shinichi0713/LLM-fundamental-study

this site is the fundamental page of LLM-mechanism

3

hnmr293/llama-viz

The attention map viewer for LLaMA models.

36

varaprasadh/llm-school

0

raiyanyahya/how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

3,293

SumanthRH/tokenization

A comprehensive deep dive into the world of tokens

231

anthropics/jacobian-lens

Companion code for the global workspace interpretability paper

1,892

Languages

JavaScript

98.7%

CSS

1.3%

marcelbtec/transformer-visualizer

The inner working of a transformer

0

stars

6

commits

JavaScript

primary language

Nov 20, 2025

updated

transformer-visualizer.vercel.app

README

πŸ”¬ Transformer Architecture Visualizer

An interactive technical visualization of transformer model components built with Next.js and React.

πŸš€ Features

  • Technical Accuracy: Real token IDs, embeddings, and attention matrices
  • Interactive Components: Click attention matrices, explore different steps
  • Mathematical Foundations: Actual formulas and computations
  • Beautiful UI: Dark theme with artistic gradients and animations

πŸ› οΈ Components Visualized

  1. Input Text Processing
  2. Tokenization - WordPiece/BPE tokenization
  3. Token Embeddings - Dense vector representations
  4. Positional Encoding - Sinusoidal position information
  5. Self-Attention - Multi-head attention mechanism
  6. Feed Forward - Position-wise neural networks

πŸƒβ€β™‚οΈ Getting Started

Installation

npm install

πŸ“„ License MIT License - feel free to use for educational purposes!

Similar repos

FateScript/token_visualizer

Token level visualization tools for large language models

91

devMuniz02/Image-Attention-Visualizer

Interactive Gradio app for visualizing image-to-text attention in multimodal models.

0

Shinichi0713/LLM-fundamental-study

this site is the fundamental page of LLM-mechanism

3

hnmr293/llama-viz

The attention map viewer for LLaMA models.

36

varaprasadh/llm-school

0

raiyanyahya/how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

3,293

SumanthRH/tokenization

A comprehensive deep dive into the world of tokens

231

anthropics/jacobian-lens

Companion code for the global workspace interpretability paper

1,892

Contributors

marcelbtec

6 commits

Languages

JavaScript

98.7%

CSS

1.3%