pbloem/former

Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)

Python

1,102

69 commits

updated Mar 20, 2025

peterbloem.nl/blog/transformers

See the code

README

This repository is no longer maintained. For the latest version, see https://codeberg.org/pbm/former

machine-learning

pytorch

transformer

Significant stargazers

Piotr Migdał

740 followers · starred Aug 2019

Juan Manuel Pérez

154 followers · starred Jan 2020

vincent d warmerdam

2,848 followers · starred Mar 2020

Dat Tran

1,372 followers · starred Feb 2021

Similar repos

hkproj/pytorch-transformer

Attention is all you need implementation

1,316

brian030128/transformers_

A fork from huggingface transformers.

sidijju/NestedTensorsTransformers

Implemented Nested Tensors for Transformers

gordicaleksa/pytorch-original-transformer

My implementation of the original transformer model (Vaswani et al.). I've additionally included…

1,116

jingqun/textharmony

Model

sgrvinod/a-PyTorch-Tutorial-to-Transformers

Attention Is All You Need | a PyTorch Tutorial to Transformers

389

ramu11/PyTorch_ML_Models

eliasubz/pytorch-basics