Shadowgraph
About
Sign in

epicure/llama2.js

Inference Llama 2 in one file of pure JavaScript(HTML)

36

stars

163

commits

Python

primary language

May 20, 2025

updated

README

llama2.js

llama2.js

A pure JavaScript port of Karpathy's llama2.c with a simple UI.

How to run

  1. Download Karpathy's Llama2 (Orig instructions) parameters pretrained on TinyStories dataset

    wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories42M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories110M.bin

  2. Open run.html via a WebServer

     python -m http.server 8080
 open http://localhost:8080/run.html

Performance

Tokens/sec measurement on Apple M1

tok/s15M42M110M
🐒~30~13~5

License

MIT

Contributors

karpathy

111 commits

richinseattle

9 commits

epicure

6 commits

aegkmq

5 commits

Similar repos

tairov/llama2.py

Inference Llama 2 in one file of pure Python

426

shared contributors

karpathy/llama2.c

Inference Llama 2 in one file of pure C

20,058

shared contributors

trholding/llama2.c

Llama 2 Everywhere (L2E)

1,523

shared contributors

wizzard0/llama2.ts

Llama2 inference in one TypeScript file

20

gaxler/llama2.rs

Inference Llama 2 in one file of pure Rust πŸ¦€

236

atjsh/llmlingua-2-js

JavaScript/TypeScript implementation of LLMLingua-2 (Experimental)

32

flaneur2020/llama2.rs

πŸ¦™πŸ¦™.πŸ¦€

28

trrahul/llama2.cs

Inference Llama 2 in one file of pure C#

103

Languages

Python

48.6%

C

27.6%

HTML

22.2%

Makefile

1.6%

epicure/llama2.js

Inference Llama 2 in one file of pure JavaScript(HTML)

36

stars

163

commits

Python

primary language

May 20, 2025

updated

README

llama2.js

llama2.js

A pure JavaScript port of Karpathy's llama2.c with a simple UI.

How to run

  1. Download Karpathy's Llama2 (Orig instructions) parameters pretrained on TinyStories dataset

    wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories42M.bin
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories110M.bin

  2. Open run.html via a WebServer

     python -m http.server 8080
 open http://localhost:8080/run.html

Performance

Tokens/sec measurement on Apple M1

tok/s15M42M110M
🐒~30~13~5

License

MIT

Similar repos

tairov/llama2.py

Inference Llama 2 in one file of pure Python

426

shared contributors

karpathy/llama2.c

Inference Llama 2 in one file of pure C

20,058

shared contributors

trholding/llama2.c

Llama 2 Everywhere (L2E)

1,523

shared contributors

wizzard0/llama2.ts

Llama2 inference in one TypeScript file

20

gaxler/llama2.rs

Inference Llama 2 in one file of pure Rust πŸ¦€

236

atjsh/llmlingua-2-js

JavaScript/TypeScript implementation of LLMLingua-2 (Experimental)

32

flaneur2020/llama2.rs

πŸ¦™πŸ¦™.πŸ¦€

28

trrahul/llama2.cs

Inference Llama 2 in one file of pure C#

103

Contributors

karpathy

111 commits

richinseattle

9 commits

epicure

6 commits

aegkmq

5 commits

Languages

Python

48.6%

C

27.6%

HTML

22.2%

Makefile

1.6%