2 repos
ziliangpeng/tinyllm
LLM inference in Python - GPT-2, OPT, LLaMA with KV cache, weight loader, benchmark CLI
0
24 commits
ziliangpeng/triton-llm
Pure Python + Triton GPT-2 inference (no PyTorch)
32 commits
