Prathmesh234/simple-inference

Simple inference engine for llama from first principles

hamelsmu/llama-inference

experiments with inference on llama

ziliangpeng/tinyllm

LLM inference in Python - GPT-2, OPT, LLaMA with KV cache, weight loader, benchmark CLI

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference

NeuralSentinel/LLM-CPU-Inference

LLM-CPU-Inference