Prathmesh234/simple-inference-autoresearch

Simple inference scaffolding + autoresearch

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference

ziliangpeng/tinyllm

LLM inference in Python - GPT-2, OPT, LLaMA with KV cache, weight loader, benchmark CLI

saurabhaloneai/Hermes

Inference engine for vlm

hamelsmu/llama-inference

experiments with inference on llama

Taylor-eOS/local-language-models

An inconsistent assortment of small LLM's for inference on home hardware