A flask api that runs llm models from huggingface
Python
0
5 commits
updated May 30, 2023
TechX-Corp/selfhost-llm-server
Self-host LLM using candle framework from HuggingFace
Lamy210/LLM_server
Glanderlice/open_llm
2
BoltzmachineQ/MindLLM
LoselSpt/LLM
tyukei/llm-mojo
ziliangpeng/tinyllm
LLM inference in Python - GPT-2, OPT, LLaMA with KV cache, weight loader, benchmark CLI
binxia/LLMGA-pretrained-mlp
