TechX-Corp/selfhost-llm-server

Self-host LLM using candle framework from HuggingFace

fujie-cit/finetune_llm

finetuning example

kevban/llm-api

A flask api that runs llm models from huggingface

rainbow-brain/LLM_Embedding_Finetuning

LLM을 활용하기 위한 Embedding 모델과, LLM 모델의 finetuning 하는 방법을 모은 곳

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference