amachwe/gen_ai_web_server

Web-server to run any Gen AI Model!

Python

22 commits

updated Nov 1, 2025

See the code

README

gen_ai_web_server

Web-server to run any Gen AI Model!

Just use the LLM Wrapper (or the pipeline version) to wrap your favourite Hugging Face accessible LLM and you are ready to rock!

Similar repos

kevban/llm-api

A flask api that runs llm models from huggingface

Lamy210/LLM_server

TechX-Corp/selfhost-llm-server

Self-host LLM using candle framework from HuggingFace

Onyx-AI-Studio/studio-llm-service

LLM service for the Generative AI Studio.

owainkenwayucl/LLM_Playground

Messing with LLMs + Generative AI

Hieuman/GenC-LlaMa

Model

frkri/ModelRunner

Run LLM models locally with an HTTP API

QUT-GenAI-Lab/inference-gateway

A unified API to provide LLM inference capabilities to GenAI Arcade widgets

amachwe/gen_ai_web_server

Web-server to run any Gen AI Model!

Python

22 commits

updated Nov 1, 2025

See the code

README

gen_ai_web_server

Web-server to run any Gen AI Model!

Just use the LLM Wrapper (or the pipeline version) to wrap your favourite Hugging Face accessible LLM and you are ready to rock!

Similar repos

kevban/llm-api

A flask api that runs llm models from huggingface

Lamy210/LLM_server

TechX-Corp/selfhost-llm-server

Self-host LLM using candle framework from HuggingFace

Onyx-AI-Studio/studio-llm-service

LLM service for the Generative AI Studio.

owainkenwayucl/LLM_Playground

Messing with LLMs + Generative AI

Hieuman/GenC-LlaMa

Model

frkri/ModelRunner

Run LLM models locally with an HTTP API

QUT-GenAI-Lab/inference-gateway

A unified API to provide LLM inference capabilities to GenAI Arcade widgets