bebopbabailey/ov-llm-server

OpenVINO backend on Ubuntu Intel Mac Mini

stars

commits

Python

primary language

Apr 9, 2026

updated

README

ov-llm-server

OpenVINO LLM server for the Mini.

Current posture:

standalone backend, not an active LiteLLM handle
maintenance-oriented service boundary
no dependency churn or host-binding changes without explicit approval

Read first:

SERVICE_SPEC.md
CONSTRAINTS.md
RUNBOOK.md

Contributors

bebopbabailey

13 commits

Similar repos

bebopbabailey/homelab-llm

main monorepo

same org

Lamy210/LLM_server

openvinotoolkit/model_server

A scalable inference server for models optimized with OpenVINO™

929

Glanderlice/open_llm

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the…

21,611

LoselSpt/LLM

Onyx-AI-Studio/studio-llm-service

LLM service for the Generative AI Studio.

sebastian-napora/llm-server

Languages

Python

57.0%

Shell

41.8%

Makefile

1.1%

bebopbabailey/ov-llm-server

OpenVINO backend on Ubuntu Intel Mac Mini

stars

commits

Python

primary language

Apr 9, 2026

updated

README

ov-llm-server

OpenVINO LLM server for the Mini.

Current posture:

standalone backend, not an active LiteLLM handle
maintenance-oriented service boundary
no dependency churn or host-binding changes without explicit approval

Read first:

SERVICE_SPEC.md
CONSTRAINTS.md
RUNBOOK.md

Similar repos

bebopbabailey/homelab-llm

main monorepo

same org

Lamy210/LLM_server

openvinotoolkit/model_server

A scalable inference server for models optimized with OpenVINO™

929

Glanderlice/open_llm

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the…

21,611

LoselSpt/LLM

Onyx-AI-Studio/studio-llm-service

LLM service for the Generative AI Studio.

sebastian-napora/llm-server

Contributors

bebopbabailey

13 commits

Languages

Python

57.0%

Shell

41.8%

Makefile

1.1%