Local LLM deployment and integration
10 repos
Python-based tools and applications for running large language models locally on consumer hardware, with a focus on practical integrations like chatbots, speech interfaces, and messaging platform connectors. The cluster centers on Ollama and similar on-device AI frameworks that enable private, offline inference without cloud dependencies. Key examples include browser extensions, Telegram bots, and speech-to-speech applications that leverage local models for real-world use cases.
Python · 7
TypeScript · 3
ollama ·11,515
chrome-extension ·9,339
chat-application ·8,205
localllm ·8,205
open-source ·8,205
local-ai ·3,310
ai ·2,333
llm ·2,317
chatbot ·1,183
offline-ai ·1,135
