GradientHQ/parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python

1,396

410 commits

updated Jul 1, 2026

See the code

README

Trusted by Partners

SGLang vLLM Qwen DeepSeek Kimi Minimax ZAI

license issue resolution open issues

Parallax by Gradient - Host LLMs across devices sharing GPU to make your AI go brrr | Product Hunt

Gradient | Blog | X/Twitter (Gradient) | X/Twitter (Parallax) | Discord | Arxiv

News

  • [2026/02] 🦞 Parallax now supports OpenClaw integration! See Docs
  • [2025/10] 🔥 Parallax won #1 Product of The Day on Product Hunt!
  • [2025/10] 🔥 Parallax version 0.0.1 has been released!

About

A fully decentralized inference engine developed by Gradient. Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location. Its core features include:

  • Host local LLM on personal devices
  • Cross-platform support
  • Pipeline parallel model sharding
  • Paged KV cache management & continuous batching for Mac
  • Dynamic request scheduling and routing for high performance

The backend architecture:

User Guide

Quick Install

git clone https://github.com/GradientHQ/parallax.git
cd parallax
./install.sh
source .venv/bin/activate
parallax serve -m Qwen/Qwen3.5-0.8B

Contributing

We warmly welcome contributions of all kinds! For guidelines on how to get involved, please refer to our Contributing Guide.

Supported Models

ProviderHuggingFace CollectionBlogDescription
DeepSeekDeepseekDeepSeek-V3.2
DeepSeek-R1
DeepSeek-V3.2 ReleaseDeepSeek-V3.2 is built for stronger reasoning and agent workflows, adding thinking-aware tool use while keeping both thinking and non-thinking tool-use modes available.
MiniMaxMiniMax AIMiniMax-M3
MiniMax-M2.7
MiniMax M3: Frontier Coding, 1M Context, Native MultimodalityMiniMax-M3 is a sparse-attention model for coding, agentic work, long-context tasks, and multimodal input, with MiniMax-M2.7 kept as a supported sibling model.
GLMZ AIGLM-5.2
GLM-5.1
GLM-4.7
GLM-5.2: Built for Long-Horizon TasksGLM-5.2 is Z AI's latest flagship model for long-horizon coding agents, large-scale implementation, automated research, and performance optimization.
Kimi-K2Moonshot AIKimi-K2-Thinking
Kimi-K2-Instruct-0905
Kimi K2 ThinkingKimi-K2-Thinking is the reasoning-focused Kimi-K2 variant for long-horizon agentic workflows, multi-step reasoning, and tool-heavy tasks.
QwenQwenQwen3.6-35B-A3BQwen3.6-35B-A3B: Agentic Coding Power, Now Open to AllQwen3.6-35B-A3B is an open-weight MoE model focused on stable, practical coding and agentic workflows, with Qwen3-Next and larger Qwen3 MoE variants also represented.
gpt-ossOpenAIgpt-oss-120b
gpt-oss-safeguard-120b
Introducing gpt-oss-safeguardgpt-oss-120b is OpenAI's open-weight GPT model; gpt-oss-safeguard-120b adds policy-driven reasoning classification for flexible moderation and safety workflows.
StepStepFunStep-3.5-FlashStep 3.5 FlashStep-3.5-Flash is a sparse MoE foundation model for efficient reasoning and agentic workflows, activating a small subset of its total parameters per token.
blackwell
chatbot
decentralized-inference
deepseek
distributed-systems
glm
kimi
large-language-models
llama
llm
llm-serving
minimax
oss-gpt
python
pytorch
qwen
transformer

GradientHQ/parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python

1,396

410 commits

updated Jul 1, 2026

See the code

README

Trusted by Partners

SGLang vLLM Qwen DeepSeek Kimi Minimax ZAI

license issue resolution open issues

Parallax by Gradient - Host LLMs across devices sharing GPU to make your AI go brrr | Product Hunt

Gradient | Blog | X/Twitter (Gradient) | X/Twitter (Parallax) | Discord | Arxiv

News

  • [2026/02] 🦞 Parallax now supports OpenClaw integration! See Docs
  • [2025/10] 🔥 Parallax won #1 Product of The Day on Product Hunt!
  • [2025/10] 🔥 Parallax version 0.0.1 has been released!

About

A fully decentralized inference engine developed by Gradient. Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location. Its core features include:

  • Host local LLM on personal devices
  • Cross-platform support
  • Pipeline parallel model sharding
  • Paged KV cache management & continuous batching for Mac
  • Dynamic request scheduling and routing for high performance

The backend architecture:

User Guide

Quick Install

git clone https://github.com/GradientHQ/parallax.git
cd parallax
./install.sh
source .venv/bin/activate
parallax serve -m Qwen/Qwen3.5-0.8B

Contributing

We warmly welcome contributions of all kinds! For guidelines on how to get involved, please refer to our Contributing Guide.

Supported Models

ProviderHuggingFace CollectionBlogDescription
DeepSeekDeepseekDeepSeek-V3.2
DeepSeek-R1
DeepSeek-V3.2 ReleaseDeepSeek-V3.2 is built for stronger reasoning and agent workflows, adding thinking-aware tool use while keeping both thinking and non-thinking tool-use modes available.
MiniMaxMiniMax AIMiniMax-M3
MiniMax-M2.7
MiniMax M3: Frontier Coding, 1M Context, Native MultimodalityMiniMax-M3 is a sparse-attention model for coding, agentic work, long-context tasks, and multimodal input, with MiniMax-M2.7 kept as a supported sibling model.
GLMZ AIGLM-5.2
GLM-5.1
GLM-4.7
GLM-5.2: Built for Long-Horizon TasksGLM-5.2 is Z AI's latest flagship model for long-horizon coding agents, large-scale implementation, automated research, and performance optimization.
Kimi-K2Moonshot AIKimi-K2-Thinking
Kimi-K2-Instruct-0905
Kimi K2 ThinkingKimi-K2-Thinking is the reasoning-focused Kimi-K2 variant for long-horizon agentic workflows, multi-step reasoning, and tool-heavy tasks.
QwenQwenQwen3.6-35B-A3BQwen3.6-35B-A3B: Agentic Coding Power, Now Open to AllQwen3.6-35B-A3B is an open-weight MoE model focused on stable, practical coding and agentic workflows, with Qwen3-Next and larger Qwen3 MoE variants also represented.
gpt-ossOpenAIgpt-oss-120b
gpt-oss-safeguard-120b
Introducing gpt-oss-safeguardgpt-oss-120b is OpenAI's open-weight GPT model; gpt-oss-safeguard-120b adds policy-driven reasoning classification for flexible moderation and safety workflows.
StepStepFunStep-3.5-FlashStep 3.5 FlashStep-3.5-Flash is a sparse MoE foundation model for efficient reasoning and agentic workflows, activating a small subset of its total parameters per token.
blackwell
chatbot
decentralized-inference
deepseek
distributed-systems
glm
kimi
large-language-models
llama
llm
llm-serving
minimax
oss-gpt
python
pytorch
qwen
transformer

Significant stargazers

willxxy

61 followers · starred Oct 2025

Brian Li

627 followers · starred Oct 2025

Rudrank Riyam

1,071 followers · starred Oct 2025

Awni Hannun

2,479 followers · starred Oct 2025