Website · Architecture · Training Data

The best 0$ AI.

---

🥳🥳🥳 CrowdGPT v0.4 released 🥳🥳🥳

Key changes

• GUI version
• Dataset has now 280B tokens
• Model already trained on 1.6B tokens

---

What is CrowdGPT?

CrowdGPT is a project for training arbitrary big LLMs using volunteered compute.

Instead of one datacenter doing all the work, CrowdGPT distributes training across participating machines.

All of this working without money, API keys or any centralized GPU clusters.

How it works

See ARCHITECTURE.md

⚡ Quick Start

git clone https://github.com/Vxtzq/CrowdGPT.git
cd CrowdGPT

Install the dependencies for your hardware:

# NVIDIA
pip install -r requirements_cuda.txt

# AMD
pip install -r requirements_rocm.txt

# Windows / DirectML
pip install -r requirements_directml.txt

# CPU / Apple Silicon
pip install -r requirements.txt

Then:

python client.py

For the automatic installer, see docs/easy_install.md.

---

🧠 Contribute

Training data is curated through pull requests.

See docs/DATA.md to contribute.

---

crowdgpt.net · Architecture · Data