Cluster 653132

3 repos

Python · 2

Rust · 1

llm ·7,701

rust ·7,701

uqff ·7,701

deep-learning ·2,113

inference ·2,113

pytorch ·2,113

Related clusters

deepspeedai/DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Python

2,113

239 commits

deepspeedai/DeepSpeedExamples

Example models using DeepSpeed

Python

6,849

346 commits

EricLBuehler/mistral.rs

Fast, flexible LLM inference

Rust

7,701

3,461 commits