Cluster 650403

5 repos

Python · 3

C++ · 1

large-language-models ·389

mixture-of-experts ·389

pytorch ·360

huggingface ·360

inference-engine ·360

llm-inference ·360

model-fusion ·15

in-context-learning ·15

deepseek-r1 ·14

deepseek-v3 ·14

Related clusters

EfficientMoE/MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

Python

360

129 commits

batchgen-project/batchgen

High-Throughput Batch Inference

C++

357 commits

cmavro/PackLLM

Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization

Python

1 commits

QuixiAI/laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'

Python

240

57 commits

PSNbst/PAseer-TDD-Accelerator

LoRA 的结构：

6 commits