6 repos
lightseekorg/TorchSpec
A PyTorch native library for training speculative decoding models
247
141 commits
torchspec-project/TorchSpec
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM…
837
577 commits
vllm-project/compressed-tensors
A safetensors extension to efficiently store sparse quantized tensors on disk
326
520 commits
vllm-project/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized…
3,795
2,745 commits
mlc-ai/pith-train
Compact and Agent-Native MoE Training System
350
80 commits
