mlsys-seo/multisd-llm-engine

stars

commits

Python

primary language

Nov 30, 2025

updated

README

MultiSDEngine

LLM inference engine using flashinfer kernels with various SD techniques.

Installation

git clone https://github.com/mlsys-seo/multisd-llm-engine
cd SDProfiler
docker build -t multi_sd_engine:0.1 .    # It tasks ~25 min
./run_docker.sh
pip install -e .

Contributors

SungBalance

2 commits

Similar repos

SungBalance/sdprofiler

tjluyao/fastSD

Labman42/JetEngine

A lightweight Inference Engine built for block diffusion models

Tencent/KsanaLLM

549

flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

6,375

ResponsibleAILab/S3LLM

EvolvingLMMs-Lab/lmms-engine

A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.

825

infinigence/Semi-PD

A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained…

131

Languages

Python

98.1%