Shadowgraph
TrendingAbout
Sign in

S-Lab-System-Group/Awesome-DL-Scheduling-Papers

335

14 commits

updated Jan 22, 2024

See the code

README

Awesome-DL-Scheduling-Papers

🔥 A curated list of DL cluster scheduling papers.

Please feel free to pull requests or open an issue to add papers.

Table of Content

Schedulers for DL Training

SchedulerYearSeriesPaperObjectiveHeter.ElasticAutoMLCode
Acme2024NSDIPaper♣---Code
Cassini2024NSDIPaper♠♣♥-✔--
Sia2023SOSPPaper♠♣♥✔✔✔Code
EasyScale2023SCPaper♠♣✔✔-Code
Hydro2023OSDIPaper♠▲✔✔✔Code
Shockwave2023NSDIPaper♠♣♥-✔-Code
ModelKeeper2023NSDIPaper♦♣--✔Code
Lyra2023EuroSysPaper♠♣✔✔--
SiloD2023EuroSysPaper♠♣♥✔*---
FGD2023ATCPaper♠♣---Code
ElasticFlow2023ASPLOSPaper♣✿-✔-Code
Lucid2023ASPLOSPaper♠♣---Code
PowerFlow2023arxivPaper♦♣-✔--
EDL2022TPDSPaper♠♣-✔--
AOnline2022TCCPaper♠♣-✔--
Titan2022SoCCPaper♠♣----
Muri2022SIGCOMMPaper♠♣✔*--Code
Synergy2022OSDIPaper♣---Code
Ali-MLaaS2022NSDIPaper♠♣---Code
GADGET2022INFOCOMPaper♠♣-✔-Code
CloudBrain2022ICCDPaper♠---Code
Aryl2022arxivPaper♠♣-✔✔-
Singularity2022arxivPaper♠♣♦-✔--
$DL^2$2021TPDSPaper♣-✔-Code
Astraea2021TPDSPaper♥---Code
Horus2021TPDSPaper♠♣----
Liquid2021TPDSPaper♣---Code
POP2021SOSPPaper♥♣✔--Code
Chronus2021SoCCPaper✿---Code
SEER2021SoCCPaper▲-✔✔-
Helios2021SCPaper♣♦---Code
ONES2021SCPaper♠♣-✔-Code
Pollux2021OSDIPaper♠♣♥-✔✔Code
AFS2021NSDIPaper♠♣-✔--
SMD2021INFOCOMPaper♣----
ANDREAS2021FCloudPaper♦----
RubberBand2021EuroSysPaper♦-✔✔-
Hermes2021ElectronicsPaper♣--✔-
Jigsaw2021DistributedMLPaper♣----
DynamoML2021CLOSERPaper♠♣-✔--
GENIE2020TPDSPaper✿-✔--
Parrot2020TCCPaper♣----
Non-Intrusive2020SCPaper♠♣-✔--
Antman2020OSDIPaper♠♣-✔-Code
Gavel2020OSDIPaper♣♥✔--Code
HiveD2020OSDIPaper♣---Code
Themis2020NSDIPaper♥----
Salus2020MLSysPaper♠♣---Code
Vaibhav et al.2020MASCOTSPaper♠♣-✔--
SPIN2020INFOCOMPaper♣----
E-LAS2020ICPPPaper♣----
CODA2020ICDCSPaper♣✔*---
Elan2020ICDCSPaper♠♣-✔--
Yeung2020HotCloudPaper♠----
$Gandiva_{fair}$2020EuroSysPaper♥♣✔---
MLCloudPrice2020DISPAPaper♣♦---Code
MLFS2020CoNextPaper♣✿---Code
MARBLE2020CCGRIDPaper♠♣-✔--
Ada-SRSF2020arxivPaper♣✔*---
Co-scheML2020ACSOSPaper♣----
HyperSched2019SoCCPaper✿ ▲-✔✔-
Tiresias2019NSDIPaper♣---Code
FfDL2019MiddlewarePaper♣---Code
JPAS2019JNCAPaper♣▲--✔-
Harmony2019INFOCOMPaper♣----
Cynthia2019ICPPPaper♦-✔--
Jahani2019ICCCSPaper♦✔✔--
$Sched^2$2019GLOBECOMPaper♣----
Dragon2019CLOSERPaper♠♣-✔--
$FC^2$2019CCPaper♦✔*✔--
Philly2019ATCPaper♣---Code
Gandiva2018OSDIPaper♠♣-✔✔-
OASiS2018INFOCOMPaper♠♣-✔--
Optimus2018EuroSysPaper♣-✔-Code
Dorm2017SMARTCOMPPaper♥----
Topology-Aware2017SCPaper♣---Code
HyperDrive2017MiddlewarePaper♣▲--✔-

Symbols of Training Schedulers:

JCTUtilizationCostFairnessDDLAccuracy
♣♠♦♥✿▲

Schedulers for DL Inference

SchedulerYearSeriesPaperObjectiveBatchShareCloudSource Code
SpotServe2024ASPLOSPaper♦♥✔-✔Code
DeltaZip2023arxivPaper♥♠✔--Code
MOSEL2023arxivPaper♦♠✔---
Punica2023arxivPaper♥♠-✔*-Code
S-LoRA2023arxivPaper♥♠-✔*-Code
Symphony2023arxivPaper✿♠♦✔---
DeepPlan2023EuroSysPaper♦♠✔--Code
Tabi2023EuroSysPaper♦♣--✔-
Kairos2023HPDCPaper♦♥♠✔-✔Code
Shepherd2023NSDIPaper✿♠♦✔---
AlpaServe2023OSDIPaper♦♠✔✔-Code
Clover2023SCPaper♥✔✔-Code
iGniter2023TPDSPaper✿♥✔✔✔Code
Gpulet2022ATCPaper✿♠♥✔✔-Code
Cocktail2022NSDIPaper♣♦♥--✔Code
INFaaS2021ATCPaper♦♥♠-✔✔Code
MIG-SERVING2021CoRRPaper♦♥✔✔--
Mendoza et al.2021EuroMLSysPaper♦-✔--
Abacus2021SCPaper♦♠-✔-Code
Morphling2021SoCCPaper♥♠✔✔✔Code
Irina2020APNetPaper♦♠✿✔✔--
DyBatch2020CCGridPaper♦♠✔✔--
CMS2020Future InternetPaper♣✿----
PERSEUS2020IC2EPaper♦♥♠✔-✔Code
AutoDeep2020InfocomPaper♦♥♠-✔✔-
Clockwork2020OSDIPaper♦♠✔--Code
GSLICE2020SoCCPaper♠✿✔✔--
Inferline2020SoCCPaper♦♥✔-✔Code
MArk2019ATCPaper♦♥✔-✔Code
TrIMS2019CLOUDPaper♦♠✿✔✔✔Code
Kube-Knots2019CLUSTERPaper♦✿✔✔--
Gilman et al.2019DIDLPaper♦♠-✔--
Nanily2019HPCCPaper♦♠✔---
Ebird2019ICCDPaper♦♠✿✔✔-Code
Tolerance Tiers2019ISPASSPaper♣♦♥--✔-
RRL2019SCPaper♦✔✔-Code
ParM2019SOSPPaper♦✔--Code
HiveMind2018NIPSPaper♠✔✔--
Space-Time2018NIPSPaper♠✿✔✔--
Ease.ml2018VLDBPaper♣---Code
Rafiki2018VLDBPaper♣♦✔--Code
Clipper2017NSDIPaper♣♦♠✔--Code

Symbols of Inference Schedulers:

AccuracyThroughputLatencyCostUtilization
♣♠♦♥✿

Glossary of Terms

TerminologyDefinition
JCTJob Completion Time (Job Finish Time - Job Submission Time)
Fairnessa metric to assess whether resources are fairly shared among users or jobs
QoSQuality of Service
DDLDeadline, a time point where DL job must be completed
SLOService Level Objective

Contributors

Qinghao-Hu

10 commits

gaow0007

3 commits

smile-luobin

1 commits

Similar repos

byungsoo-oh/ml-systems-papers

Curated collection of papers in machine learning systems

656

AmberLJC/LLMSys-PaperList

Large Language Model (LLM) Systems Paper List

2,263

lambda7xx/awesome-AI-system

paper and its code for AI System

379

AmadeusChan/Awesome-LLM-System-Papers

645

xilangzhou/Awesome-LLM-Serving

Large Language Model (LLM) Serving Paper and Resource List

30

chenhongyu2048/LLM-inference-optimization-paper

Summary of some awesome work for optimizing LLM inference

271

galeselee/Awesome_LLM_System-PaperList

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become…

284

OpsPAI/awesome-AIOps

A curated list of awesome academic researches and industrial materials about Artificial…

329

S-Lab-System-Group/Awesome-DL-Scheduling-Papers

335

14 commits

updated Jan 22, 2024

See the code

README

Awesome-DL-Scheduling-Papers

🔥 A curated list of DL cluster scheduling papers.

Please feel free to pull requests or open an issue to add papers.

Table of Content

Schedulers for DL Training

SchedulerYearSeriesPaperObjectiveHeter.ElasticAutoMLCode
Acme2024NSDIPaper♣---Code
Cassini2024NSDIPaper♠♣♥-✔--
Sia2023SOSPPaper♠♣♥✔✔✔Code
EasyScale2023SCPaper♠♣✔✔-Code
Hydro2023OSDIPaper♠▲✔✔✔Code
Shockwave2023NSDIPaper♠♣♥-✔-Code
ModelKeeper2023NSDIPaper♦♣--✔Code
Lyra2023EuroSysPaper♠♣✔✔--
SiloD2023EuroSysPaper♠♣♥✔*---
FGD2023ATCPaper♠♣---Code
ElasticFlow2023ASPLOSPaper♣✿-✔-Code
Lucid2023ASPLOSPaper♠♣---Code
PowerFlow2023arxivPaper♦♣-✔--
EDL2022TPDSPaper♠♣-✔--
AOnline2022TCCPaper♠♣-✔--
Titan2022SoCCPaper♠♣----
Muri2022SIGCOMMPaper♠♣✔*--Code
Synergy2022OSDIPaper♣---Code
Ali-MLaaS2022NSDIPaper♠♣---Code
GADGET2022INFOCOMPaper♠♣-✔-Code
CloudBrain2022ICCDPaper♠---Code
Aryl2022arxivPaper♠♣-✔✔-
Singularity2022arxivPaper♠♣♦-✔--
$DL^2$2021TPDSPaper♣-✔-Code
Astraea2021TPDSPaper♥---Code
Horus2021TPDSPaper♠♣----
Liquid2021TPDSPaper♣---Code
POP2021SOSPPaper♥♣✔--Code
Chronus2021SoCCPaper✿---Code
SEER2021SoCCPaper▲-✔✔-
Helios2021SCPaper♣♦---Code
ONES2021SCPaper♠♣-✔-Code
Pollux2021OSDIPaper♠♣♥-✔✔Code
AFS2021NSDIPaper♠♣-✔--
SMD2021INFOCOMPaper♣----
ANDREAS2021FCloudPaper♦----
RubberBand2021EuroSysPaper♦-✔✔-
Hermes2021ElectronicsPaper♣--✔-
Jigsaw2021DistributedMLPaper♣----
DynamoML2021CLOSERPaper♠♣-✔--
GENIE2020TPDSPaper✿-✔--
Parrot2020TCCPaper♣----
Non-Intrusive2020SCPaper♠♣-✔--
Antman2020OSDIPaper♠♣-✔-Code
Gavel2020OSDIPaper♣♥✔--Code
HiveD2020OSDIPaper♣---Code
Themis2020NSDIPaper♥----
Salus2020MLSysPaper♠♣---Code
Vaibhav et al.2020MASCOTSPaper♠♣-✔--
SPIN2020INFOCOMPaper♣----
E-LAS2020ICPPPaper♣----
CODA2020ICDCSPaper♣✔*---
Elan2020ICDCSPaper♠♣-✔--
Yeung2020HotCloudPaper♠----
$Gandiva_{fair}$2020EuroSysPaper♥♣✔---
MLCloudPrice2020DISPAPaper♣♦---Code
MLFS2020CoNextPaper♣✿---Code
MARBLE2020CCGRIDPaper♠♣-✔--
Ada-SRSF2020arxivPaper♣✔*---
Co-scheML2020ACSOSPaper♣----
HyperSched2019SoCCPaper✿ ▲-✔✔-
Tiresias2019NSDIPaper♣---Code
FfDL2019MiddlewarePaper♣---Code
JPAS2019JNCAPaper♣▲--✔-
Harmony2019INFOCOMPaper♣----
Cynthia2019ICPPPaper♦-✔--
Jahani2019ICCCSPaper♦✔✔--
$Sched^2$2019GLOBECOMPaper♣----
Dragon2019CLOSERPaper♠♣-✔--
$FC^2$2019CCPaper♦✔*✔--
Philly2019ATCPaper♣---Code
Gandiva2018OSDIPaper♠♣-✔✔-
OASiS2018INFOCOMPaper♠♣-✔--
Optimus2018EuroSysPaper♣-✔-Code
Dorm2017SMARTCOMPPaper♥----
Topology-Aware2017SCPaper♣---Code
HyperDrive2017MiddlewarePaper♣▲--✔-

Symbols of Training Schedulers:

JCTUtilizationCostFairnessDDLAccuracy
♣♠♦♥✿▲

Schedulers for DL Inference

SchedulerYearSeriesPaperObjectiveBatchShareCloudSource Code
SpotServe2024ASPLOSPaper♦♥✔-✔Code
DeltaZip2023arxivPaper♥♠✔--Code
MOSEL2023arxivPaper♦♠✔---
Punica2023arxivPaper♥♠-✔*-Code
S-LoRA2023arxivPaper♥♠-✔*-Code
Symphony2023arxivPaper✿♠♦✔---
DeepPlan2023EuroSysPaper♦♠✔--Code
Tabi2023EuroSysPaper♦♣--✔-
Kairos2023HPDCPaper♦♥♠✔-✔Code
Shepherd2023NSDIPaper✿♠♦✔---
AlpaServe2023OSDIPaper♦♠✔✔-Code
Clover2023SCPaper♥✔✔-Code
iGniter2023TPDSPaper✿♥✔✔✔Code
Gpulet2022ATCPaper✿♠♥✔✔-Code
Cocktail2022NSDIPaper♣♦♥--✔Code
INFaaS2021ATCPaper♦♥♠-✔✔Code
MIG-SERVING2021CoRRPaper♦♥✔✔--
Mendoza et al.2021EuroMLSysPaper♦-✔--
Abacus2021SCPaper♦♠-✔-Code
Morphling2021SoCCPaper♥♠✔✔✔Code
Irina2020APNetPaper♦♠✿✔✔--
DyBatch2020CCGridPaper♦♠✔✔--
CMS2020Future InternetPaper♣✿----
PERSEUS2020IC2EPaper♦♥♠✔-✔Code
AutoDeep2020InfocomPaper♦♥♠-✔✔-
Clockwork2020OSDIPaper♦♠✔--Code
GSLICE2020SoCCPaper♠✿✔✔--
Inferline2020SoCCPaper♦♥✔-✔Code
MArk2019ATCPaper♦♥✔-✔Code
TrIMS2019CLOUDPaper♦♠✿✔✔✔Code
Kube-Knots2019CLUSTERPaper♦✿✔✔--
Gilman et al.2019DIDLPaper♦♠-✔--
Nanily2019HPCCPaper♦♠✔---
Ebird2019ICCDPaper♦♠✿✔✔-Code
Tolerance Tiers2019ISPASSPaper♣♦♥--✔-
RRL2019SCPaper♦✔✔-Code
ParM2019SOSPPaper♦✔--Code
HiveMind2018NIPSPaper♠✔✔--
Space-Time2018NIPSPaper♠✿✔✔--
Ease.ml2018VLDBPaper♣---Code
Rafiki2018VLDBPaper♣♦✔--Code
Clipper2017NSDIPaper♣♦♠✔--Code

Symbols of Inference Schedulers:

AccuracyThroughputLatencyCostUtilization
♣♠♦♥✿

Glossary of Terms

TerminologyDefinition
JCTJob Completion Time (Job Finish Time - Job Submission Time)
Fairnessa metric to assess whether resources are fairly shared among users or jobs
QoSQuality of Service
DDLDeadline, a time point where DL job must be completed
SLOService Level Objective

Similar repos

byungsoo-oh/ml-systems-papers

Curated collection of papers in machine learning systems

656

AmberLJC/LLMSys-PaperList

Large Language Model (LLM) Systems Paper List

2,263

lambda7xx/awesome-AI-system

paper and its code for AI System

379

AmadeusChan/Awesome-LLM-System-Papers

645

xilangzhou/Awesome-LLM-Serving

Large Language Model (LLM) Serving Paper and Resource List

30

chenhongyu2048/LLM-inference-optimization-paper

Summary of some awesome work for optimizing LLM inference

271

galeselee/Awesome_LLM_System-PaperList

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become…

284

OpsPAI/awesome-AIOps

A curated list of awesome academic researches and industrial materials about Artificial…

329

Contributors

Qinghao-Hu

10 commits

gaow0007

3 commits

smile-luobin

1 commits