Shadowgraph
About
Sign in
← Papers

A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training

ACM:3577193.3593704 · 2 repos reference this paper in their README

deepspeedai/DeepSpeed

43,096

·

+32

·

Python

DeepSpeed is a deep learning optimization library that makes distributed training and inference…

microsoft/DeepSpeed

43,096

·

+32

·

Python

DeepSpeed is a deep learning optimization library that makes distributed training and inference…