Shadowgraph
TrendingBuzzResearch
Chrome extension
Sign in

alibaba/x-deeplearning

An industrial deep learning framework for high-dimension sparse data

PureBasic

4,302

24 commits

updated Sep 25, 2024

See the code

README

概述

X-DeepLearning(简称XDL)是面向高维稀疏数据场景（如广告/推荐/搜索等）深度优化的一整套解决方案。XDL1.2版本已于近期发布，主要特性包括：

  • 针对大batch/低并发场景的性能优化：在此类场景下性能提升50-100%
  • 存储及通信优化：参数无需人工干预自动全局分配，请求合并，彻底消除ps的计算/存储/通信热点
  • 完整的流式训练特性：包括特征准入，特征淘汰，模型增量导出，特征counting统计等
  • Fix了若干1.0中的小bugs

完整介绍请参考XDL1.2 release note

1. XDL训练引擎

2. XDL算法解决方案

3. Blaze预估引擎

4. 深度树匹配模型 TDM 匹配召回引擎

联系我们

FAQ

常见问题

License

XDL使用Apache-2.0许可

致谢

XDL项目由阿里妈妈事业部荣誉出品，核心贡献团队包括阿里妈妈工程平台、算法平台、定向广告技术团队、搜索广告技术团队等，同时XDL项目也得到了阿里巴巴计算平台事业部（特别是PAI团队）的帮助。

Significant stargazers

Zhen Zhang

274 followers · starred Mar 2019

An Tao

698 followers · starred Jan 2020

Alex Wang

244 followers · starred Dec 2018

土豆

1,505 followers · starred Dec 2018

Similar repos

alibaba/EasyRec

A framework for large scale recommendation algorithms.

2,361

same org

alibaba/euler

A distributed graph deep learning framework.

2,900

same org

alibaba/graph-learn

An Industrial Graph Neural Network Framework

1,340

same org

alibaba/BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

932

same org

DeepRec-AI/DeepRec

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is…

1,197

amazon-archives/amazon-dsstne

Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building…

4,390

NVIDIA-Merlin/HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

1,073

baidu/paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice…

24,126

alibaba/x-deeplearning

An industrial deep learning framework for high-dimension sparse data

PureBasic

4,302

24 commits

updated Sep 25, 2024

See the code

README

概述

X-DeepLearning(简称XDL)是面向高维稀疏数据场景（如广告/推荐/搜索等）深度优化的一整套解决方案。XDL1.2版本已于近期发布，主要特性包括：

  • 针对大batch/低并发场景的性能优化：在此类场景下性能提升50-100%
  • 存储及通信优化：参数无需人工干预自动全局分配，请求合并，彻底消除ps的计算/存储/通信热点
  • 完整的流式训练特性：包括特征准入，特征淘汰，模型增量导出，特征counting统计等
  • Fix了若干1.0中的小bugs

完整介绍请参考XDL1.2 release note

1. XDL训练引擎

2. XDL算法解决方案

3. Blaze预估引擎

4. 深度树匹配模型 TDM 匹配召回引擎

联系我们

FAQ

常见问题

License

XDL使用Apache-2.0许可

致谢

XDL项目由阿里妈妈事业部荣誉出品，核心贡献团队包括阿里妈妈工程平台、算法平台、定向广告技术团队、搜索广告技术团队等，同时XDL项目也得到了阿里巴巴计算平台事业部（特别是PAI团队）的帮助。

Significant stargazers

Zhen Zhang

274 followers · starred Mar 2019

An Tao

698 followers · starred Jan 2020

Alex Wang

244 followers · starred Dec 2018

土豆

1,505 followers · starred Dec 2018

Similar repos

alibaba/EasyRec

A framework for large scale recommendation algorithms.

2,361

same org

alibaba/euler

A distributed graph deep learning framework.

2,900

same org

alibaba/graph-learn

An Industrial Graph Neural Network Framework

1,340

same org

alibaba/BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

932

same org

DeepRec-AI/DeepRec

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is…

1,197

amazon-archives/amazon-dsstne

Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building…

4,390

NVIDIA-Merlin/HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

1,073

baidu/paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice…

24,126