Popular repositories Loading

1. Paddle Paddle Public

   Forked from PaddlePaddle/Paddle

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++

2. docs docs Public

   Forked from PaddlePaddle/docs

   Documentations for PaddlePaddle

   Python

3. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

4. mesh mesh Public

   Forked from tensorflow/mesh

   Mesh TensorFlow: Model Parallelism Made Easier

   Python

5. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from deepspeedai/Megatron-DeepSpeed

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python

6. PaddleFleetX PaddleFleetX Public

   Forked from PaddlePaddle/PaddleFleetX

   Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC Loc…

   Python