Repositories list

• DeepSpeed

  Public
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  compressioninferencezero+ 10data-parallelismmodel-parallelismmixture-of-expertspipeline-parallelismbillion-parameterstrillion-parametersmachine-learning+ 3

  Python

  •

  Apache License 2.0

  •4.2k•37k•996•106•Updated Feb 5, 2025Feb 5, 2025

• DeepSpeedExamples

  Public
  Example models using DeepSpeed

  Python

  •

  Apache License 2.0

  •1.1k•6.2k•294•20•Updated Feb 3, 2025Feb 3, 2025

• DeepSpeed-MII

  Public
  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  inferencedeep-learningpytorch

  Python

  •

  Apache License 2.0

  •176•2k•197•12•Updated Feb 3, 2025Feb 3, 2025

• DeepSpeed-Kernels

  Public
  C++

  •

  Apache License 2.0

  •11•59•1•0•Updated Feb 3, 2025Feb 3, 2025

• fastgen

  Public
  DeepSpeed FastGen

  Apache License 2.0

  •3•9•1•1•Updated Jan 29, 2025Jan 29, 2025

• Megatron-DeepSpeed

  Public
  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Python

  •

  Other

  •2.5k•2k•130•17•Updated Dec 24, 2024Dec 24, 2024