Code

Add MoE#1129

Code

Merged

Quentin-Anthony merged 4 commits intoEleutherAI:mainEleutherAI/gpt-neox:mainfrom yang:moe2yang/gpt-neox:moe2Copy head branch name to clipboardMar 7, 2024

+434-31

Commits

Commits on Mar 6, 2024

• Add DeepSpeed MoE

  Show description for 4825f1a
  yang

  committed
  4825f1a

• Update NeoXArgs docs automatically

  

  github-actions

  committed
  7ee6c52

Commits on Mar 7, 2024

• pre-commit

  Quentin-Anthony

  committed
  ae06be5

• Update NeoXArgs docs automatically

  

  github-actions

  committed
  bf6dd4f