Skip to content

[Dev] Add MoE example recipes - #4890

Merged
Victarry merged 6 commits into
NVIDIA:devfrom
Victarry:denliu/add-moe-release-recipes
May 21, 2026
Merged

[Dev] Add MoE example recipes#4890
Victarry merged 6 commits into
NVIDIA:devfrom
Victarry:denliu/add-moe-release-recipes

Conversation

@Victarry

@Victarry Victarry commented May 20, 2026

Copy link
Copy Markdown

Summary

  • Add exported MoE release recipes under examples/moe_recipes.
  • Include DeepSeek-V3 recipes for B200, GB200, GB300, and H100.
  • Include Qwen3-235B recipes for GB200, GB300, and H100.

Test plan

  • Parsed all 9 added YAML files with PyYAML and checked that each has DEPENDENCIES, ENV_VARS, and ARGS sections.
  • Ran git diff --cached --check before commit.
  • Ran CHECK_ONLY=true BASE_REF=dev uv run --project /Users/denliu/Projects/repos/agentic-mcore-dev --extra mcore-lint -- bash tools/autoformat.sh.
  • Copyright check skipped because no Python files under megatron/core or tests changed.

@Victarry
Victarry requested review from a team as code owners May 20, 2026 09:45
@copy-pr-bot

copy-pr-bot Bot commented May 20, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@Victarry Victarry changed the title [Dev] Add MoE release recipes [Dev] Add MoE example recipes May 20, 2026
@Victarry

Victarry commented May 21, 2026

Copy link
Copy Markdown
Author

/ok to test 1e50e97

@yaox12

yaox12 commented May 21, 2026

Copy link
Copy Markdown
Member

Suggest adding a README at examples/moe_recipes.

@Victarry

Victarry commented May 21, 2026

Copy link
Copy Markdown
Author

Suggest adding a README at examples/moe_recipes.

Great suggestion. Updated, thanks!

@yaox12 yaox12 added the docs-only documentation only (docs or docstrings) label May 21, 2026
@Victarry

Victarry commented May 21, 2026

Copy link
Copy Markdown
Author

/ok to test 29686bd

@Victarry
Victarry added this pull request to the merge queue May 21, 2026
@svcnvidia-nemo-ci

svcnvidia-nemo-ci commented May 21, 2026

Copy link
Copy Markdown
Contributor

🔄 Merge queue validation started!

You can track the progress here: https://github.com/NVIDIA/Megatron-LM/actions/runs/26215234350

Merged via the queue into NVIDIA:dev with commit 6b6fb95 May 21, 2026
38 checks passed
@Victarry
Victarry deleted the denliu/add-moe-release-recipes branch May 21, 2026 10:13
HaochenYuan pushed a commit to HaochenYuan/Megatron-LM that referenced this pull request Jun 12, 2026
Dennis(Zhenhuan) Liu @HaochenYuan
[Dev] Add MoE example recipes (NVIDIA#4890)
0989d9b 
Signed-off-by: HaochenYuan <haocheny@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yaox12 yaox12 yaox12 approved these changes

Assignees

No one assigned

Labels

docs-only documentation only (docs or docstrings)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Victarry @yaox12 @svcnvidia-nemo-ci