Fix MoE aux loss tracker hang with MTP enabled

d28506e

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Sign in for the full log view

Oncall Assign on: pull_request_target

assign-reviewer

Auto Swap Labels on: pull_request_review

check-approval

Auto-assign Milestone to PR on: push

assign-milestone

Codeowners Approval Workflow on: push

pre-flight / pre-flight

codeowners-approval

multi-approval-bot-summary

Installation Test on: push

pre-flight / pre-flight

Pip - Python3.12 - AMD64/Linux - NGC PyTorch

UV - Python3.12 - AMD64/Linux - NGC PyTorch

Install test summary

CICD Megatron-LM on: push 38

is-not-external-contributor

merge-queue-notification

pre-flight / pre-flight

linting

cicd-wait-in-queue

cicd-container-build

cicd-parse-unit-tests

tests/unit_tests/test_model_configs.py - latest

tests/unit_tests/test_fp8_param.py - latest

tests/unit_tests/pipeline_parallel/**/*.py - latest

tests/unit_tests/models/**/*.py - latest

tests/unit_tests/data/**/*.py - latest

tests/unit_tests/dist_checkpointing/test_optimizer.py - latest

tests/unit_tests/dist_checkpointing/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/test_moe_experts.py - latest

tests/unit_tests/transformer/**/*.py - latest

tests/unit_tests/transformer/moe/**/*.py - latest

tests/unit_tests/distributed/megatron_fsdp/**/*.py - latest

tests/unit_tests/**/*.py - latest

cicd-parse-integration-tests

gpt/gpt3_mcore_te_tp1_pp4_vp1_dist_optimizer_overlap_grad_reduce_param_gather_overlap_optimizer - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce_param_gather - latest

moe/gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_resume_torch_dist_dist_optimizer - latest

Nemo_CICD_Test

Coverage_Fake

Coverage (unit-test)

cleanup-taint-node

Copyright check on: push

pre-flight / pre-flight

copyright-check / main

copyright-check-summary

Build, test, and publish a PyPi wheel (to testpypi). on: push

pre-flight / pre-flight

build-test-publish-wheels / build-and-test-wheels (megatron-core, arm64, quay.io/pypa/manylinux_2_28_aarch64)

build-test-publish-wheels / build-and-test-wheels (megatron-core, amd64, quay.io/pypa/manylinux_2_28_x86_64)

build-test-publish-wheels / build-and-test-wheels (megatron-fsdp, quay.io/pypa/manylinux_2_28_x86_64, amd64)

build-test-publish-wheels / publish-wheels

build-test-publish-wheel-summary

Auto Swap Labels on: pull_request_review

check-approval

Auto Swap Labels on: pull_request_review

check-approval

The logs for this run have expired and are no longer available.

Loading

Re-running jobs...