Merge remote-tracking branch 'upstream/main' into mamba_chunked_prefill

758ffe0

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Auto-assign Milestone to PR on: push

assign-milestone

Installation Test on: push

pre-flight / pre-flight

Pip - Python3.12 - AMD64/Linux - NGC PyTorch

UV - Python3.12 - AMD64/Linux - NGC PyTorch

Install test summary

Copyright check on: push

pre-flight / pre-flight

copyright-check / main

copyright-check-summary

CICD Megatron-LM on: push 2

is-not-external-contributor

merge-queue-notification

pre-flight / pre-flight

linting

cicd-wait-in-queue

cicd-container-build

cicd-parse-unit-tests

tests/unit_tests/test_model_configs.py - latest

tests/unit_tests/test_fp8_param.py - latest

tests/unit_tests/pipeline_parallel/**/*.py - latest

tests/unit_tests/models/**/*.py - latest

tests/unit_tests/data/**/*.py - latest

tests/unit_tests/dist_checkpointing/test_optimizer.py - latest

tests/unit_tests/dist_checkpointing/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/test_moe_experts.py - latest

tests/unit_tests/transformer/**/*.py - latest

tests/unit_tests/transformer/moe/**/*.py - latest

tests/unit_tests/distributed/megatron_fsdp/**/*.py - latest

tests/unit_tests/**/*.py - latest

cicd-parse-integration-tests

common/moe_perf - latest

gpt/gpt3_mcore_te_tp1_pp1_dist_optimizer_fim_dataset - latest

gpt/gpt3_mcore_te_tp1_pp1_dist_optimizer_no_mmap_bin_files - latest

gpt/gpt3_mcore_te_tp1_pp1_resume_torch_dist_uniform_full_recompute - latest

gpt/gpt3_mcore_te_tp1_pp2_resume_torch_dist_rope_embeddings - latest

gpt/gpt3_mcore_te_tp1_pp2_resume_torch_dist_rope_embeddings_interleaved_no_fusion - latest

gpt/gpt3_mcore_te_tp1_pp4_resume_torch_dist_disable_bias_linear - latest

gpt/gpt3_mcore_te_tp1_pp4_resume_torch_dist_persistent_disable_bias_linear - latest

gpt/gpt3_mcore_te_tp1_pp4_resume_torch_dist_untie_embeddings_and_outputs - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1 - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_dist_optimizer_overlap_grad_reduce_param_gather_overlap_optimizer - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_resume_torch_decoupled_lr - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_resume_torch_dist_calculate_per_token_loss - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_uneven_pipeline - latest

gpt/gpt3_mcore_te_tp1_pp4_vp2_account_for_embedding_loss_in_pipeline_split - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn - latest

gpt/gpt3_mcore_te_tp2_pp1_modelopt_distill_resume - latest

gpt/gpt3_mcore_te_tp2_pp1_resume_torch_dist_cp2_nondeterministic - latest

gpt/gpt3_mcore_te_tp2_pp1_resume_torch_dist_multi_dist_optimizer_instances - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2 - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_calculate_per_token_loss - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_calculate_per_token_loss_nondeterministic - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_etp4_calculate_per_token_loss_dp_last - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_etp4_calculate_per_token_loss_nondeterministic_dp_last - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_etp4_dp_last - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_etp4_nondeterministic_dp_last - latest

gpt/gpt3_mcore_te_tp2_pp2_cp2_nondeterministic - latest

gpt/gpt3_mcore_te_tp2_pp2_cross_entropy_loss_fusion - latest

gpt/gpt3_mcore_te_tp2_pp2_mla - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist_cp2_nondeterministic - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist_cross_entropy_loss_fusion - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist_ddp_average_in_collective - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist_defer_embedding_wgrad_compute - latest

gpt/gpt3_mcore_te_tp2_pp2_resume_torch_dist_reshard_1x4xNone - latest

gpt/gpt3_mcore_te_tp2_zp_z3_resume_fsdp_dtensor - latest

gpt/gpt3_mcore_te_tp4_pp1_dist_optimizer_overlap_grad_reduce_param_gather - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce_param_gather - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_qk_layernorm_test_mode - latest

gpt/gpt3_mcore_te_tp4_pp2_resume_torch_dist_reshard_8x1xNone - latest

gpt/gpt3_mcore_tp2_pp2_uninstall_te - latest

gpt/gpt_grpo_basic_function - latest

gpt/gpt_static_inference_tp1_pp1_16b_multiprompt_tokensmatch - latest

gpt/gpt_static_inference_tp1_pp1_583m_cudagraphs - latest

gpt/gpt_static_inference_tp1_pp1_583m_fp8_cudagraphs - latest

gpt/gpt_static_inference_tp1_pp1_583m_logitsmatch - latest

hybrid/hybrid_dynamic_inference_tp1_pp1_dp8_583m - latest

hybrid/hybrid_dynamic_inference_tp1_pp1_dp8_583m_chunked_prefill - latest

hybrid/hybrid_mr_mcore_te_tp1_pp1_cp1_dgx_a100_1N8G - latest

hybrid/hybrid_mr_mcore_te_tp2_pp1_cp1_dgx_a100_1N8G - latest

hybrid/hybrid_mr_mcore_te_tp2_pp1_cp4_dgx_a100_1N8G - latest

moe/gpt3_mcore_te_tp1_pp2_resume_torch_dist_reshard_2x1x4_te_8experts2parallel_dist_optimizer - latest

moe/gpt3_mcore_te_tp2_pp1_resume_torch_dist_te_8experts2parallel_dist_optimizer - latest

moe/gpt3_mcore_te_tp2_pp1_resume_torch_dist_te_8experts2parallel_multi_dist_optimizer_instances - latest

moe/gpt3_mcore_te_tp2_pp1_te_8experts2parallel_ddp_average_in_collective - latest

moe/gpt3_mcore_te_tp2_pp1_te_8experts2parallel_overlap_grad_reduce_param_gather_groupedGEMM - latest

moe/gpt3_mcore_te_tp2_pp1_te_a2a_ovlp_8experts_etp1_ep4 - latest

moe/gpt3_mcore_te_tp2_zp_z3_resume_torch_dist_te_8experts2parallel_top2router - latest

moe/gpt3_moe_mcore_te_ep8_resume_torch_dist_dist_muon - latest

moe/gpt3_moe_mcore_te_ep8_resume_torch_dist_dist_optimizer - latest

moe/gpt3_moe_mcore_te_ep8_resume_torch_dist_muon - latest

moe/gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_resume_torch_dist_dist_optimizer - latest

moe/gpt3_moe_mcore_te_tp4_ep2_etp2_pp2_scoped_cudagraph - latest

moe/gpt_dynamic_inference_tp4_etp1_pp1_ep8_16B_logitsmatch_cudagraph_zmq - latest

Nemo_CICD_Test

Coverage_Fake

Coverage (unit-test)

cleanup-taint-node

Codeowners Approval Workflow on: push

pre-flight / pre-flight

codeowners-approval

multi-approval-bot-summary

Build, test, and publish a PyPi wheel (to testpypi). on: push

pre-flight / pre-flight

build-test-publish-wheels / build-and-test-wheels (megatron-core, arm64, quay.io/pypa/manylinux_2_28_aarch64)

build-test-publish-wheels / build-and-test-wheels (megatron-core, amd64, quay.io/pypa/manylinux_2_28_x86_64)

build-test-publish-wheels / build-and-test-wheels (megatron-fsdp, quay.io/pypa/manylinux_2_28_x86_64, amd64)

build-test-publish-wheels / publish-wheels

build-test-publish-wheel-summary

Select a check to view from the sidebar