Skip to content

[ci] fix: re-enable FSDP checkpoint test after TE 2.14 fix - #3485

Closed
yaoyu-33 wants to merge 2 commits into
mainfrom
fix/re-enable-fsdp-checkpoint-test
Closed

[ci] fix: re-enable FSDP checkpoint test after TE 2.14 fix#3485
yaoyu-33 wants to merge 2 commits into
mainfrom
fix/re-enable-fsdp-checkpoint-test

Conversation

@yaoyu-33

Copy link
Copy Markdown
Contributor

Summary

Closes #2998

Test plan

  • CI runs the re-enabled test_fsdp_pretrain_with_checkpoint in L0_Launch_training.sh and it passes

🤖 Generated with Claude Code

The test was marked `pleasefixme` due to a TE 2.14 regression where
`split_swiglu_linear_fc1` validated the local FSDP shard shape instead
of the global DTensor shape (NVIDIA/TransformerEngine#2795).

Our TE pin (f031cf87 on release_v2.14) already includes the cherry-picked
fix (a4a073b), so the marker can be removed.

Closes: #2998

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
@copy-pr-bot

copy-pr-bot Bot commented Apr 22, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@yaoyu-33

Copy link
Copy Markdown
Contributor Author

/ok to test 94154e8

@yaoyu-33

Copy link
Copy Markdown
Contributor Author

/ok to test cb7eb10

@yaoyu-33 yaoyu-33 added ci CI, automation, test queue, or workflow infrastructure work area:training Training loop, callbacks, and runtime integration needs-review PR is ready for code review and waiting on a reviewer ready-to-merge PR is approved, current, and only waiting for CI to pass before merge and removed needs-review PR is ready for code review and waiting on a reviewer labels Apr 23, 2026
@yaoyu-33 yaoyu-33 removed the ready-to-merge PR is approved, current, and only waiting for CI to pass before merge label Apr 23, 2026
@yaoyu-33

Copy link
Copy Markdown
Contributor Author

no longer relevant since new fsdp tests added.

@yaoyu-33 yaoyu-33 closed this Apr 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:training Training loop, callbacks, and runtime integration ci CI, automation, test queue, or workflow infrastructure work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[bug] test_megatron_fsdp.py::TestMegatronFSDP::test_fsdp_pretrain_with_checkpoint broken after TE2.14

1 participant