[Dev] Support paged stash with device-initiated GroupedTensor experts - #6845
Draft
lhb8125 wants to merge 10 commits into
Draft
[Dev] Support paged stash with device-initiated GroupedTensor experts#6845lhb8125 wants to merge 10 commits into
lhb8125 wants to merge 10 commits into
Conversation
…ing TE opfuser (NVIDIA#6000) Signed-off-by: Zhongbo Zhu <42691305+zhongbozhu@users.noreply.github.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
lhb8125
force-pushed
the
denliu/paged-stash-grouped-tensor-dev
branch
from
August 25, 2026 13:09
0da1b1b to
e569fa3
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
TEGroupedMLPGroupedTensor path.moe_use_grouped_tensor=Truewithout requiring the TE op fuser.Dependency and merge order
devport of [Main] Support device-init grouped linear module too with when not using TE opfuser #6000.devbranch.This branch currently contains the #6847 prerequisite commits so it remains buildable before that PR lands. Its effective diff will shrink after #6847 is merged, and the branch will then be refreshed before this PR is merged.
Transformer Engine dependencies
GroupedTensorStorage.Test plan
CHECK_ONLY=true BASE_REF=dev ... bash tools/autoformat.sh(Black, isort, pylint, and ruff passed).python tools/check_copyright.py <changed Python files>.python -m py_compileon all changed Python files.tests/unit_tests/transformer/moe/test_paged_stashing.pyexited 0. The currentmcore-ci-devimage predates TE ci(fix): Parse unit tests in merge-queue #3224, so the new grouped-tensor case is dependency-gated withInstalled TE GroupedLinear does not expose use_grouped_tensorinstead of failing during module construction.