feat(moe): Fine-grained activation offloading - #1913

Merged

ko3n1g merged 71 commits into

NVIDIA:mainfrom

lhb8125:hongbinl/activation_offloading_github_main

Jan 15, 2026

Commits on Oct 27, 2025

Commits on Oct 29, 2025

fix ft and import error

Hongbin Liu
authored and
root
committed
f5bf8c4
address comments

lhb8125
authored and
root
committed
0321e20
format

lhb8125
authored and
root
committed
9068805
update golden values on eos

lhb8125
authored and
root
committed
61af7fd
minor fix

lhb8125
authored and
root
committed
b67a0ed
format

lhb8125
authored and
root
committed
a11d351
renaming golden values

lhb8125
authored and
root
committed
b84b5ff
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
2f76430

Commits on Nov 5, 2025

Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
92ce540

Commits on Nov 6, 2025

update golden values
lhb8125
committed
5787848
update golden values
lhb8125
committed
7eaec4d
update model_config and golden values
lhb8125
committed
3c68f79
format
lhb8125
committed
ee53677
remove old golden values
lhb8125
committed
1c1d9c8

Commits on Nov 10, 2025

Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
committed
30f8dec
update golden values
lhb8125
committed
b2a261f

Commits on Nov 18, 2025

Commits on Dec 1, 2025

format
lhb8125
committed
2123564
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
committed
bd69216

Commits on Dec 9, 2025

Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
8d05dfc
update golden value
lhb8125
committed
9d23103
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
7b6ebb3

Commits on Jan 6, 2026

Commits on Jan 7, 2026

bug fix when cuda graph is disabled and fix for dumping offloading info
root
committed
83058e4

Commits on Jan 8, 2026

refactor and update ut
lhb8125
committed
9605a67
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
committed
b7a25ac
format
lhb8125
committed
cb612c7
remove unrelated changes
lhb8125
committed
64ae361
fix ut
lhb8125
committed
a8dfa65
fix ut
lhb8125
committed
2c63e1d
fix ut
lhb8125
committed
f52069e

Commits on Jan 9, 2026

update ut
lhb8125
committed
0643e55
format
lhb8125
committed
d57ccb0
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
committed
eadb8a3
update golden values
lhb8125
committed
ff4a2cd
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
6dc9e2f
fix ut
lhb8125
committed
9555702
Merge branch 'hongbinl/activation_offloading_github_main' of https://github.com/lhb8125/Megatron-LM into hongbinl/activation_offloading_github_main
lhb8125
committed
9895754

Commits on Jan 12, 2026

Commits on Jan 14, 2026

fix doc
lhb8125
committed
2f42e91
code refactor
lhb8125
committed
469cef0
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
c1fdba4
remove group_start() calls
lhb8125
committed
b93d212
format
lhb8125
committed
16d4114
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
1964268
add comments
lhb8125
committed
6263630
fix min_offload_size and update golden values
lhb8125
committed
9423c6b

Commits on Jan 15, 2026

rename group_commit
lhb8125
committed
cc28dd7
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125
authored
b7153fa
fix test_mamba_moe_model.py
lhb8125
committed
871bdaf