[Dev][feat] Support CUDA Graph capture offloading modules - #3219

Merged

lhb8125 merged 125 commits into

lhb8125:hongbinl/activation_offloading_refactor_cuda_graph

Mar 30, 2026

Commits on Oct 29, 2025

renaming golden values
lhb8125
committed
1219a26

Commits on Nov 4, 2025

fix bug: accuracy issu because of recomputing and offloading same module
lhb8125
committed
ce6e661
Merge branch 'dev' into hongbinl/activation_offloading_fix
lhb8125
committed
d04d741
format
lhb8125
committed
2fe4aeb

Commits on Nov 5, 2025

update golden values
lhb8125
committed
fb3f7c3
Merge branch 'dev' into hongbinl/activation_offloading_fix
lhb8125
authored
5001e2b
update golden values
lhb8125
committed
9937890

Commits on Nov 6, 2025

update model_config and golden values
lhb8125
committed
6c83118
format
lhb8125
committed
33a38f5
update golden values
lhb8125
committed
6c76b07

Commits on Nov 10, 2025

Merge branch 'dev' into hongbinl/activation_offloading_fix
lhb8125
committed
4d83f69

Commits on Nov 18, 2025

temp save
lhb8125
committed
8e72b44

Commits on Nov 25, 2025

support offloading+cuda graph
lhb8125
committed
1646f04
Merge branch 'dev' into hongbinl/activation_offloading_cuda_graph
lhb8125
committed
43973a7

Commits on Nov 27, 2025

support PP=1
lhb8125
committed
a177cf5

Commits on Dec 1, 2025

support VPP
lhb8125
committed
f7cfbba

Commits on Dec 2, 2025

bug fix
lhb8125
committed
6d475ad

Commits on Dec 8, 2025

support VPP
lhb8125
committed
089da6c
code refactor
lhb8125
committed
35b0f97
big code refactor and format
lhb8125
committed
df09b85
Merge branch 'dev' into hongbinl/activation_offloading_cuda_graph
lhb8125
committed
06ef4e2
minor fix
lhb8125
committed
12cb8de
minor fix
lhb8125
committed
3cf19b7
dump offloading information
lhb8125
committed
d0fc888
Merge branch 'dev' into hongbinl/activation_offloading_cuda_graph
lhb8125
authored
bc47650
fix ut
lhb8125
committed
b7c0fba
Merge branch 'hongbinl/activation_offloading_cuda_graph' of https://github.com/lhb8125/Megatron-LM into hongbinl/activation_offloading_cuda_graph
lhb8125
committed
b18e69b
format
lhb8125
committed
ae4e2b5
fit ut
lhb8125
committed
b797438

Commits on Dec 17, 2025

delay d2h copies until finishing cuda graph
lhb8125
committed
6cec22f
minor fix
lhb8125
committed
5a150c7
Merge branch 'dev' into hongbinl/activation_offloading_cuda_graph
lhb8125
committed
e6cf8b5
format
lhb8125
committed
60e3082
fix ut
lhb8125
committed
256d79d
format
lhb8125
committed
9475e3d
Merge branch 'dev' into hongbinl/activation_offloading_cuda_graph
lhb8125
authored
6daa2a4

Commits on Jan 6, 2026

minor fix
lhb8125
committed
93c0827
remove changes for cuda graph
lhb8125
committed
f22a194

Commits on Jan 8, 2026

bug fix when cuda graph is disabled and fix for dumping offloading info

root
authored and
lhb8125
committed
a9d6633
refactor and update ut
lhb8125
committed
9d766e9
format
lhb8125
committed
9d1fe34
fix ut
lhb8125
committed
08b46aa

Commits on Jan 12, 2026

update ut
lhb8125
committed
d33b3c4
update ut
lhb8125
committed
884c335
fix ut
lhb8125
committed
df2e839
add version check
lhb8125
committed
569f347
minor refactor for fine_grained_activation_offload.py
lhb8125
committed
7f8109a
format
lhb8125
committed
19b35c3
Merge branch 'dev' into hongbinl/activation_offloading_refactor
lhb8125
committed
e867835

Commits on Jan 13, 2026

support partial cuda graph
lhb8125
committed
dd874a9
fix bug when working with a2a overlap and cuda graph
lhb8125
committed
b8c0b79
support offloading less for large pp rank
lhb8125
committed
994fc5a

Commits on Jan 15, 2026

fix doc
lhb8125
committed
2688c7e
code refactor
lhb8125
committed
aab8455
remove group_start() calls
lhb8125
committed
0a92566
add comments
lhb8125
committed
0df5134
fix min_offload_size and update golden values
lhb8125
committed
62d36f2
minor fix and format
lhb8125
committed
17c0eb9
Merge branch 'hongbinl/activation_offloading_refactor' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
committed
d979f1e
rename group_commit
lhb8125
committed
53a21e1

Commits on Jan 19, 2026

fix for graph support
lhb8125
committed
600cfe7

Commits on Jan 20, 2026

refine offloading strategy
lhb8125
committed
09956df

Commits on Jan 22, 2026

temp fix for mxfp8
lhb8125
committed
18a2d9e

Commits on Jan 24, 2026

minor fix
lhb8125
committed
885164b

Commits on Jan 25, 2026

support offloading fraction
lhb8125
committed
688c2ab

Commits on Feb 3, 2026

Commits on Feb 4, 2026

Commits on Feb 5, 2026

Commits on Feb 6, 2026

Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
committed
526fc35

Commits on Feb 24, 2026

Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
committed
6264494

Commits on Feb 25, 2026

minor refactor
lhb8125
committed
7640bf3
Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
authored
15641c4
format
lhb8125
committed
dfc8161

Commits on Feb 26, 2026

fix ut
lhb8125
committed
e362f79
format
lhb8125
committed
2da15b2
minor fix
lhb8125
committed
221cc16
format and minor fix
lhb8125
committed
726c526
Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
committed
f19c4f6

Commits on Feb 27, 2026

1. replace hasattr+delattr with None;
lhb8125
committed
998d1b0

Commits on Mar 2, 2026

Commits on Mar 5, 2026

Commits on Mar 6, 2026

resolve comments
lhb8125
committed
d8da479
remove redundant offloading doc
lhb8125
committed
a6e16a9

Commits on Mar 9, 2026

Commits on Mar 11, 2026

replace multiple imports with a _get_off_interface()
lhb8125
committed
e5f154b
renaming _get_offloading_interface
lhb8125
committed
701f831
minor fix
lhb8125
committed
a70f801
Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
authored
8959afb
fix mhc layer
lhb8125
committed
2a1afc1

Commits on Mar 12, 2026

Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
committed
bb4ac50

Commits on Mar 23, 2026

fix comments
lhb8125
committed
92ea308
Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
authored
51ba05a
fix ci
lhb8125
committed
837dba4

Commits on Mar 25, 2026

fix ut
lhb8125
committed
c56acec
Merge branch 'dev' into hongbinl/activation_offloading_refactor_cuda_graph
lhb8125
authored
d78b776

Commits on Mar 30, 2026