[Main][feat] Support CUDA Graph capture offloading modules - #3697

Merged

lhb8125 merged 66 commits into

NVIDIA:mainfrom

lhb8125:hongbinl/activation_offloading_refactor_cuda_graph_main

Jul 2, 2026

Commits on Mar 4, 2026

support offloading modules captured by cuda graph
lhb8125
committed
06954b9
minor fix
lhb8125
committed
8a889c0
bug fix
lhb8125
committed
0a8e867
add flag to control flush_delayed_groups in fine_grained_callables.py
lhb8125
committed
fba4e8d
Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
authored
ecaa319
format
lhb8125
committed
5591584

Commits on Mar 5, 2026

Commits on Mar 6, 2026

Commits on Mar 11, 2026

add assertion for recomputing and offloading
lhb8125
committed
7a5234c
fix ut
lhb8125
committed
57890f8
format and fix TE version
lhb8125
committed
344479e
replace multiple imports with a _get_off_interface()
lhb8125
committed
73ed9f5
renaming _get_offloading_interface
lhb8125
committed
1d51cfc
minor fix
lhb8125
committed
f19bf81
Merge branch 'hongbinl/activation_offloading_refactor_cuda_graph_main' of https://github.com/lhb8125/Megatron-LM into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
committed
7dba82c
Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
authored
823eaf3

Commits on Mar 30, 2026

fix comments
lhb8125
committed
4befd50
fix ci
lhb8125
committed
aa793ab
fix ut
lhb8125
committed
334f48d
refine docs and minor fix
lhb8125
committed
b7e95c6
minor fix
lhb8125
committed
ef6fa2b
minor fix
lhb8125
committed
795f5a9
Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
committed
06c75e6
Merge branch 'hongbinl/activation_offloading_refactor_cuda_graph_main' of https://github.com/lhb8125/Megatron-LM into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
committed
2390074
format
lhb8125
committed
dd6d702
fix ci
lhb8125
committed
aaa23de
fix ci
lhb8125
committed
183244c

Commits on May 8, 2026

Merge remote-tracking branch 'upstream/main' into pr3697
lhb8125
committed
ac82c9b

Commits on May 22, 2026

Merge origin/main into PR #3697
lhb8125
committed
609e3c7
refactor: use group offload manager API
lhb8125
committed
2e93c38
Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
authored
83e3c17

Commits on May 26, 2026

Commits on Jun 2, 2026

fix: preserve reload cadence for offload fraction
lhb8125
committed
afe6bf0

Commits on Jun 9, 2026

Commits on Jun 10, 2026

Fix CUDA graph test formatting
lhb8125
committed
b8102b4

Commits on Jun 16, 2026

Address CUDA graph offload review nits
lhb8125
committed
b14985c
Clarify activation offload fraction semantics
lhb8125
committed
46fe4cf

Commits on Jun 25, 2026

Commits on Jun 26, 2026

Commits on Jun 30, 2026

fix: ignore zero-byte groups in offload fraction
lhb8125
committed
008df8a
fix: use offload manager for fused grouped mlp
lhb8125
committed
e68718a
fix: consume skipped activation offload groups
lhb8125
committed
4c31cfb
cleanup: remove unused layer offload flags
lhb8125
committed
c477ab0
style: apply activation offload autoformat
lhb8125
committed
c583f5d
Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
lhb8125
authored
6f0b3d1

Commits on Jul 2, 2026

Merge branch 'main' into hongbinl/activation_offloading_refactor_cuda_graph_main
yaox12
authored
e50a23b