[Dev] Add schedule-aware cross-stream tensor lifetime management - #6948

[Dev] Add schedule-aware cross-stream tensor lifetime management#6948

lhb8125 wants to merge 3 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

lhb8125:hongbinl/schedule-aware-tensor-lifetimelhb8125/Megatron-LM:hongbinl/schedule-aware-tensor-lifetimeCopy head branch name to clipboard