Skip to content

feat: Discard weight when finish generation in the main loop - #2495

Merged
terrykong merged 2 commits into
NVIDIA-NeMo:mainfrom
guyueh1:discard_vllm_weight_when_offloaded
May 21, 2026
Merged

feat: Discard weight when finish generation in the main loop#2495
terrykong merged 2 commits into
NVIDIA-NeMo:mainfrom
guyueh1:discard_vllm_weight_when_offloaded

Add UT

8d80498
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded May 19, 2026 in 1s

DCO

All commits are signed off!