Skip to content

feat: Discard weight when finish generation in the main loop - #2495

Merged
terrykong merged 2 commits into
NVIDIA-NeMo:mainfrom
guyueh1:discard_vllm_weight_when_offloaded
May 21, 2026
Merged

terrykong merged 2 commits into
NVIDIA-NeMo:mainfrom
guyueh1:discard_vllm_weight_when_offloaded

Commits

Commits on May 17, 2026

Commits on May 19, 2026

  • Add UT

    committed