Skip to content

feat: separately wakeup vllm to reduce peak memory in refitting#190

Closed
zpqiu wants to merge 1 commit into
mainfrom
alexq/vllm-separately-wakeup
Closed

feat: separately wakeup vllm to reduce peak memory in refitting#190
zpqiu wants to merge 1 commit into
mainfrom
alexq/vllm-separately-wakeup

use tags to separately wakeup vllm to reduce refitting peak memory

f578ff4
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs