Skip to content

[feature][WIP] Enable KV Offload for DeepSeek V4 model#41352

Open
foraxe wants to merge 1 commit into
vllm-project:mainfrom
foraxe:dsv4-kv-offload-vllm
Open

[feature][WIP] Enable KV Offload for DeepSeek V4 model#41352
foraxe wants to merge 1 commit into
vllm-project:mainfrom
foraxe:dsv4-kv-offload-vllm

[KV Offload] Enable HMA finish for offloading connector

53f9788
Select commit
Loading
Failed to load commit list.