Skip to content

DeepSeek-V4.1-Flash: LMCache tier offload through the MP server (vLLM plugin) - #2598

Open
PerryZhang01 wants to merge 63 commits into
mainfrom
perzhang/dsv41-lmcache-031
Open

DeepSeek-V4.1-Flash: LMCache tier offload through the MP server (vLLM plugin)#2598
PerryZhang01 wants to merge 63 commits into
mainfrom
perzhang/dsv41-lmcache-031

offload: settle the polling thread's shutdown, failure and stalls

ba157dd
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar