Skip to content

[Bugfix][Prefix caching] Fix inconsistent hybrid Mamba prefix cache boundaries and incomplete tail saves - #59826

Closed
wzhao18 wants to merge 10 commits into
vllm-project:mainfrom
wzhao18:wzhao/k3-prefix-cache-fix
Closed

[Bugfix][Prefix caching] Fix inconsistent hybrid Mamba prefix cache boundaries and incomplete tail saves#59826
wzhao18 wants to merge 10 commits into
vllm-project:mainfrom
wzhao18:wzhao/k3-prefix-cache-fix

[Test] Initialize Mamba2 checkpoint fixture block sizes

288b4c3
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Oct 6, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync