Skip to content

[Bugfix] Fix KV cache sizing and allocation for hybrid Mamba/attention models - #37429

Open
swtb3 wants to merge 4 commits into
vllm-project:mainfrom
swtb3:fix/hybrid-mamba-compact-allocation
Open

[Bugfix] Fix KV cache sizing and allocation for hybrid Mamba/attention models#37429
swtb3 wants to merge 4 commits into
vllm-project:mainfrom
swtb3:fix/hybrid-mamba-compact-allocation

Merge branch 'main' into fix/hybrid-mamba-compact-allocation

f74c1cb
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 19, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync