Skip to content

[Bugfix] - Fix Mamba prefix caching corruption with chunked prefill - #34587

Closed
Josephasafg wants to merge 2 commits into
vllm-project:mainfrom
Josephasafg:fix_mamba_apc_block_cache_clean
Closed

[Bugfix] - Fix Mamba prefix caching corruption with chunked prefill#34587
Josephasafg wants to merge 2 commits into
vllm-project:mainfrom
Josephasafg:fix_mamba_apc_block_cache_clean