[V1][Hybrid] Mamba Prefix Caching with align mode#30877

Merged

heheda12345 merged 136 commits intovllm-project:mainfrom

peakcrosser7:ups/mamba_prefix_cache_align

Jan 23, 2026

Commits on Nov 24, 2025

Commits on Dec 13, 2025

add test script (just for testing)
peakcrosser7
committed
fix runner

heheda12345
authored and
peakcrosser7
committed
support sps (still issues)
peakcrosser7
committed
add some logs for debug
peakcrosser7
committed
fix block reuse bug when SPS is enabled
peakcrosser7
committed
fix block_table bug when sps is enabled
peakcrosser7
committed
fix the bug only mamba new blocks are empty
peakcrosser7
committed
add postprocess for prefix caching
peakcrosser7
committed
refactor preprocess_mamba
peakcrosser7
committed
add some logs for debug
peakcrosser7
committed
fix the wrong kv_cache_gid bug
peakcrosser7
committed
adjust preprocess_mamba only copying state when new blocks exist
peakcrosser7
committed
update mamba_gather_indices and apply to mamba models
peakcrosser7
committed
fix bugs with mamba and lfm2
peakcrosser7
committed
fix the bug when prefix-caching is disable
peakcrosser7
committed
fix the bug between LPC and mamba mixer
peakcrosser7
committed
tmp from commit "b15e6fd"

heheda12345
authored and
peakcrosser7
committed
add e2e impl (still has bug)

heheda12345
authored and
peakcrosser7
committed
update runner

heheda12345
authored and
peakcrosser7
committed
[WIP] write unit test

heheda12345
authored and
peakcrosser7
committed
extract mamba state

heheda12345
authored and
peakcrosser7
committed
update

heheda12345
authored and
peakcrosser7
committed
set block size to max_model_len when prefix caching is disable
peakcrosser7
committed
update mamba manager
peakcrosser7
committed
update max mem usage bytes for mamba spec
peakcrosser7
committed
init result checker

heheda12345
authored and
peakcrosser7
committed
format code

heheda12345
authored and
peakcrosser7
committed
preprocess copy need to consider accept token

heheda12345
authored and
peakcrosser7
committed
test decode

heheda12345
authored and
peakcrosser7
committed
unit test

heheda12345
authored and
peakcrosser7
committed
revert

heheda12345
authored and
peakcrosser7
committed
fix

heheda12345
authored and
peakcrosser7
committed
add more tests

heheda12345
authored and
peakcrosser7
committed
add more tests

heheda12345
authored and
peakcrosser7
committed
Merge branch 'main' of github.com:vllm-project/vllm into ups/mamba_prefix_cache_pro
peakcrosser7
committed
Merge branch 'main' of github.com:vllm-project/vllm into ups/mamba_prefix_cache_pro
peakcrosser7
committed
change env to config

heheda12345
authored and
peakcrosser7
committed
nit update

heheda12345
authored and
peakcrosser7
committed
remove enable_caching from mamba_spec

heheda12345
authored and
peakcrosser7
committed
revert

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
fix pre-commit

heheda12345
authored and
peakcrosser7
committed
clean up

heheda12345
authored and
peakcrosser7
committed
code cleanup

heheda12345
authored and
peakcrosser7
committed
code cleanup

heheda12345
authored and
peakcrosser7
committed
code cleanup

heheda12345
authored and
peakcrosser7
committed
revert

heheda12345
authored and
peakcrosser7
committed
update

heheda12345
authored and
peakcrosser7
committed
update

heheda12345
authored and
peakcrosser7
committed
update

heheda12345
authored and
peakcrosser7
committed
introduce mamba_utils

heheda12345
authored and
peakcrosser7
committed
fix mamba block size usage before update
peakcrosser7
committed
fix prefill chunk incorrectly including draft tokens
peakcrosser7
committed

Commits on Dec 17, 2025

fix the bug in mamba_get_block_table_tensor when cuda graph is enabled
peakcrosser7
committed

Commits on Dec 19, 2025

Commits on Dec 20, 2025

Commits on Dec 21, 2025

Commits on Dec 22, 2025

Commits on Dec 24, 2025

move get_mamba_copy_func to the model
peakcrosser7
committed

Commits on Dec 25, 2025

Commits on Dec 26, 2025

fix test
heheda12345
committed

Commits on Jan 3, 2026

Commits on Jan 4, 2026

Commits on Jan 6, 2026

Commits on Jan 8, 2026

fix allocate_new_blocks
peakcrosser7
committed

Commits on Jan 15, 2026

add comments
peakcrosser7
committed

Commits on Jan 19, 2026

Commits on Jan 21, 2026

Merge branch 'main' into ups/mamba_prefix_cache_align
peakcrosser7
committed