[Mamba] Unify FI ReplaySSM STP/MTP/Prefix Caching Lifecycle - #55688

Open

askliar wants to merge 58 commits into

vllm-project:mainfrom

askliar:feat/unify_replayssm_cycle

Commits on Sep 1, 2026

[Mamba] Add FlashInfer ReplaySSM support for MTP
Andrii Skliar
committed
069ba91
fix merge inconsistencies
Andrii Skliar
committed
f86b0fd
restore test skips
Andrii Skliar
committed
829531c
remove unnecessary code
Andrii Skliar
committed
2a20d79

Commits on Sep 2, 2026

Add ReplaySSM prefix caching on the MTP branch
Andrii Skliar
committed
0f7abb7
test(mamba): skip ReplaySSM graph test without autotuning
Andrii Skliar
committed
65fac9b
Simplify ReplaySSM lifecycle integration
Andrii Skliar
committed
25b2f1d
Fix ReplaySSM pre-commit checks
Andrii Skliar
committed
4d8d019
Fix ReplaySSM type checks
Andrii Skliar
committed
efbfcee
fix(mamba): maintain FlashInfer ReplaySSM trackers in all cache modes
Andrii Skliar
committed
47a0133
refactor(mamba): clarify ReplaySSM lifecycle and prefix materialization
Andrii Skliar
committed
a9339be

Commits on Sep 3, 2026

fix(mamba): compact ReplaySSM materialization requests
Andrii Skliar
committed
fe27076
refactor(mamba): simplify ReplaySSM cache lifecycle
Andrii Skliar
committed
8546368
refactor(mamba): minimize ReplaySSM postprocess planning
Andrii Skliar
committed
791a665
fix(mamba): publish ReplaySSM state after drafting
Andrii Skliar
committed
30d9042
[Mamba] Reconcile ReplaySSM live-state prefix caching

Andrii Skliar
and
codex
committed
00a8998
test: trim ReplaySSM regression suite
Andrii Skliar
committed
9d9c728
[Mamba] Strengthen ReplaySSM MTP cache tests
Andrii Skliar
committed
c202d4b
Merge remote ReplaySSM test cleanup
Andrii Skliar
committed
b1008ee
[Mamba] Respect MTP prefix-cache support boundary
Andrii Skliar
committed
25890ec
[Mamba] Keep ReplaySSM prefix E2E on supported model
Andrii Skliar
committed
5f6d99f
[Mamba] Correct ReplaySSM cache lifecycle
Andrii Skliar
committed
ab96e0b
[Mamba] Simplify ReplaySSM prefix maintenance
Andrii Skliar
committed
7a2c540
[Mamba] Bound ReplaySSM reset launch to active batch
Andrii Skliar
committed
2d75f40
refactor(mamba): clarify ReplaySSM MTP bookkeeping
Andrii Skliar
committed
ce28868
Refactor MTP decode tensor views
Andrii Skliar
committed
1d828e0
Run ReplaySSM end-to-end tests in CI
Andrii Skliar
committed
609e19e
Merge upstream main and preserve ReplaySSM CI coverage
Andrii Skliar
committed
3c6d80e
Expand ReplaySSM CI dependencies
Andrii Skliar
committed
77dea00
test(mamba): run ReplaySSM MTP at TP2
Andrii Skliar
committed
c1dd5a3
[Mamba] Address ReplaySSM review feedback
Andrii Skliar
committed
d4757fa
[Mamba] Simplify ReplaySSM cache ownership
Andrii Skliar
committed
57085cd

Commits on Sep 4, 2026

[Mamba] Fix ReplaySSM materialization expectation
Andrii Skliar
committed
9f93dcb
[Mamba] Preserve hybrid MTP prefix-cache hits
Andrii Skliar
committed
0c4f84f
[Mamba] Fix all-mode MTP prefix-cache coverage
Andrii Skliar
committed
27d0b55
[Mamba] Finish ReplaySSM review cleanup
Andrii Skliar
committed
38429ac
[Mamba] Address ReplaySSM review follow-up
Andrii Skliar
committed
4def0e5
test: trim redundant ReplaySSM coverage
Andrii Skliar
committed
476dc96
test: second trim pass on ReplaySSM coverage
Andrii Skliar
committed
d2dae3d
test: drop superficial ReplaySSM assertions
Andrii Skliar
committed
2409c0c
test: reduce ReplaySSM suite to core coverage
Andrii Skliar
committed
7bb8f00
test: restore load-bearing ReplaySSM coverage
Andrii Skliar
committed
487b9cc
[Mamba] Scope hybrid fallback to ReplaySSM
Andrii Skliar
committed
9d29c8b
[Mamba] Clarify ReplaySSM copied state
Andrii Skliar
committed
b7ec902
[Mamba] Keep ReplaySSM changes feature-scoped
Andrii Skliar
committed
9bf580c
[Mamba] Explain ReplaySSM state transitions
Andrii Skliar
committed
ce01679
[Mamba] Document runner state staging
Andrii Skliar
committed
b0185c6
test(mamba): pin Triton ReplaySSM to runner V1
Andrii Skliar
committed
7d8c575
test(mamba): cover FlashInfer ReplaySSM on V1
Andrii Skliar
committed
669da5b
test(mamba): cover FlashInfer MTP on V1
Andrii Skliar
committed
19fe160
test(mamba): require FlashInfer ReplaySSM coverage
Andrii Skliar
committed
53fe7ed
[Mamba] Tighten ReplaySSM integration boundaries
Andrii Skliar
committed
4c223a7

Commits on Sep 5, 2026

[Mamba] Fix ReplaySSM cache paths and MTP grouping
Andrii Skliar
committed
fc4313d

Commits on Sep 6, 2026

[Mamba] Commit RecoverSSM state in Model Runner V1
Andrii Skliar
committed
6cececc

Commits on Sep 7, 2026

Merge ReplaySSM MTP base into prefix caching
Andrii Skliar
committed
c196387
[Mamba] Merge current main into unified ReplaySSM lifecycle
Andrii Skliar
committed
4eb2ead

Commits on Sep 9, 2026

[Mamba] Preserve ReplaySSM state for padded prompt tails
Andrii Skliar
committed
e4be47b

Commits on Sep 11, 2026

[Mamba] Fix ReplaySSM prefix lifecycle and validation
Andrii Skliar
committed
89f5ad7