[Feat][Model] Support encoder-side SWA-bounded replay for DeepSeek-V4.1-Flash - #56227

Merged

WoosukKwon merged 13 commits into

mainfrom

feat/dsv41-swa-bounded-replay

Sep 18, 2026

Commits on Sep 17, 2026

[Core][HMA] SWA bounded replay for DeepSeek-V4.1 sliding-window caches

ivanium
and
claude
committed
f97274e
[Bugfix][DeepSeek-V4.1] Mask the indexer's compressed slots under PCP too

ivanium
and
claude
committed
23f16e0
[Core][HMA] Always mask compressed slots by the tokens' own slots

ivanium
and
claude
committed
81ef332
[Bugfix][DeepSeek-V4.1] Take KV-connector hits in whole blocks under SWA bounded replay

ivanium
and
claude
committed
a1396b7
[Model] Own the DeepSeek-V4.1 SWA replay start in the model state

ivanium
and
claude
committed
42acc01
[Model] Turn SWA bounded replay off under prefill context parallelism

ivanium
and
claude
committed
4d4796c

Commits on Sep 18, 2026

Merge branch 'main' into feat/dsv41-swa-bounded-replay
WoosukKwon
authored
8f46876
[Model] Accept the new optional arguments in SWA builder and model-state overrides

ivanium
and
claude
committed
a1f3da4
Merge branch 'main' into feat/dsv41-swa-bounded-replay
ivanium
authored
a210a63
[Test] Give the SWA and NIXL scheduler stubs the bounded-replay attributes

ivanium
and
claude
committed
af3d418
Merge branch 'main' into feat/dsv41-swa-bounded-replay
WoosukKwon
authored
4fad82b
[Test] Give the bare NIXL HMA scheduler a replay window of zero

ivanium
and
claude
committed
d34076c
Merge branch 'main' into feat/dsv41-swa-bounded-replay
ivanium
authored
4909bff