Add StaticScatterKeyValueCache: drive mobius bias-aware external-KV (TensorScatter + nonpad_kv_seqlen) static cache - #2235

Open

Ti-Tai Wang (titaiwangms) wants to merge 8 commits into

mainfrom

static-scatter-kv-cache

Commits on Jun 20, 2026

Add StaticScatterKeyValueCache for mobius static-cache decoders (#349)

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
6b1ba5b
Enable StaticScatterKeyValueCache e2e fixture-parity test

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
5ee880d
Address StaticScatterKeyValueCache review: fail-loud RewindTo, predicate, nits

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
d3a3837
Reconcile static-scatter tests: restore e2e parity + enable RewindTo throw test

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
4753c69

Commits on Jun 22, 2026

Fix CI build + lint for static-scatter KV cache test

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
345800b
Address Copilot review nits on static-scatter KV cache

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
7c0e90a
Skip StaticScatter fixture tests on the DirectML EP

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
2fd84e8

Commits on Jun 23, 2026

Address review feedback on static-scatter KV cache

Ti-Tai Wang (titaiwangms)
and
Copilot
committed
72e7199