refactor(unified-memory): translate the KV write location once, at ForwardBatch construction - #35245

Merged

ch-wan merged 19 commits into

sgl-project:mainfrom

caihuali95:mainline/write-loc-rebind

Aug 31, 2026

Commits on Aug 30, 2026

feat(unified-memory): KVIndexTranslator, one place to convert KV ids

authored and
ch-wan
committed
d35eb7b
refactor(unified-memory): Triton reads through the id translator

authored and
ch-wan
committed
70fac37
perf(unified-memory): the read-table stride is a runtime arg, not a constexpr

ch-wan
and
claude
committed
97813dc
fix(unified-memory): route a negative slot to the sink in the kernel, not just the reference

ch-wan
and
claude
committed
35510f6
fix(unified-memory): size the read table off seq_lens_sum, not seq_lens_cpu

ch-wan
and
claude
committed
5ffb07a
docs(unified-memory): cut the comments that argue for the diff

ch-wan
and
claude
committed
09ee00f
docs(unified-memory): finish the vocabulary alignment

ch-wan
and
claude
committed
6a5e4d0
refactor(unified-memory): the read table's destination is a parameter, not a mode

ch-wan
and
claude
committed
09d556c
refactor(unified-memory): fill_read_table fills, it does not return
ch-wan
committed
c94187a

Commits on Aug 31, 2026

docs(unified-memory): cut the comments that restate the line below them
ch-wan
committed
4e48ddd
feat(unified-memory): write-loc surface on the KV index translator

authored and
ch-wan
committed
46dd3f7
refactor(unified-memory): translate the KV write loc once, at ForwardBatch prep

authored and
ch-wan
committed
f093ed2
fix(unified-memory): disable prefill cuda-graph capture, not just piecewise

authored and
ch-wan
committed
1b5c0c4
test(unified-memory): pin the ForwardBatch-side write-loc wiring

authored and
ch-wan
committed
31e8417
docs(unified-memory): say why get_ still translates and set_ no longer does

ch-wan
and
claude
committed
bc50bb7
fix(unified-memory): make a skipped write-loc rebind detectable

ch-wan
and
claude
committed
49ff303
docs(unified-memory): cut the comments that argue for the diff

ch-wan
and
claude
committed
576b1f9
refactor(unified-memory): derive the SWA write loc from the translator, not the read table
ch-wan
committed
bdc9849
docs(unified-memory): cut the comments that restate the line below them
ch-wan
committed
54a59c2