[DCP] CPP-prefill -> DCP-decode KV transfer, replicated index cache, and MTP - #2008

Closed

Jasen2201 wants to merge 79 commits into

mainfrom

Jasen/dcp-kv-transfer

Commits on Aug 21, 2026

add persistent path for DCP GLM5.2
zhuyuhua-v
committed
c5a5223

Commits on Aug 24, 2026

add ATOM_DCP_REPLICATE_INDEX_CACHE to control dcp index cache
zhuyuhua-v
committed
b2bbbbf
remove contiguous and support lmcache
zhuyuhua-v
committed
acf9ab2
Merge main and preserve replicated DCP index layout
zhuyuhua-v
committed
571d5be

Commits on Aug 26, 2026

feat(dcp): migrate the test_pd_dcp branch onto the DCP KV-transfer line
Jasen2201
committed
82a5fa6
Adapt the PD block transfer to a DCP decode node
Jasen2201
committed
c3d933a
Run MTP on the DCP decode node
Jasen2201
committed
445fa83
support PD replicated index cache
Phi-C
committed
2630230
Move DSA index pages as pages, not as tokens
Jasen2201
committed
7a3d735
Mirror the DSA decode logits plane out of the CUDA graph
Jasen2201
committed
9f20653
Evaluate GSM8K the way the GLM-5 recipe does
Jasen2201
committed
ebfd52f
Give the DCP PD GSM8K number a same-box control
Jasen2201
committed
852bd8d
Record the MTP=3 accuracy and acceptance rate on DCP decode
Jasen2201
committed
52fe310
Merge branch 'main' into yuhua/dsa-dcp-persistent
zhuyuhua-v
authored
1517dff
Turn MTP on by default in the DCP launch script
Jasen2201
committed
bbc6af7
Drop the CI and doc changes from the DCP KV-transfer branch
Jasen2201
committed
0330f82

Commits on Aug 27, 2026

[CI] add test case step for p(cpp4)d(dcp4)
MengqingCao
committed
1ddd09b
remove tp4+dcp4
MengqingCao
committed
0725b57
[CI] fix common args
MengqingCao
committed
387ba07
[CI] fix HANDSHAKE_PORT
MengqingCao
committed
16420d5
[CI] make 47 firt order
MengqingCao
committed
3fa18cc
[ci] fix pp
MengqingCao
committed
778fce1
[CI] keep prefill-only env out of the decode server
Jasen2201
committed
e8827d4
[CI] replicate the DCP index cache on the cpp4-dcp4 decode server
Jasen2201
committed
b57cd66
Merge PR #1995 (yuhua/dsa-dcp-persistent) into the DCP KV-transfer branch
Jasen2201
committed
3250c16
style: fold the dsa_logits_dump import into the existing atom.utils block
Jasen2201
committed
f07b5d2
Remove the DSA indexer logits mirror
Jasen2201
committed
23c05f2
[Dashboard] fix wrong count of gpu
MengqingCao
committed
0e8ea4f
Keep the PAGE layout version at 3
Jasen2201
committed
a195fce
Keep register_received_prefix returning the registered block count
Jasen2201
committed
23c0ce6
Restore the one-line docstring on _replicated_index_cache_transfer_supported
Jasen2201
committed
7dd0bc7
Drop the index page plane comment
Jasen2201
committed
d440996
Drop the index_slot_mapping MTP comment
Jasen2201
committed
8ecb035
Condense the DCP relayout comments
Jasen2201
committed
36ba408

Commits on Aug 28, 2026

[CI] make 43 the first order
MengqingCao
committed
f2cb8b5
set ATOM_SPARSE_INDEXER_LOGITS_BUDGET_MB to 2047
MengqingCao
committed
dcd0420
make node customized
MengqingCao
committed
d3a412a
Let ATOMesh workflow infer Slurm partition from custom nodes.

MengqingCao
and
cursoragent
committed
178453e
Merge origin/main into Jasen/dcp-kv-transfer
Jasen2201
committed
8919b45
Merge remote-tracking branch 'origin/Jasen/dcp-kv-transfer' into Jasen/dcp-kv-transfer
Jasen2201
committed
0c21124
Merge origin/main into Jasen/dcp-kv-transfer
Jasen2201
committed
43c6384
revert 178453e7c563f9f2f6bfb23aa88a8c851fdb77d5
MengqingCao
committed
eed8ce1
revert d3a412a7251804dd8d126a74b48fcc72434a0291
MengqingCao
committed
9cd8f03
Shrink PR #2008 to the DCP KV-transfer code change
Jasen2201
committed
39c3eb0
Trim DCP relayout commentary
Jasen2201
committed
4997a76
Drop the DCP sparse indptr comment
Jasen2201
committed
cd3e425
Restore upstream NaN-guard formatting in dcp_ops
Jasen2201
committed
a787950
Drop the RS-layout DCP merge optimization
Jasen2201
committed
48a5a45
Keep pd_matrix's node-count branches separate
Jasen2201
committed
76095c6
Drop the LMCache chunk-floor fix
Jasen2201
committed
6212a11

Commits on Aug 30, 2026

Keep PD incremental KV alive when only decode runs DCP
Jasen2201
committed
3d3738d

Commits on Aug 31, 2026

Merge origin/main into Jasen/dcp-kv-transfer
Jasen2201
committed
087d037
set TOPK_FORCE_PATH=one
MengqingCao
committed
43fb811
Give the replicated index cache a skip sentinel and a draft-step mapping

Jasen2201
and
claude
committed
2e22291
Give both ubatch builders the indexer fields they were missing

Jasen2201
and
claude
committed
ca2bcb2
Filter the padded decode width, not just the scheduled one

Jasen2201
and
claude
committed
6d2e1fb
Size sparse MTP work buffers for the DCP-gathered query width

Jasen2201
and
claude
committed
ee9cc0e
Fault instead of misplacing KV when the DCP relayout cannot apply

Jasen2201
and
claude
committed
2782986
Cover the MTP shape the DCP filter's token->request map exists for

Jasen2201
and
claude
committed
a41c374

Commits on Sep 1, 2026

Merge remote-tracking branch 'origin/main' into Jasen/dcp-kv-transfer
Jasen2201
committed
a864a81
Keep the two DCP relayouts off out-of-range blocks

Jasen2201
and
claude
committed
0a97a53
Merge branch 'main' into Jasen/dcp-kv-transfer
Jasen2201
authored
870dbd6
test(mla): give the transfer-region runner double aligned_index_dim

Jasen2201
and
claude
committed
0bf776b
Assert the row counts the DCP filter's token grid indexes

Jasen2201
and
claude
committed
809de5f
Reject an index page that is not a whole number of token rows

Jasen2201
and
claude
committed
9941008
Drop the replicated-index fields nothing reads

Jasen2201
and
claude
committed
a02bfc0
Document ATOM_DCP_REPLICATE_INDEX_CACHE and the DSA+DCP+MTP it unblocks

Jasen2201
and
claude
committed
4cb411b
Drop the _coalesce claim that merging is the common case

Jasen2201
and
claude
committed
fed3c56
Plan the replicated index relayout once per page geometry

Jasen2201
and
claude
committed
fb876da
Raise rather than assert on the DCP filter's row counts
Jasen2201
committed
8f80ae4
Refuse a block region the DCP relayout does not describe
Jasen2201
committed
174456e
Check the index row against the indexer's quantization block
Jasen2201
committed
5dc621b
Declare index_slot_mapping on AttentionMetaData
Jasen2201
committed
858f6ca
Say that speculative decode keeps the sparse DCP persistent path
Jasen2201
committed
b7939fd
Count a PP role's GPUs from the flag the server ran with
Jasen2201
committed
8e3956e
Merge branch 'main' into Jasen/dcp-kv-transfer
Jasen2201
committed
e4cedc5

Commits on Sep 2, 2026

Merge branch 'main' into Jasen/dcp-kv-transfer
Jasen2201
authored
d127fe1
[MTP][DCP] Fix draft token_to_seq_idxs, drop broken index sharing
Jasen2201
committed
6337d9b
Merge branch 'main' into Jasen/dcp-kv-transfer

Jasen2201
and
cursoragent
committed
44868cc