Repository navigation

[feature] support pp>1 for Kimi-K3 - #2365

Merged

valarLip merged 52 commits into

mainfrom

guanbao/k3-pp2tp4

Nov 5, 2026

Merged

[feature] support pp>1 for Kimi-K3#2365
valarLip merged 52 commits into
mainfrom
guanbao/k3-pp2tp4

Commits on Oct 30, 2026
- [feature] Support pp>1 for Kimi-K3, with DSpark speculative decoding
  
  ganyi1996ppo
  and
  claude
  committed
  ba71ea2
- review: move the verify-window shift into the runner, clarify spec flags
  
  ganyi1996ppo
  and
  claude
  committed
  0eac576
- test: skip test_verify_ctx_lens without AITER, like the other model_runner tests
  
  ganyi1996ppo
  and
  claude
  committed
  a247dab
- review: derive the PP aux relay layout from ascending tap order and check it
  
  ganyi1996ppo
  and
  claude
  committed
  539e3fe
- review: release a batch's checkpoint holds before any per-seq work
  
  ganyi1996ppo
  and
  claude
  committed
  a913f2b
- review: make the K3 DSpark skip prefixes a tuple the PP stage rebinds
  
  ganyi1996ppo
  and
  claude
  committed
  458260b
- review: fill the PP verify draft columns in one vectorized scatter
  
  ganyi1996ppo
  and
  claude
  committed
  cba6844
- review: read undeferred spec counts back in one D2H
  
  ganyi1996ppo
  and
  claude
  committed
  9981597
- review: pack the PP aux relay into one preallocated send buffer
  
  ganyi1996ppo
  and
  claude
  committed
  1f17859
Commits on Oct 31, 2026
- Merge main (0e71a5273) into guanbao/k3-pp2tp4
  wanzhenchn
  committed
  a128906
Commits on Nov 1, 2026
- review: size the PP aux relay send buffer to the forward's rows
  
  ganyi1996ppo
  and
  claude
  committed
  6808659
- review: drop the stale read-side reason from _checkpoint_room
  
  ganyi1996ppo
  and
  claude
  committed
  acdf74d
- review: flush a held chunk's hashes on the PP ack path too
  
  ganyi1996ppo
  and
  claude
  committed
  f34cb8a
Commits on Nov 2, 2026
- Merge main (99ebf633a) into guanbao/k3-pp2tp4
  
  ganyi1996ppo
  and
  claude
  committed
  5ab3d68
- review: let any PP aux relay tap allocate, and check every own tap fired
  
  ganyi1996ppo
  and
  claude
  committed
  a0b8ef0
- review: build the PP aux relay in spec_decode, not in the runner
  
  ganyi1996ppo
  and
  claude
  committed
  f0522ff
- review: size a P/D first decode's neighbours from the shifted context lens
  
  ganyi1996ppo
  and
  claude
  committed
  9bebbb3
- review: read a forked state through the kernels' read-side index
  
  ganyi1996ppo
  and
  claude
  committed
  401bcae
- review: refuse unwired PP combinations at config time
  
  ganyi1996ppo
  and
  claude
  committed
  549ae77
- review: plan the vLLM plugin's dense MLA work at the layer's padded width
  
  ganyi1996ppo
  and
  claude
  committed
  c823e96
- review: drop the PP checkpoint hold's dead prompt-end case
  
  ganyi1996ppo
  and
  claude
  committed
  5b0b85d
- review: install the PP aux relay's taps through the drafter's own helper
  
  ganyi1996ppo
  and
  claude
  committed
  7a61f50
- review: send the PP aux relay's payload without a second clone
  
  ganyi1996ppo
  and
  claude
  committed
  b5821ff
- review: one use_spec on every stage, runner and scheduler alike
  
  ganyi1996ppo
  and
  claude
  committed
  400f1f7
- review: one source each for the deferred-output mode and the verify width
  
  ganyi1996ppo
  and
  claude
  committed
  202906e
- review: top-level imports, and document PP + DSpark for Kimi-K3
  
  ganyi1996ppo
  and
  claude
  committed
  74d743b
- review: keep the DSpark draft out of online quant in the PP2 accuracy case
  
  ganyi1996ppo
  and
  claude
  committed
  3fc180e
- review: keep the PP aux relay's hook free of in-place set mutation under Dynamo
  
  ganyi1996ppo
  and
  claude
  committed
  f660797
- review: read undeferred spec counts off the sampled ids, without a D2H
  
  ganyi1996ppo
  and
  claude
  committed
  64bda0c
- review: stage the forked write slots through pinned memory
  
  ganyi1996ppo
  and
  claude
  committed
  89b996c
- review: the relay's docstring follows the spec's layer_ids order
  
  ganyi1996ppo
  and
  claude
  committed
  e1c80ce
Commits on Nov 3, 2026
- Merge main (825b63ba4) into guanbao/k3-pp2tp4
  
  ganyi1996ppo
  and
  claude
  committed
  c4975cd
- review: pass the runner's attn_family to defers_output again
  
  ganyi1996ppo
  and
  claude
  committed
  2edbab7
- review: gate PP placeholders on the batch's frozen chunk state
  
  ganyi1996ppo
  and
  claude
  committed
  5661b9f
- review: release a checkpoint hold only from the chunk that holds it
  
  ganyi1996ppo
  and
  claude
  committed
  91e51df
- review: let a P/D producer under PP keep any drafter
  
  ganyi1996ppo
  and
  claude
  committed
  1a570a2
- review: read a forked spec row's source in every column
  
  ganyi1996ppo
  and
  claude
  committed
  d9f26d5
- review: keep the spec-path fork assert unless the backend opts in
  
  ganyi1996ppo
  and
  claude
  committed
  7a64ee6
- review: refuse TBO under PP and drop the relay's TBO grow branch
  
  ganyi1996ppo
  and
  claude
  committed
  7e45c5b
- review: seed ReplaySSM forks from host-known slot pairs, without a sync
  
  ganyi1996ppo
  and
  claude
  committed
  c024c82
- review: write relay captures without bookkeeping Dynamo freezes
  
  ganyi1996ppo
  and
  claude
  committed
  cf98ae7
- review: let the registry declare which spec methods an arch serves under PP
  
  ganyi1996ppo
  and
  claude
  committed
  cd0d315
- review: name the checkpoint hold by what it does
  
  ganyi1996ppo
  and
  claude
  committed
  e65bb71
- review: stage the undeferred window from the recorded placeholder width
  
  ganyi1996ppo
  and
  claude
  committed
  3a2258b
- review: let the drafter read the relayed aux block in place
  
  ganyi1996ppo
  and
  claude
  committed
  50998fd
- review: derive DSpark's instance aux spec from its classmethod
  
  ganyi1996ppo
  and
  claude
  committed
  81917c0
- review: drop the CLAUDE.md key list and getattrs on always-set fields
  
  ganyi1996ppo
  and
  claude
  committed
  30829a3
- Merge main (a8946ff73) into guanbao/k3-pp2tp4
  
  ganyi1996ppo
  and
  claude
  committed
  337bcd5
Commits on Nov 4, 2026
- review: allocate aux buffers only for this stage's own taps
  
  ganyi1996ppo
  and
  claude
  committed
  a1436cd
- review: share one tap residency rule between the drafter and the relay
  
  ganyi1996ppo
  and
  claude
  committed
  b62bf7a
Commits on Nov 5, 2026
- Merge main (ab4ada40a) into guanbao/k3-pp2tp4
  
  ganyi1996ppo
  and
  claude
  committed
  c10069c
- Merge main (058c21957) into guanbao/k3-pp2tp4
  
  ganyi1996ppo
  and
  claude
  committed
  9fb45ff

Commits

Commits on Oct 30, 2026

Commits on Oct 31, 2026

Commits on Nov 1, 2026

Commits on Nov 2, 2026

Commits on Nov 3, 2026

Commits on Nov 4, 2026

Commits on Nov 5, 2026