Pipeline parallelism x speculative decoding (EAGLE/MTP) compatibility - #30775

Open

AliceChenyy wants to merge 47 commits into

sgl-project:mainfrom

AliceChenyy:feat/pp-spec-compat

Commits on Jul 10, 2026

Fix PP proxy buffer sizing and refresh for speculative verify

AliceChenyy
and
claude
committed
6b232c1
[RFC] Pipeline parallelism x speculative decoding (EAGLE/MTP) compatibility

AliceChenyy
and
claude
committed
c79d133

Commits on Jul 13, 2026

Fix lint: apply black/isort formatting

AliceChenyy
and
claude
committed
682d323
Fix PP+spec draft embedding loading; accept_length recovers to parity

AliceChenyy
and
claude
committed
5718cc6
Generalize PP+spec beyond GLM: portable embed name and context-len bound

AliceChenyy
and
claude
committed
46fee6c
Address self-review: harden the PP+spec gate and fix ungated regressions

AliceChenyy
and
claude
committed
3686cd9

Commits on Jul 14, 2026

Revert batch_result_processor.py to upstream (comment-only net diff)

AliceChenyy
and
claude
committed
32e3751
Merge upstream/main into feat/pp-spec-compat

AliceChenyy
and
claude
committed
ec9c1d0
Review polish: assert message, explicit None checks, stray blank lines

AliceChenyy
and
claude
committed
5b51ecb

Commits on Jul 16, 2026

Commits on Jul 17, 2026

Lint: black formatting for bootstrap.py

AliceChenyy
and
claude
committed
aa737e6

Commits on Jul 27, 2026

Merge upstream/main into feat/pp-spec-compat

AliceChenyy
and
claude
committed
8caeda8
Fix stale attribute after merge: num_tokens_per_req -> captured_req_width

AliceChenyy
and
claude
committed
598fa41

Commits on Aug 17, 2026

Merge upstream/main into feat/pp-spec-compat

AliceChenyy
and
claude
committed
13a5d3d
Adapt the PP+spec verify rebuild to upstream's verify-mask API

AliceChenyy
and
claude
committed
06285ec
Harden the PP+spec relay: ring ordering, chunked prefill, batch invariants

AliceChenyy
and
claude
committed
ffd716a
Relay the drafted tree topology so PP+spec is not limited to topk=1 chains

AliceChenyy
and
claude
committed
090c391
Add PP x spec tests; drop the mixed-chunk assert as unreachable

AliceChenyy
and
claude
committed
dc440b9
Carry the PP relay state as a SpecInput instead of a scheduler side table

AliceChenyy
and
claude
committed
d41e097

Commits on Aug 26, 2026

Merge upstream/main into feat/pp-spec-compat

AliceChenyy
and
claude
committed
2fdb5af

Commits on Aug 27, 2026

Merge upstream/main into feat/pp-spec-compat
AliceChenyy
committed
29e3244

Commits on Aug 31, 2026

Merge upstream/main into feat/pp-spec-compat

AliceChenyy
and
claude
committed
b48e4d9
Lint: isort/black over the merge
AliceChenyy
committed
6a0ec0e

Commits on Sep 1, 2026

Gate the PP+spec relay reads mock-safely

AliceChenyy
and
claude
committed
08ae55c
Address review: config reads, algorithm whitelist, PD gate, embed loader, steps=0

AliceChenyy
and
claude
committed
2684031

Commits on Sep 2, 2026

Reuse the target runner's load config for the draft embedding read

AliceChenyy
and
claude
committed
8d78574
Merge remote-tracking branch 'origin/main' into HEAD
YAMY1234
committed
cf9f9bc

Commits on Sep 3, 2026

Commits on Sep 8, 2026

Commits on Sep 9, 2026

Merge branch 'main' into feat/pp-spec-compat
YAMY1234
authored
96626f2

Commits on Sep 14, 2026

Merge upstream/main to include MXFP4 JIT CI fix
YAMY1234
committed
5a0eaed
test: use Scheduler defaults in sampling-mask PP round trip
YAMY1234
committed
7d8cf63

Commits on Sep 15, 2026

Commits on Sep 16, 2026

Compact the accepted tree path into every PP stage's KV, not just the last

AliceChenyy
and
claude
committed
75c07c8