Repository navigation

[Perf][Spec Decode] Vocab-parallel DSpark Markov sampling and vocab-sharded verification over TP - #65007

Open

MrGeva wants to merge 9 commits into

vllm-project:mainfrom

MrGeva:egeva/dspark-tp-markov

Open

[Perf][Spec Decode] Vocab-parallel DSpark Markov sampling and vocab-sharded verification over TP#65007
MrGeva wants to merge 9 commits into
vllm-project:mainfrom
MrGeva:egeva/dspark-tp-markov

Commits on Nov 4, 2026
- [Perf][Spec Decode] Vocab-parallel DSpark Markov sampling over TP
  
  MrGeva
  and
  claude
  committed
  2dac1af
- [Spec Decode] DSpark TP Markov: agreed fallback, surfaced timeouts, safe tags
  
  MrGeva
  and
  claude
  committed
  f3c40ed
- [Spec Decode] Test DSpark TP Markov sampling through the real sampling path, in CI
  
  MrGeva
  and
  claude
  committed
  17f84b3
- [Spec Decode] DSpark TP Markov: flag exchange timeouts in host memory
  
  MrGeva
  and
  claude
  committed
  c9a1101
- [Perf][Spec Decode] Vocab-sharded speculative verification over TP
  
  MrGeva
  and
  claude
  committed
  c98fe05
- [Spec Decode] Vocab-sharded verification: agreed fallback, surfaced timeouts, safe tags
  
  MrGeva
  and
  claude
  committed
  c6cd6df
- [Spec Decode] Set the draft vocab shard in the DSpark TP Markov test speculator
  
  MrGeva
  and
  claude
  committed
  c4a94f2
- [Spec Decode] Vocab-sharded verification: flag exchange timeouts in host memory
  
  MrGeva
  and
  claude
  committed
  0482eef
- [Spec Decode] Vocab-sharded verification: warm up every kernel variant at load
  
  MrGeva
  and
  claude
  committed
  01ad205