Repository navigation

[Bugfix][HiSparse] Resolve MTP verification rows with a union residency kernel - #59235

Merged

MatthewBonanni merged 13 commits into

vllm-project:mainfrom

MatthewBonanni:hisparse-spec-race

Sep 30, 2026

Merged

[Bugfix][HiSparse] Resolve MTP verification rows with a union residency kernel#59235
MatthewBonanni merged 13 commits into
vllm-project:mainfrom
MatthewBonanni:hisparse-spec-race

Commits on Sep 29, 2026
- [Bugfix][HiSparse] Resolve a request's speculative rows in order
  
  MatthewBonanni
  and
  claude
  committed
  e06d812
- [HiSparse] Resolve a request's rows as one union of host misses
  
  MatthewBonanni
  and
  claude
  committed
  912f8e2
- [HiSparse] Probe a power-of-two union table and resolve rows in one pass
  
  MatthewBonanni
  and
  claude
  committed
  7b21104
- [HiSparse] Cap the union table at hot_size + 1 and keep one block per SM
  
  MatthewBonanni
  and
  claude
  committed
  2301e98
- [HiSparse] Resolve verification rows in one swap_in on every backend
  
  MatthewBonanni
  and
  claude
  committed
  9371f0b
- [HiSparse] Fold decode conversion into convert_logical_to_physical_topk
  
  MatthewBonanni
  and
  claude
  committed
  7059ece
- [HiSparse] Size the union table from the decode union bound
  
  MatthewBonanni
  and
  claude
  committed
  4a3284d
Commits on Sep 30, 2026
- [HiSparse] Keep decode request ids in a persistent buffer
  
  MatthewBonanni
  and
  claude
  committed
  30449b2
- [HiSparse] Allocate the decode request-id buffer in the group builder
  
  MatthewBonanni
  and
  claude
  committed
  ce6eb50
- [HiSparse] Trim request-id buffer comment
  
  MatthewBonanni
  and
  claude
  committed
  3d47665
- [HiSparse] Check resolver shared memory in Python, without a new op
  
  MatthewBonanni
  and
  claude
  committed
  25e666d
- [HiSparse] Drop the race test case the 8-row case covers
  
  MatthewBonanni
  and
  claude
  committed
  c735244
- Merge branch 'main' into hisparse-spec-race
  MatthewBonanni
  authored
  ce3bc50

Commits

Commits on Sep 29, 2026

Commits on Sep 30, 2026