Repository navigation

[Perf][DSv4.1] Extend the latency_specialized decode on NVIDIA - #63921

Merged

ivanium merged 16 commits into

vllm-project:mainfrom

yaoyaoding:dsv41-specialized-decode-perf

Nov 4, 2026

Merged

[Perf][DSv4.1] Extend the latency_specialized decode on NVIDIA#63921
ivanium merged 16 commits into
vllm-project:mainfrom
yaoyaoding:dsv41-specialized-decode-perf

Commits on Oct 23, 2026
- [DSv4.1] Faster latency_specialized decode on NVIDIA GPUs
  
  yaoyaoding
  and
  claude
  committed
  bbf4528
- [DSv4.1] Gather the specialized decode's rows and logits with its own all-gather
  
  yaoyaoding
  and
  claude
  committed
  5ab5ef9
- [DSv4.1] Gate the specialized decode on weight updates; custom all-gather stress mode
  
  yaoyaoding
  and
  claude
  committed
  0cdfc56
Commits on Oct 27, 2026
- [DSv4.1] Run the specialized decode's FlashInfer paths on newer FlashInfer
  
  yaoyaoding
  and
  claude
  committed
  8746d6d
- Merge main and the FlashInfer gate fix into the specialized decode extension
  
  yaoyaoding
  and
  claude
  committed
  d7fcb75
- [DSv4.1] Allow FlashInfer's summation order in the finalize test
  
  yaoyaoding
  and
  claude
  committed
  b7bb822
Commits on Oct 28, 2026
- Merge main into the specialized decode extension
  
  yaoyaoding
  and
  claude
  committed
  cf60138
Commits on Oct 31, 2026
- Merge main into the specialized decode extension
  
  yaoyaoding
  and
  claude
  committed
  537ec36
- [DSv4.1] Give the specialized decode's MXFP8 test layer a params dtype
  
  yaoyaoding
  and
  claude
  committed
  6dfe8de
Commits on Nov 2, 2026
- Merge branch 'main' into dsv41-specialized-decode-perf
  mergify[bot]
  authored
  031e305
Commits on Nov 3, 2026
- [DSv4.1] Narrow the custom all-gather communicator in its test
  
  yaoyaoding
  and
  claude
  committed
  8e3fd02
- Merge branch 'main' into dsv41-specialized-decode-perf
  vllm-agent
  authored
  6330fc8
- Merge main into the specialized decode extension
  
  yaoyaoding
  and
  claude
  committed
  8c0c7ca
- Merge branch 'main' into dsv41-specialized-decode-perf
  vllm-agent
  authored
  3bd9660
Commits on Nov 4, 2026
- Merge main into the specialized decode extension
  
  yaoyaoding
  and
  claude
  committed
  af1aab4
- Merge branch 'main' into dsv41-specialized-decode-perf
  vllm-agent
  authored
  fe843bc

Commits

Commits on Oct 23, 2026

Commits on Oct 27, 2026

Commits on Oct 28, 2026

Commits on Oct 31, 2026

Commits on Nov 2, 2026

Commits on Nov 3, 2026

Commits on Nov 4, 2026