Repository navigation

[wip] support PD seperate mode for fault-tolerance - #55151

Open

tiankaijin wants to merge 35 commits into

vllm-project:mainfrom

tiankaijin:vllm271

Open

[wip] support PD seperate mode for fault-tolerance#55151
tiankaijin wants to merge 35 commits into
vllm-project:mainfrom
tiankaijin:vllm271

Commits on Aug 7, 2026
- [Bugfix][Build] Fix DeepGEMM CUDA 12.9 FP8 header visibility (#51003)
  khluu
  committed
  539455e
- [Bugfix][CPU] Fix macOS build: std::sqrt is not constexpr under libc++ (#50915)
  
  harjothkhara
  authored and
  khluu
  committed
  14a4751
- [Kernel] Add support for Flashinfer Mamba SSU algorithm selection (#50157)
  
  authored and
  khluu
  committed
  160356c
- [CI] Stabilize GLM-5.2 PCP evaluation (#51015)
  
  khluu
  and
  codex
  committed
  b047571
- [Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)
  
  netanel-haber
  authored and
  khluu
  committed
  4b25076
Commits on Aug 9, 2026
- Bump Flashinfer version to 0.6.16.post3 (#50892)
  
  committed
  689fa52
- [INC] fix w4a4 model (#50807)
  
  mayuyuace
  authored and
  khluu
  committed
  85ea133
- [Kimi-K3] Add option to shard the shared expert instead of replicating (#50656)
  
  authored and
  khluu
  committed
  5a76724
- [BugFix][K3] Skip moe_intermediate padding when EP is enabled (#51131)
  
  ZeldaHuang
  authored and
  khluu
  committed
  4efaa99
- [Bugfix][Model] Add missing fused_qkv_a_proj to Kimi-Linear packed_modules_mapping (#51249)
  
  authored and
  khluu
  committed
  31ffc88
- [Bugfix] Keep mamba align prefill chunks block-aligned past last_cache_position (#51113)
  
  authored and
  khluu
  committed
  3f9fc83
- Fix ROCm architecture import on non-ROCm platforms (#51357)
  
  authored and
  khluu
  committed
  d0d9691
- [CI] Fix Batch Invariance (B200) (#51417)
  
  ZJY0516
  authored and
  khluu
  committed
  a60fb53
- [K3] Allow tpu to import kimi_k3.common (#51529)
  
  majunze2001
  authored and
  khluu
  committed
  4dbf890
Commits on Aug 10, 2026
- [Model] Add K-EXAONE-2.0-750B-A37B (#50524)
  
  authored and
  khluu
  committed
  525832b
- [Kimi][MM] disable kimi_vit's dynamic torch.compile for TPU (#51196)
  
  lk-chen
  authored and
  khluu
  committed
  e50f7d3
- [Docs] Fix two docs build warnings (#51014)
  
  hmellor
  and
  claude
  committed
  4bdc8a7
- Support quantized DSpark Markov heads (#50424)
  
  authored and
  khluu
  committed
  7ce42a9
Commits on Aug 11, 2026
- [CI] Parallelize release image publishing (#51735)
  
  khluu
  and
  codex
  committed
  9fc29ec
- [CI] Isolate Ubuntu 22.04 test dependency cache
  khluu
  committed
  26363ce
- [CI] Limit Arctic import check to x86 test images
  khluu
  committed
  6e448d0
Commits on Aug 25, 2026
- ft reuse request
  tiankaijin
  committed
  9e695c4
Commits on Aug 26, 2026
- add debug info
  tiankaijin
  committed
  bb40a8b
Commits on Aug 29, 2026
- fix resume logic
  tiankaijin
  committed
  f9a0040
- fix resume
  tiankaijin
  committed
  36537a8
Commits on Sep 4, 2026
- fix kv_connector losss in FT case
  tiankaijin
  committed
  3b0fc98
Commits on Sep 5, 2026
- fix pd seperate kv_connector loss problem(FT_tolerance)
  tiankaijin
  committed
  ed80814
- fix grammer
  tiankaijin
  committed
  ba86f44
- fix bug
  tiankaijin
  committed
  dfa4272
- fix
  tiankaijin
  committed
  7c5c05b
- fix
  tiankaijin
  committed
  d60f0fc
Commits on Sep 8, 2026
- fix
  tiankaijin
  committed
  b2259c2
- fix
  tiankaijin
  committed
  dceea49
- fix
  tiankaijin
  committed
  ff375fa
- fix
  tiankaijin
  committed
  08092f5

Commits

Commits on Aug 7, 2026

Commits on Aug 9, 2026

Commits on Aug 10, 2026

Commits on Aug 11, 2026

Commits on Aug 25, 2026

Commits on Aug 26, 2026

Commits on Aug 29, 2026

Commits on Sep 4, 2026

Commits on Sep 5, 2026

Commits on Sep 8, 2026