Repository navigation

[Chore] [NVIDIA] deps: Bump FlashInfer to 0.7.3 and migrate the NVLink one-sided all-to-all to flashinfer.moe_ep - #48468

Open

leejnau wants to merge 16 commits into

sgl-project:mainfrom

leejnau:flashinfer-0.7.3-moe-ep

Open

[Chore] [NVIDIA] deps: Bump FlashInfer to 0.7.3 and migrate the NVLink one-sided all-to-all to flashinfer.moe_ep#48468
leejnau wants to merge 16 commits into
sgl-project:mainfrom
leejnau:flashinfer-0.7.3-moe-ep

Commits on Nov 4, 2026
- Switch NVLinkOneSidedAllToAll to use moe-ep flashinfer API
  
  trevor-m
  authored and
  leejnau
  committed
  2634149
- fix lint
  
  trevor-m
  authored and
  leejnau
  committed
  4d0a170
- use runtime_max_tokens_per_rank instead of max_tokens_per_rank in dispatch
  
  trevor-m
  authored and
  leejnau
  committed
  b559e7e
- Bump FlashInfer to 0.7.3
  
  leejnau
  and
  claude
  committed
  fce266d
Commits on Nov 5, 2026
- speculative: Pass last_valid_index to FlashInfer 0.7.3 DeviceSamplingFromProb
  
  leejnau
  and
  claude
  committed
  542af95
- Merge branch 'main' into flashinfer-0.7.3-moe-ep
  Fridge003
  authored
  9b3e5b1
- Merge remote-tracking branch 'upstream/main' into flashinfer-0.7.3-moe-ep
  leejnau
  committed
  d051b43
- Merge branch 'main' into flashinfer-0.7.3-moe-ep
  nvpohanh
  authored
  146b95a
- flashinfer: Pass fixed_uniform_q_len in the fast prefill plan for FlashInfer 0.7.3
  
  leejnau
  and
  claude
  committed
  c8d1c29
- minimax: Zero the NVFP4 payload when the block scale underflows, as FlashInfer 0.7.3 does
  
  leejnau
  and
  claude
  committed
  f7e46a5
- moe: Sum the NVFP4 trtllm MoE outputs in a fixed order in deterministic mode
  
  leejnau
  and
  claude
  committed
  ef199b4
- moe: Skip the deterministic-mode check when no server config is published
  
  leejnau
  and
  claude
  committed
  cab9499
- Merge remote-tracking branch 'upstream/main' into flashinfer-0.7.3-moe-ep
  leejnau
  committed
  e9fe238
- Merge remote-tracking branch 'upstream/main' into flashinfer-0.7.3-moe-ep
  leejnau
  committed
  dc0415c
Commits on Nov 6, 2026
- Merge remote-tracking branch 'upstream/main' into flashinfer-0.7.3-moe-ep
  
  Fridge003
  and
  claude
  committed
  2209653
- Merge branch 'main' into flashinfer-0.7.3-moe-ep
  Fridge003
  authored
  167baf5

Commits

Commits on Nov 4, 2026

Commits on Nov 5, 2026

Commits on Nov 6, 2026