Repository navigation
[Deps] Bump FlashInfer to 0.7.1 - #43494
Merged
Merged
Conversation
mmangkad
added
dependencies
mmangkad
requested review from
JustinTong0323,
merrymercy,
mickqian,
ping1jing2 and
slin1237
as code owners
October 10, 2026 04:26
mmangkad
requested review from
AgainstEntropy,
HaiShaw and
yichiche
as code owners
October 10, 2026 04:26
mmangkad
requested review from
BBuf,
Fridge003,
ishandhanani,
kevin-mii,
niehen6174,
sogalin and
yctseng0211
as code owners
October 10, 2026 04:26
github-actions
Bot
added
documentation
mmangkad
added
bypass-fail-fast
mmangkad
added
the
max-concurrency
4 of 5 tasks
Fridge003
approved these changes
Oct 12, 2026
3 of 4 tasks
Liwansi
added a commit
to Liwansi/sglang_vans
that referenced
this pull request
Oct 13, 2026
…n_allgather * 'main' of https://github.com/sgl-project/sglang: (236 commits) [NPU] Stabilize HiCache and registered CI tests (sgl-project#43308) [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (sgl-project#43799) [Docs] Update GLM-5.3-Flash playground: B300 default, CP8, EP and PD (sgl-project#43802) [DSV4.1][PD][1/N] Support prefill node use cp parallel strategy (sgl-project#40323) [BCG][DSV4-Flash][CP] Support DeepSeek V4 prefill with interleave CP and breakable CUDA graphs (sgl-project#38603) [XPU] Support decode context parallelism (DCP) on Intel XPU (sgl-project#34355) Keep NIXL Mamba checkpoint keys separate by TP rank (sgl-project#43594) Capture KV host transfer buffers (sgl-project#43711) [CI] Move tests that do not need GB300 off the per-PR GB300 suite (sgl-project#43784) [HiCache] Preserve all MTP KV and recurrent state (sgl-project#40223) [HiCache] Support Mamba in buffer-only host memory mode (sgl-project#36345) [PD] Poison the deferred abort ack when a Mooncake send fails (sgl-project#43719) [Perf] Route BF16 mixed-batch decode tails through decode attention (sgl-project#43238) [Fix] Link cuda_ipc JIT against CUDA driver stubs dir (sgl-project#43764) docs: clarify prefill CP terminology and simplify wording (sgl-project#43787) [diffusion][xpu] FLUX.2: enable the bit-exact Triton SwiGLU on XPU (sgl-project#41940) [Fix] Adapt to transformers 5.18 / 5.19 changes (sgl-project#43688) [XPU CI] Optimize PR CI per-file timeouts and fail hanging tests fast (sgl-project#42048) [Deps] Bump FlashInfer to 0.7.1 (sgl-project#43494) docs: sync LMSYS SGLang blog cards (sgl-project#43462) ...
Collaborator
|
cc @leejnau |
4 of 5 tasks
1 of 5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
flashinfer_python,flashinfer-cubin, and the optional JIT cache from 0.7.0.post1 to 0.7.1 (release notes)scripts/release/bump_flashinfer_version.pyat the files that actually carry the pin: adddocker/Dockerfile.cu134(bumped by hand last time) and droppython/sglang/srt/utils/common.py, whose versioned docstring example was removed in [Deps] Bump FlashInfer to 0.7.0.post1 #40709 and which made the script fail validationbsa_attn_sm120_blk64_sage_fwdandquantize_sage_qkv_sm120Compatibility
None of the APIs called out in the 0.7.1 upgrade notices are used in sglang (
cute_dsl_fused_moe_bf16,CuteDslBf16MoEWrapper,moe_a2a_dispatch, FlashInfer'sfp8/fp4_paged_mqa_logits, the removed PrimTS decode entry points). The new dependency floors are already met by our pins (nvidia-cutlass-dsl[cu13]==4.8.0,apache-tvm-ffi==0.1.11,cuda-tile==1.6.0rc5);nvidia-cudnn-frontend>=1.30.0resolves transitively to 1.31.0.Validation
bump_flashinfer_version.py 0.7.1updates and validates all 4 pin filesuv pip compile python/pyproject.toml(py3.12, x86_64, cu130 torch index) resolves toflashinfer-python==0.7.1flashinfer-cubin==0.7.1andflashinfer-jit-cache==0.7.1(cu129 and cu130, x86_64 and aarch64) are published on flashinfer.ai/whlflashinfer/cute_dsl/sparse/bsa_attn_sm120.pyandbsa_utils/sage_quant_sm120.pywith the two symbols imported bysubblock_sparse_attn.pyGPU model E2E tests were not run locally; relying on CI.
CI States
Latest PR Test (Base): ✅ Run #38140591080
Latest PR Test (Extra): ✅ Run #38140590993
Latest PR Test (AMD ROCm 10): ❌ Run #38140591114