v0.20.1 Cherry pick PRs#41435

Closed

khluu wants to merge 13 commits intoreleases/v0.20.1from

codex/backport-v0.20.1-milestone-27

Commits on May 1, 2026

Auto-disable expandable_segments around cumem memory pool (#40812)

authored and
khluu
committed
[Model][DSV4] Support base model (#41006)

jeejeelee
authored and
khluu
committed
[DSV4] Enable Multi-stream for Pre-Attn GEMM (#41061)

zyongye
authored and
khluu
committed
[Core] Account for `num_gpu_blocks_override` in `max_model_len` checks (#41069)

njhill
authored and
khluu
committed
[DSV4] Align aux stream API with DeepseekV4DecoderLayer (#41171)

zixi-qi
authored and
khluu
committed
[Bugfix] Fix Deepseek V4 import error due to AOT compile cache loading (#41090)

wzhao18
authored and
khluu
committed
[Bugfix] fix inductor error for dpsk v4 (#41135)

ZJY0516
authored and
khluu
committed
[Bugfix] Fix max_num_batched_token not captured in cuda graph (#40734)

authored and
khluu
committed
[Bugfix] DSV32/V4 add missing type conversion for non-streaming tool calls (#41198)

chaunceyjiang
authored and
khluu
committed
[Bugfix] Fix repeated DSv4 RoPE cache initialization (#41148)

authored and
khluu
committed
[DSv4] Use `cvt` PTX for FP32->FP4 conversion (#41015)

gau-nernst
authored and
khluu
committed
[Bugfix] Fix persistent_topk cooperative deadlock at TopK=1024 (#41189)

authored and
khluu
committed
[DSV4] Add BF16 and MXFP8 A2A support for flashinfer a2a one sided (#40960)

authored and
khluu
committed