Skip to content

support qwen 3.8 flash next - #37500

Merged
Qiaolin-Yu merged 47 commits into
mainfrom
qwen4-main-squashed-rebased
Sep 8, 2026
Merged

support qwen 3.8 flash next#37500
Qiaolin-Yu merged 47 commits into
mainfrom
qwen4-main-squashed-rebased

Conversation

@Qiaolin-Yu

@Qiaolin-Yu Qiaolin-Yu commented Sep 2, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Collaborator

initial pr: #36497

CI States

Latest PR Test (Base): ✅ Run #34195586068
Latest PR Test (Extra): ✅ Run #34273666129
Latest PR Test (AMD ROCm 7.2): ❌ Run #34195586146

Qiaolin-Yu and others added 7 commits September 2, 2026 00:11
@Qiaolin-Yu @ch-wan
@ispobock @JustinTong0323 @samuellees @YAMY1234 @yhyang201 @yizhang2077 @zijiexia
Introduce Qwen 3.8 Flash Next
19ece24 
Co-authored-by: Qiaolin-Yu <90088090+Qiaolin-Yu@users.noreply.github.com>
Co-authored-by: ch-wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ispobock <26454835+ispobock@users.noreply.github.com>
Co-authored-by: JustinTong0323 <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: samuellees <26428561+samuellees@users.noreply.github.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yizhang2077 <25844240+yizhang2077@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
@cshintov @Qiaolin-Yu
fix(qsa): enable trtllm-gen sparse decode on sm_121 (GB10 / DGX Spark) (
d77f198 
#36649)
@huangzhilin-hzl @Qiaolin-Yu
fix(qwen4): accept qwen_sparse_attention layer type alias (#36772)
dc13576
@cshintov @Qiaolin-Yu
chore: make qwen4-main-squashed pre-commit clean (#36667)
bd61867
@BBuf @cshintov @Qiaolin-Yu
fix(qsa): route exact SM120 to FlashInfer sparse decode (#36806)
d6c8709 
Co-authored-by: Shinto C V <cshintov@gmail.com>
@BBuf @Qiaolin-Yu
fix(qsa): restore SM121 correctness with Humanize and Kernel Design A…
4c63cb5 
…gent (#36845)
@Qiaolin-Yu
upd
52feb60
@Qiaolin-Yu Qiaolin-Yu changed the title support qwen next support qwen 3.8 flash next Sep 8, 2026
@Qiaolin-Yu

Qiaolin-Yu commented Sep 8, 2026

Copy link
Copy Markdown
Collaborator Author

offline discussed with @YAMY1234 , we think this is good enough to merge. https://github.com/sgl-project/sglang/actions/runs/34195585918 failed ci is unrelated

@Qiaolin-Yu
Qiaolin-Yu merged commit 52fecfd into main Sep 8, 2026
415 of 456 checks passed
@Qiaolin-Yu
Qiaolin-Yu deleted the qwen4-main-squashed-rebased branch September 8, 2026 20:56
@Qiaolin-Yu Qiaolin-Yu mentioned this pull request Sep 8, 2026
Closed
5 tasks
This was referenced Sep 8, 2026
Closed
Closed
Closed
This was referenced Sep 9, 2026
Merged
Open
cursor Bot pushed a commit that referenced this pull request Sep 9, 2026
@cursoragent @michaelzhang-ai
Merge origin/main into cursor/upstream-qwen38-flash-next-rocm-image-f…
dc5ff6d 
…e21 (includes #37500 Qwen3.8-Flash-Next model support)

Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
cursor Bot pushed a commit that referenced this pull request Sep 9, 2026
@cursoragent @michaelzhang-ai
[AMD] Arm Qwen3.8-Flash-Next nightly now that #37500 landed
31de631 
Drop the Qwen4ExpConfig skip guard. Model support is on main, so the
GSM8K nightly should run rather than skip.

Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
@cursor cursor Bot mentioned this pull request Sep 9, 2026
Open
5 tasks
This was referenced Sep 9, 2026
Open
Open
@curnane-lab curnane-lab mentioned this pull request Sep 9, 2026
Open
5 tasks
@JUNQINGV587 JUNQINGV587 mentioned this pull request Sep 9, 2026
Closed
@200lz 200lz mentioned this pull request Sep 10, 2026
Open
This was referenced Sep 10, 2026
Closed
Closed
@bingxche bingxche mentioned this pull request Sep 10, 2026
Open
joev-harmonic pushed a commit to joev-harmonic/sglang that referenced this pull request Sep 11, 2026
@Qiaolin-Yu @ch-wan
@ispobock @JustinTong0323 @samuellees @YAMY1234 @yhyang201 @yizhang2077 @zijiexia @cshintov @huangzhilin-hzl @BBuf @joev-harmonic
support qwen 3.8 flash next (sgl-project#37500)
b62c5e8 
Co-authored-by: ch-wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ispobock <26454835+ispobock@users.noreply.github.com>
Co-authored-by: JustinTong0323 <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: samuellees <26428561+samuellees@users.noreply.github.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yizhang2077 <25844240+yizhang2077@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Shinto C V <cshintov@gmail.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@antgroup.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
@andyluo7 andyluo7 mentioned this pull request Sep 12, 2026
Open
6 tasks
This was referenced Sep 14, 2026
Open
Open
@fishAndShrimp fishAndShrimp mentioned this pull request Sep 14, 2026
Draft
7 tasks
@detain detain mentioned this pull request Sep 14, 2026
Draft
5 tasks
mqhc2020 pushed a commit to mqhc2020/sglang that referenced this pull request Sep 15, 2026
@Qiaolin-Yu @ch-wan
@ispobock @JustinTong0323 @samuellees @YAMY1234 @yhyang201 @yizhang2077 @zijiexia @cshintov @huangzhilin-hzl @BBuf @mqhc2020
support qwen 3.8 flash next (sgl-project#37500)
9b4f75a 
Co-authored-by: ch-wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ispobock <26454835+ispobock@users.noreply.github.com>
Co-authored-by: JustinTong0323 <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: samuellees <26428561+samuellees@users.noreply.github.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yizhang2077 <25844240+yizhang2077@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Shinto C V <cshintov@gmail.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@antgroup.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
This was referenced Sep 15, 2026
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JustinTong0323 JustinTong0323 Awaiting requested review from JustinTong0323 JustinTong0323 is a code owner
@Ying1123 Ying1123 Awaiting requested review from Ying1123 Ying1123 is a code owner
@merrymercy merrymercy Awaiting requested review from merrymercy merrymercy is a code owner
@hnyls2002 hnyls2002 Awaiting requested review from hnyls2002 hnyls2002 is a code owner
@mickqian mickqian Awaiting requested review from mickqian mickqian is a code owner
@yhyang201 yhyang201 Awaiting requested review from yhyang201 yhyang201 is a code owner
@yuan-luo yuan-luo Awaiting requested review from yuan-luo yuan-luo is a code owner
@HaiShaw HaiShaw Awaiting requested review from HaiShaw HaiShaw is a code owner
@yctseng0211 yctseng0211 Awaiting requested review from yctseng0211 yctseng0211 is a code owner
@Fridge003 Fridge003 Awaiting requested review from Fridge003 Fridge003 is a code owner
@ispobock ispobock Awaiting requested review from ispobock ispobock is a code owner
@alphabetc1 alphabetc1 Awaiting requested review from alphabetc1 alphabetc1 is a code owner
@xiezhq-hermann xiezhq-hermann Awaiting requested review from xiezhq-hermann xiezhq-hermann is a code owner
@hanming-lu hanming-lu Awaiting requested review from hanming-lu hanming-lu is a code owner
@yizhang2077 yizhang2077 Awaiting requested review from yizhang2077 yizhang2077 is a code owner
@hzh0425 hzh0425 Awaiting requested review from hzh0425 hzh0425 is a code owner
@huangtingwei9988 huangtingwei9988 Awaiting requested review from huangtingwei9988 huangtingwei9988 is a code owner
@ch-wan ch-wan Awaiting requested review from ch-wan ch-wan is a code owner
@BBuf BBuf Awaiting requested review from BBuf BBuf is a code owner
@Edwardf0t1 Edwardf0t1 Awaiting requested review from Edwardf0t1 Edwardf0t1 is a code owner
@FlamingoPg FlamingoPg Awaiting requested review from FlamingoPg FlamingoPg is a code owner
@AniZpZ AniZpZ Awaiting requested review from AniZpZ AniZpZ is a code owner
@b8zhong b8zhong Awaiting requested review from b8zhong b8zhong is a code owner
@OrangeRedeng OrangeRedeng Awaiting requested review from OrangeRedeng OrangeRedeng is a code owner
@Alisehen Alisehen Awaiting requested review from Alisehen Alisehen is a code owner
@mmangkad mmangkad Awaiting requested review from mmangkad mmangkad is a code owner
@hebiao064 hebiao064 Awaiting requested review from hebiao064 hebiao064 is a code owner
@ByronHsu ByronHsu Awaiting requested review from ByronHsu ByronHsu is a code owner
@ShangmingCai ShangmingCai Awaiting requested review from ShangmingCai ShangmingCai is a code owner
@Duyi-Wang Duyi-Wang Awaiting requested review from Duyi-Wang Duyi-Wang is a code owner
@sogalin sogalin Awaiting requested review from sogalin sogalin is a code owner
@DarkSharpness DarkSharpness Awaiting requested review from DarkSharpness DarkSharpness is a code owner
@celve celve Awaiting requested review from celve celve is a code owner
@HydraQYH HydraQYH Awaiting requested review from HydraQYH HydraQYH is a code owner

Assignees

No one assigned

Labels

bypass-fastfail documentation Improvements or additions to documentation high priority jit-kernel memory-pool quant LLM Quantization release-highlight Candidate PR for release note highlight run-ci run-ci-extra speculative-decoding unified-radix-cache

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@Qiaolin-Yu @huxiang088 @cshintov @huangzhilin-hzl @BBuf @yhyang201