Skip to content

[MoE] DeepSeek-V4: add Hopper (SM90) FP8 FlashInfer moe_ep mega backend - #58540

Draft
chaunceyjiang wants to merge 1 commit into
vllm-project:mainfrom
chaunceyjiang:feat/dsv4-sm90-fp8-moe-ep-backend
Draft

[MoE] DeepSeek-V4: add Hopper (SM90) FP8 FlashInfer moe_ep mega backend#58540
chaunceyjiang wants to merge 1 commit into
vllm-project:mainfrom
chaunceyjiang:feat/dsv4-sm90-fp8-moe-ep-backend

Conversation

@chaunceyjiang

@chaunceyjiang chaunceyjiang commented Sep 24, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Contributor

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

@mergify mergify Bot added deepseek Related to DeepSeek models DSv4 nvidia labels Sep 24, 2026
@mergify

mergify Bot commented Oct 3, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @chaunceyjiang.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Oct 3, 2026
@qianlihuang qianlihuang mentioned this pull request Oct 20, 2026
Open
6 tasks done
@chaunceyjiang
[MoE] DeepSeek-V4: add Hopper (SM90) FP8 FlashInfer moe_ep mega backend
1f7d177 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
@chaunceyjiang
chaunceyjiang force-pushed the feat/dsv4-sm90-fp8-moe-ep-backend branch from c169319 to 1f7d177 Compare October 20, 2026 07:56
@mergify mergify Bot removed the needs-rebase label Oct 20, 2026
@mergify

mergify Bot commented Oct 22, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @chaunceyjiang.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Oct 22, 2026
@kabishou11 kabishou11 mentioned this pull request Oct 25, 2026
Merged

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@DarkLight1337 DarkLight1337 Awaiting requested review from DarkLight1337 DarkLight1337 will be requested when the pull request is marked ready for review DarkLight1337 is a code owner
@ywang96 ywang96 Awaiting requested review from ywang96 ywang96 will be requested when the pull request is marked ready for review ywang96 is a code owner
@AndreasKaratzas AndreasKaratzas Awaiting requested review from AndreasKaratzas AndreasKaratzas will be requested when the pull request is marked ready for review AndreasKaratzas is a code owner
@bnellnm bnellnm Awaiting requested review from bnellnm bnellnm will be requested when the pull request is marked ready for review bnellnm is a code owner
@WoosukKwon WoosukKwon Awaiting requested review from WoosukKwon WoosukKwon will be requested when the pull request is marked ready for review WoosukKwon is a code owner
@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao will be requested when the pull request is marked ready for review youkaichao is a code owner
@robertgshaw2-redhat robertgshaw2-redhat Awaiting requested review from robertgshaw2-redhat robertgshaw2-redhat will be requested when the pull request is marked ready for review robertgshaw2-redhat is a code owner
@mgoin mgoin Awaiting requested review from mgoin mgoin will be requested when the pull request is marked ready for review mgoin is a code owner
@tlrmchlsmth tlrmchlsmth Awaiting requested review from tlrmchlsmth tlrmchlsmth will be requested when the pull request is marked ready for review tlrmchlsmth is a code owner
@houseroad houseroad Awaiting requested review from houseroad houseroad will be requested when the pull request is marked ready for review houseroad is a code owner
@yewentao256 yewentao256 Awaiting requested review from yewentao256 yewentao256 will be requested when the pull request is marked ready for review yewentao256 is a code owner
@ProExpertProg ProExpertProg Awaiting requested review from ProExpertProg ProExpertProg will be requested when the pull request is marked ready for review ProExpertProg is a code owner
@pavanimajety pavanimajety Awaiting requested review from pavanimajety pavanimajety will be requested when the pull request is marked ready for review pavanimajety is a code owner
@zyongye zyongye Awaiting requested review from zyongye zyongye will be requested when the pull request is marked ready for review zyongye is a code owner
@wzhao18 wzhao18 Awaiting requested review from wzhao18 wzhao18 will be requested when the pull request is marked ready for review wzhao18 is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

deepseek Related to DeepSeek models DSv4 needs-rebase nvidia

Projects

NVIDIA
Status: No status

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@chaunceyjiang