Skip to content

[Core/DBO][3/N] Dual-Batch Overlap with speculative decode#24608

Closed
MatthewBonanni wants to merge 1 commit into
vllm-project:mainfrom
MatthewBonanni:dbo_mtp
Closed

[Core/DBO][3/N] Dual-Batch Overlap with speculative decode#24608
MatthewBonanni wants to merge 1 commit into
vllm-project:mainfrom
MatthewBonanni:dbo_mtp

Handle shared experts correctly

7825421
Select commit
Loading
Failed to load commit list.