Skip to content

[Bug][Spec Decode] Fix AR metrics when drafting is skipped - #34757

Open
benchislett wants to merge 4 commits into
vllm-project:mainfrom
CentML:bchislett/send-input-fits-in-drafter-to-scheduler
Open

benchislett wants to merge 4 commits into
vllm-project:mainfrom
CentML:bchislett/send-input-fits-in-drafter-to-scheduler

touchup

4295cd0
Select commit
Loading
Failed to load commit list.