Skip to content

Introduce speculative decoding with draft models to vLLM#3029

Closed
sighingnow wants to merge 3 commits intovllm-project:mainfrom
sighingnow:ht/speculative
Closed

Introduce speculative decoding with draft models to vLLM#3029
sighingnow wants to merge 3 commits intovllm-project:mainfrom
sighingnow:ht/speculative

Commits

Commits on Feb 27, 2024