Skip to content

[Speculative decoding] Adding configuration object for speculative decoding#3706

Merged
cadedaniel merged 8 commits intovllm-project:mainfrom
cadedaniel:spec-decode-llm-engine
Apr 3, 2024
Merged

[Speculative decoding] Adding configuration object for speculative decoding#3706
cadedaniel merged 8 commits intovllm-project:mainfrom
cadedaniel:spec-decode-llm-engine

Commits

Commits on Apr 1, 2024

Commits on Apr 2, 2024