[Speculative decoding] Adding configuration object for speculative decoding#3706
Merged
cadedaniel merged 8 commits intovllm-project:mainfrom Apr 3, 2024
Merged
Commits
Commits on Apr 1, 2024
- committed
Commits on Apr 2, 2024
- committed
- committed
- committed
- committed
- committed
- andauthored
- committed