Skip to content

[Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker#5348

Merged
cadedaniel merged 51 commits intovllm-project:mainfrom sroy745:spec_decode_integrate_accpetance_samplerJul 1, 2024

Commits

Commits on May 29, 2024

Commits on Jun 3, 2024

Commits on Jun 7, 2024

Commits on Jun 9, 2024

Commits on Jun 11, 2024

Commits on Jun 26, 2024

Commits on Jun 27, 2024

Commits on Jun 28, 2024

Commits on Jun 29, 2024