[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling#3103
Merged
LiuXiaoxuanPKU merged 73 commits intovllm-project:mainfrom Mar 9, 2024
Merged
Commits
Commits on Feb 24, 2024
- committed
- committed
- committed
Commits on Feb 29, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Mar 4, 2024
- committed
- committed
Commits on Mar 5, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Mar 6, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Mar 9, 2024
- committed
- committed