Skip to content

Speculative decoding: Test the target distribution (to prevent issues like #32867)#34553

Merged
ArthurZucker merged 14 commits intohuggingface:mainfrom
keyboardAnt:test-speculative-sampling-distribution
Nov 22, 2024
Merged

Speculative decoding: Test the target distribution (to prevent issues like #32867)#34553
ArthurZucker merged 14 commits intohuggingface:mainfrom
keyboardAnt:test-speculative-sampling-distribution

Commits

Commits on Oct 31, 2024

Commits on Nov 1, 2024

Commits on Nov 5, 2024

Commits on Nov 6, 2024