Prompt lookup decoding - #4484

Merged

ggerganov merged 10 commits into

ggml-org:masterfrom

LeonEricsson:prompt-lookup

Dec 22, 2023

Commits on Dec 4, 2023

initial commit, going through initializations
LeonEricsson
committed
cae8f50

Commits on Dec 10, 2023

main loop finished, starting to debug
LeonEricsson
committed
0ec5fdb

Commits on Dec 15, 2023

BUG: generates gibberish/repeating tokens after a while
LeonEricsson
committed
1665ad8
Merge branch 'ggerganov:master' into prompt-lookup
LeonEricsson
authored
3404841

Commits on Dec 16, 2023

Commits on Dec 17, 2023

Added colors to distinguish drafted tokens (--color). Updated README
LeonEricsson
committed
1b26d71
lookup : fix token positions in the draft batch
ggerganov
committed
5b27975
lookup : use n_draft from CLI params
ggerganov
committed
d8ed670

Commits on Dec 22, 2023

lookup : final touches
ggerganov
committed
50ea1ef