perf(qwen-flash): 4096-token prefill chunks with an overlapped n-gram gather - #470

perf(qwen-flash): 4096-token prefill chunks with an overlapped n-gram gather#470

francescobozzo merged 7 commits into

gufo-org:maingufo-org/gufo:mainfrom

Nickybuk:pr/a2-ngram-chunkNickybuk/gufo:pr/a2-ngram-chunkCopy head branch name to clipboard