Skip to content

🚬 Add bounded MTP + N-gram pipelining for latency-limited split inference - #1026

Merged
michaelneale merged 22 commits into
mainfrom
agent/positional-mtp-ngram
Jul 22, 2026
Merged

🚬 Add bounded MTP + N-gram pipelining for latency-limited split inference#1026
michaelneale merged 22 commits into
mainfrom
agent/positional-mtp-ngram

Merge remote-tracking branch 'origin/main' into agent/positional-mtp-…

05dae2a
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar