feat: probabilistic MTP acceptance (speculative sampling)#1085

Closed

Thump604 wants to merge 21 commits intoml-explore:mainfrom

Thump604:feat/probabilistic-mtp

Commits on Mar 17, 2026

Commits on Mar 22, 2026

Commits on Mar 23, 2026

Add constraint tests for LRU cache extraction and checkpoint semantics

lyonsno
and
claude
committed
Skip checkpoint insertion for non-thinking models

lyonsno
and
claude
committed
fix: handle 1D logits in mtp_generate_step logits processors
Thump604
committed

Commits on Mar 24, 2026

Restore checkpoint creation for non-thinking models

lyonsno
and
claude
committed

Commits on Apr 1, 2026

feat: probabilistic MTP acceptance (speculative sampling)
Thump604
committed