feat: SpecPrefill — attention-based sparse prefill for TTFT reduction#180

Merged

waybarrios merged 7 commits into

waybarrios:mainfrom

Thump604:feat/specprefill

Mar 21, 2026

Commits on Mar 17, 2026

feat: MLLM+MTP per-request routing for text and vision
Thump604
committed

Commits on Mar 18, 2026

feat: system prompt KV caching for SimpleEngine MTP text path
Thump604
committed
feat: SpecPrefill — attention-based sparse prefill for TTFT reduction
Thump604
committed
feat: multi-architecture support for SpecPrefill scoring and sparse prefill
Thump604
committed

Commits on Mar 19, 2026