[Perf][DSA]: Cut MTP decode overhead with live-length-bounded replay metadata and a greedy-draft argmax exchange - #46630

[Perf][DSA]: Cut MTP decode overhead with live-length-bounded replay metadata and a greedy-draft argmax exchange#46630

mattteochen wants to merge 3 commits into

sgl-project:mainsgl-project/sglang:mainfrom

mattteochen:dsa-mtp-decode-overheadmattteochen/sglang:dsa-mtp-decode-overheadCopy head branch name to clipboard