[DSv4 Perf] Skip topk and router when not needed, 3.4% E2E TTFT improvement for Decode case - #49486

[DSv4 Perf] Skip topk and router when not needed, 3.4% E2E TTFT improvement for Decode case#49486

MatthewBonanni merged 1 commit into

mainvllm-project/vllm:mainfrom

wentao-skip-topk-dsv4vllm-project/vllm:wentao-skip-topk-dsv4Copy head branch name to clipboard