[Enhancement] Introduce High-Performance MoT (Mixture-of-Tokens) Kernels: Triton Implementation & A100 Tuning#1328

Closed

yzhu802 wants to merge 7 commits into

vllm-project:mainfrom

yzhu802:enhancement/mot_fused_kernels

Commits on Apr 19, 2026

enhancement: add mot fused kernels and benchmarks 01
Yufeng Zhu
committed
Add pytest markers for core model and diffusion tests

princepride
authored and
Yufeng Zhu
committed
Add pytest markers for core model and diffusion tests

princepride
authored and
Yufeng Zhu
committed
[Enhancement] Fix SP path for MoT fused kernels, address review feedback

authored and
Yufeng Zhu
committed
Address review comments (benchmark logs, ids, and design comments)
Yufeng Zhu
committed
Relax pixel tolerance to 15 to account for Triton kernel numerical drift
Yufeng Zhu
committed

Commits on Apr 21, 2026

Merge branch 'main' into enhancement/mot_fused_kernels
lishunyang12
authored