Repository navigation

[Kernel][Ovis-Image] Fuse text/image QK RMSNorm + cat + RoPE into one Triton launch - #7600

Open

yuweih205 wants to merge 7 commits into

vllm-project:mainfrom

yuweih205:perf/ovis-image-fused-qk-norm-rope

Open

[Kernel][Ovis-Image] Fuse text/image QK RMSNorm + cat + RoPE into one Triton launch#7600
yuweih205 wants to merge 7 commits into
vllm-project:mainfrom
yuweih205:perf/ovis-image-fused-qk-norm-rope

Commits on Oct 8, 2026
- [Kernel] Extend shared QK/RoPE ops for joint model paths
  yuweih205
  committed
  bf9acac
- [Kernel] Preserve 64-bit offsets in fused QK/RoPE kernels
  yuweih205
  committed
  24f9e25
- [Kernel][Ovis-Image] Fuse text/image QK RMSNorm, cat and RoPE
  yuweih205
  committed
  26a3eac
- docs: list Z-Image fused QK RoPE token gate default
  yuweih205
  committed
  aba7d60
Commits on Oct 13, 2026
- [Kernel] Select fused QK/RoPE paths automatically
  yuweih205
  committed
  e68c756
Commits on Oct 16, 2026
- [Kernel][Ovis-Image] Reproduce the CUDA RMSNorm reduction in the fused Q/K path
  yuweih205
  committed
  1b6004a
Commits on Oct 19, 2026
- [Kernel] Use eight heads per program in the interleaved fused Q/K kernels
  yuweih205
  committed
  ec00bef