Skip to content

Add vLLM grouped gemm backend for MoE inference - #4566

Merged
santhnm2 merged 101 commits into
NVIDIA:mainfrom
santhnm2:vllm-grouped-gemm-cuda-graphable
May 4, 2026
Merged

Add vLLM grouped gemm backend for MoE inference#4566
santhnm2 merged 101 commits into
NVIDIA:mainfrom
santhnm2:vllm-grouped-gemm-cuda-graphable

Commits

Commits on Apr 9, 2026

Commits on Apr 10, 2026

Commits on Apr 13, 2026

Commits on Apr 14, 2026

Commits on Apr 15, 2026

Commits on Apr 16, 2026

Commits on Apr 17, 2026

Commits on Apr 20, 2026

Commits on Apr 22, 2026

Commits on Apr 23, 2026

Commits on Apr 24, 2026

Commits on Apr 27, 2026

Commits on Apr 28, 2026

Commits on Apr 29, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on May 3, 2026

Commits on May 4, 2026