[MoE Refactor] Create MK for TRTLLM Kernels#32564

Merged

simon-mo merged 229 commits intovllm-project:mainfrom

robertgshaw2-redhat:monolithic-mk

Mar 3, 2026

Commits on Jan 19, 2026

imports
Robert Shaw
committed
updated
Robert Shaw
committed
stash changes for remote review
Robert Shaw
committed
stash
Robert Shaw
committed
we have startup, but incorrect answers
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
working again, had incorrect copy
Robert Shaw
committed
remove loc
Robert Shaw
committed
make trtllm use the inplace buffer
Robert Shaw
committed
remove debug loc
Robert Shaw
committed
fix precommits
Robert Shaw
committed
fix precommits
Robert Shaw
committed
fix precommits
Robert Shaw
committed
updates
Robert Shaw
committed
add interfaces
Robert Shaw
committed
nits
Robert Shaw
committed
update comments
Robert Shaw
committed
remove debug logging
Robert Shaw
committed
apply to compressed-tensors
Robert Shaw
committed
updated
Robert Shaw
committed
remove the trtllm entrypoints
Robert Shaw
committed
remove typing
Robert Shaw
committed
rename and move to a separate file
Robert Shaw
committed
rename to fp8 moe
Robert Shaw
committed
pre-commit
Robert Shaw
committed
add back missing file
Robert Shaw
committed
add back missing file
Robert Shaw
committed
able to launch with fp8
Robert Shaw
committed
remove the custom op for fp8 block
Robert Shaw
committed
scaffolding of per-tensor kernel
Robert Shaw
committed
basic poc with llama scout modelopt
Robert Shaw
committed
fix import
Robert Shaw
committed
messing around with typrs
Robert Shaw
committed
remove stray namings
Robert Shaw
committed

Commits on Jan 25, 2026

merge main
Robert Shaw
committed

Commits on Jan 26, 2026

stash
Robert Shaw
committed
nitA
Robert Shaw
committed
pre-commit
Robert Shaw
committed
fix typing
Robert Shaw
committed
remove FI TRTLLM specific logic from fp8 oracle
Robert Shaw
committed
remove FI TRTLLM specific logic from nvfp4 oracle
Robert Shaw
committed
add trtllm to backend_to_kernel_cls
Robert Shaw
committed
things are working with blockfp8
Robert Shaw
committed
remove torch op
Robert Shaw
committed
remove torch op
Robert Shaw
committed
remove
Robert Shaw
committed
updated
Robert Shaw
committed
Merge remote-tracking branch 'origin/main' into monolithic-mk
Robert Shaw
committed
updated interface
Robert Shaw
committed
updated interface
Robert Shaw
committed
updated interface
Robert Shaw
committed
update comment
Robert Shaw
committed
add skip swizzle
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
convert deepep ht to use the scheme
Robert Shaw
committed
convert some kernels to use _quantize_input
Robert Shaw
committed
edit comment
Robert Shaw
committed
update how we pass around router data for monolithic case
Robert Shaw
committed
remove special case quant config
Robert Shaw
committed
remove flashinfer special case for fp8 config
Robert Shaw
committed
updated docstring
Robert Shaw
committed
updated docstring
Robert Shaw
committed
remove stray function
Robert Shaw
committed

Commits on Jan 27, 2026

do the merge
Robert Shaw
committed
do the merge
Robert Shaw
committed
remove old info
Robert Shaw
committed
remove the nvfp4 dp/ep hack for trtllm
Robert Shaw
committed
apply new signature to nvfp4 case
Robert Shaw
committed
make MNNVL work with TRTLLM
Robert Shaw
committed
revert FI cutlass quant config changes
Robert Shaw
committed
tests nit
Robert Shaw
committed
tests nit
Robert Shaw
committed
tests nit
Robert Shaw
committed
make the monolithic kernels work with naive P/F
Robert Shaw
committed
update guards for monolithic mk
Robert Shaw
committed
revert quantize input
Robert Shaw
committed
reduce LOC changed
Robert Shaw
committed
reduce LOC changed
Robert Shaw
committed
reduce LOC changed
Robert Shaw
committed
fix pre-ciommits
Robert Shaw
committed
qwen nvfp4 working across all cases
Robert Shaw
committed
fix deepep high throughput with nvfp4
Robert Shaw
committed
updated
Robert Shaw
committed
Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored
reorder some stuff
Robert Shaw
committed
Remove debug cruft
Robert Shaw
committed

Commits on Jan 29, 2026

updated typing
Robert Shaw
committed

Commits on Jan 30, 2026

stash
Robert Shaw
committed
update naming
Robert Shaw
committed
update naming
Robert Shaw
committed
update str
Robert Shaw
committed
stash changes
Robert Shaw
committed

Commits on Jan 31, 2026

updated class heirarchy
Robert Shaw
committed
update class heirarchy
Robert Shaw
committed
seems to be working properly
Robert Shaw
committed
change the type names
Robert Shaw
committed
nits
Robert Shaw
committed
improve tping
Robert Shaw
committed
updated comments
Robert Shaw
committed
update names
Robert Shaw
committed

Commits on Feb 2, 2026

merge main
Robert Shaw
committed
add bf16 config back
Robert Shaw
committed
fix test_flashinfer
Robert Shaw
committed
fix tests
Robert Shaw
committed
fix naive ep
Robert Shaw
committed
fix import
Robert Shaw
committed
fix up typing
Robert Shaw
committed
fix up naive EP issue
Robert Shaw
committed
remove non-tuping
Robert Shaw
committed

Commits on Feb 16, 2026

pre-commit on merge
Robert Shaw
committed
updated moe_mk -> moe_kernel
Robert Shaw
committed
fix moe activation pre-commit
Robert Shaw
committed
clean up
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
convert to composition over inheritance
Robert Shaw
committed
revert inplace changes
Robert Shaw
committed
revert inplace changes
Robert Shaw
committed
remove forward
Robert Shaw
committed
remove forward
Robert Shaw
committed
updated
Robert Shaw
committed
revert comment
Robert Shaw
committed
remove the flashinfer prepare_dp_all_gather
Robert Shaw
committed
update to FusedMoEKernel
Robert Shaw
committed
remove select_gemm_impl
Robert Shaw
committed
stash
Robert Shaw
committed
fix bad tping
Robert Shaw
committed
update import pathways
Robert Shaw
committed
revert relative import
Robert Shaw
committed
move flashinfer monolithic kernels to experts folder
Robert Shaw
committed
reduce length of names
Robert Shaw
committed
remove commebnts
Robert Shaw
committed
missed hitting save
Robert Shaw
committed
add back missing files
Robert Shaw
committed
update to remove making a NoDPEPModular
Robert Shaw
committed
convert to using maybe_make_prepare_finalize in the tests
Robert Shaw
committed
convert to using maybe_make_prepare_finalize in the tests
Robert Shaw
committed
convert to using maybe_make_prepare_finalize in the tests
Robert Shaw
committed
making tests pass
Robert Shaw
committed
making tests pass
Robert Shaw
committed

Commits on Feb 17, 2026

plumb the activation type through
Robert Shaw
committed
stash
Robert Shaw
committed
fix .apply call
Robert Shaw
committed
clean up
Robert Shaw
committed
clean up
Robert Shaw
committed
stash
Robert Shaw
committed
updated
Robert Shaw
committed
clean up test flashinfer moe
Robert Shaw
committed
fix test batched deepgemm
Robert Shaw
committed
fix test batched_moe
Robert Shaw
committed
fix test batched_moe
Robert Shaw
committed
fix test batched_moe
Robert Shaw
committed
fix test cutlass moe
Robert Shaw
committed
merge main
Robert Shaw
committed
making progress on fixing kernel tests
Robert Shaw
committed
make deepgemm pass
Robert Shaw
committed
fix test marlin vs trtllm
Robert Shaw
committed
fix up more tests
Robert Shaw
committed
fix mixtral
Robert Shaw
committed
trying to fix pplx texts
Robert Shaw
committed
fix as many tests as possible
Robert Shaw
committed
Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored
fix pre-commit
Robert Shaw
committed
Merge branch 'monolithic-mk' of https://github.com/robertgshaw2-redhat/vllm into monolithic-mk
Robert Shaw
committed
fix xpuexperts typing
Robert Shaw
committed
fix workspacde shapes typing
Robert Shaw
committed
fix blockfp8
Robert Shaw
committed
updated to hopefully fix modular kernel combinations test
Robert Shaw
committed
hopefully fix mk
Robert Shaw
committed
add nemotron to blackwell moe test
Robert Shaw
committed
add hopper moe tests
Robert Shaw
committed
skip fp8 nemotron
Robert Shaw
committed
updated
Robert Shaw
committed
assert in trtllm nvfp4
Robert Shaw
committed
remove .impl
Robert Shaw
committed

Commits on Feb 18, 2026

Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored

Commits on Feb 20, 2026

enforce trtllm kernel is multiple of 512
Robert Shaw
committed

Commits on Feb 22, 2026

fix routed scaling factor
Robert Shaw
committed
merge main
Robert Shaw
committed

Commits on Feb 23, 2026

fix assertion about routing method type
Robert Shaw
committed
fix use monolithic
Robert Shaw
committed
Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored
potentially fix flashinfer nvfp4
Robert Shaw
committed
fix nemotron nvfp4
Robert Shaw
committed
stash
Robert Shaw
committed
revert
Robert Shaw
committed
fix typo for flashinfer latency _supports_shape
Robert Shaw
committed
fix fp8 oracle
Robert Shaw
committed
fix fp8 trtllm for nemotron
Robert Shaw
committed
update is_monolithic resolution time
robertgshaw2-redhat
committed

Commits on Feb 24, 2026

Commits on Mar 1, 2026

use global state to get around flashinfer autotuning
Robert Shaw
committed
updated
Robert Shaw
committed
merge main
Robert Shaw
committed
fix nits
Robert Shaw
committed
updated
Robert Shaw
committed
fix hopper moe
Robert Shaw
committed
fix hopper test issue
Robert Shaw
committed
tweak
Robert Shaw
committed
remove hopper tests
Robert Shaw
committed
fix blackwell tests
Robert Shaw
committed
Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored
remove spurious
Robert Shaw
committed

Commits on Mar 2, 2026

fix flashinfer import
Robert Shaw
committed
remove spurious test
Robert Shaw
committed
fix the shuffle_weights
Robert Shaw
committed
remove llama 4 scout
Robert Shaw
committed
Merge remote-tracking branch 'origin/main' into monolithic-mk
Robert Shaw
committed

Commits on Mar 3, 2026

Merge branch 'main' into monolithic-mk
robertgshaw2-redhat
authored