Oracle improvements#32122

Closed

robertgshaw2-redhat wants to merge 118 commits intovllm-project:mainfrom

robertgshaw2-redhat:oracle-improvements

Commits on Jan 8, 2026

stash
Robert Shaw
committed
stash
Robert Shaw
committed
update interface
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
first correctness!
Robert Shaw
committed
updated
Robert Shaw
committed
comments
Robert Shaw
committed
updated
Robert Shaw
committed
Merge branch 'main' into naive-dispatch-combine
robertgshaw2-redhat
authored
updateds
Robert Shaw
committed
nit changes
Robert Shaw
committed
support apply router weight on input
Robert Shaw
committed
attempt to get everything working for llama scout modelopt flashinfer cutlass
Robert Shaw
committed
updated
Robert Shaw
committed

Commits on Jan 10, 2026

apply to batched deep gemm
Robert Shaw
committed

Commits on Jan 11, 2026

updated
Robert Shaw
committed
stash
Robert Shaw
committed
remove NaiveBatchedExperts
Robert Shaw
committed
stash
Robert Shaw
committed
stash
Robert Shaw
committed
added back moe torch iterative
Robert Shaw
committed
revert changes
Robert Shaw
committed
re add
Robert Shaw
committed
add back iterative
Robert Shaw
committed
add methodology to kernels
Robert Shaw
committed

Commits on Jan 12, 2026

restructure kernel selection logic
Robert Shaw
committed
remove is_cuda
Robert Shaw
committed
added renamed file
Robert Shaw
committed
improve quant scheme
Robert Shaw
committed
improve validation
Robert Shaw
committed
improve platform selection logic
Robert Shaw
committed
nit newline
Robert Shaw
committed
nit newline
Robert Shaw
committed
revert spurious LOC change
Robert Shaw
committed
revert spurious LOC change
Robert Shaw
committed
updated
Robert Shaw
committed
update marlin
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
support differentiating on static vs dynamic
Robert Shaw
committed
newline nit
Robert Shaw
committed
update logic for aiter foudn
Robert Shaw
committed
cleanup support logic
Robert Shaw
committed
update logic for trtllm config
Robert Shaw
committed
updated
Robert Shaw
committed

Commits on Jan 13, 2026

more progress
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
Merge branch 'main' into naive-dispatch-combine
robertgshaw2-redhat
authored
merged
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
update kernel selection logic
Robert Shaw
committed
seem to have accuracy with dp/ep and tp for deepgemm
Robert Shaw
committed
updated
Robert Shaw
committed
re-add
Robert Shaw
committed
added back naive batched experts
Robert Shaw
committed
added back naive batched experts
Robert Shaw
committed
added back naive batched experts
Robert Shaw
committed
added back naive batched experts
Robert Shaw
committed
reduce LOC change
Robert Shaw
committed
reduce LOC change
Robert Shaw
committed
reduce LOC change
Robert Shaw
committed
reduce loc change
Robert Shaw
committed
reduce LOC change
Robert Shaw
committed

Commits on Jan 14, 2026

fix native ag/rs
Robert Shaw
committed
oracle is now working properly
Robert Shaw
committed
confirmed aiter env variables work as expected
Robert Shaw
committed
fix up oracle
Robert Shaw
committed
trying to make ct work
Robert Shaw
committed
Merge remote-tracking branch 'origin/main' into oracle-improvements
Robert Shaw
committed
made llama 4 work via compressed tensors
Robert Shaw
committed
initial attempt at modelopt
Robert Shaw
committed
attempt to fix naive multicast
Robert Shaw
committed
flashinfer appears to be working
Robert Shaw
committed
Merge remote-tracking branch 'origin/main' into oracle-improvements
Robert Shaw
committed
stash changes for review
Robert Shaw
committed
made modelopt start up
Robert Shaw
committed
still enable flashinfer
Robert Shaw
committed
remove comments
Robert Shaw
committed
appears that we have AG/RS working for nvfp4
Robert Shaw
committed
updated
Robert Shaw
committed
updated
Robert Shaw
committed
updared comment
Robert Shaw
committed
make marling work with current device
Robert Shaw
committed
added compressed tensors nvfp4
Robert Shaw
committed
added compressed tensors nvfp4 - nit
Robert Shaw
committed
remove shared expert overlap functionality
Robert Shaw
committed
make cutedsl work
Robert Shaw
committed
hook up marlin experts properly
Robert Shaw
committed
hook up marlin experts properly
Robert Shaw
committed
make marlin work with AG/RS
Robert Shaw
committed
convert to using quant key
Robert Shaw
committed
convert to using quant key
Robert Shaw
committed
reject usage for things that have not migrated over yet
Robert Shaw
committed
reject usage for things that have not migrated over yet
Robert Shaw
committed
reject usage for things that have not migrated over yet
Robert Shaw
committed
reject usage for things that have not migrated over yet
Robert Shaw
committed
differentiate static vs dynamic quantization
Robert Shaw
committed
remove newline
Robert Shaw
committed
fix static vs dynamic
Robert Shaw
committed
get things working again
Robert Shaw
committed

Commits on Jan 15, 2026

updated
Robert Shaw
committed
updatred
Robert Shaw
committed
attempt to get sp working
Robert Shaw
committed
nit
Robert Shaw
committed
appears to be working properly
Robert Shaw
committed
fix pre commit
Robert Shaw
committed
updated
Robert Shaw
committed
remove flashinfer constructors
Robert Shaw
committed
nits
Robert Shaw
committed
remove do naive dispach combine comment
Robert Shaw
committed
update backend names
Robert Shaw
committed
update fallback experts
Robert Shaw
committed