Oracle improvements

[robertgshaw2-redhat]

Purpose

This PR does two inter-related things:

Oracle

• updates oracle to query the mk experts for support for various features in standard way, enabling auto-selection
• updates the mk experts to express which features are supported
• creates standard interface for creating experts, simplifying the factory function

Unifies Dp/Ep and Tp cases

• add support for running naive and ag/rs dispatch/combine via modular kernels
• allow the QuantMethod to "own" the kernel, no more FusedMoEModularMethod

Follow Ups

• apply to the other quant methods (this only does fp8 and nvfp4)
• remove do_naive_dispatch_combine from fused moe (^once everything above is migrated)

TODOs

• Figure out flashinfer all2all
• Make sure models with shared expert are working properly (including SBO)
• Routing Tables
• Kernels --- Batched Triton
• Kernels --- vLLM CUTLASS FP4
• Kernels --- Batched vLLM CUTLASS
• Split into 2 PRs?

Test Plan

Test Result

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

[mergify]

Documentation preview: https://vllm--32122.org.readthedocs.build/en/32122/

[gemini-code-assist]

Code Review

This pull request introduces a valuable refactoring by adding a set of supports_* methods to the MoE expert kernels. This acts as an 'oracle' for kernel capabilities, which will allow for a more robust and modular kernel selection mechanism. The changes are well-structured and implement the new interface across several kernel files. I've found one critical issue in the implementation that needs to be addressed.

[gemini-code-assist]

current_platform.is_cuda is a method and must be called as current_platform.is_cuda(). Without the call, it will always evaluate to True as a function object is truthy, which could lead to incorrect behavior.

Additionally, this check is redundant because supports_current_device is expected to be called before this method, and it already performs the is_cuda() check. Removing the redundant check simplifies the code.

Suggested change

	if (current_platform.is_cuda and current_platform.is_device_capability(9,0) and quant_config.block_shape[0] == 128 and quant_config.block_shape[1] == 128):
	if current_platform.is_device_capability(9, 0) and quant_config.block_shape[0] == 128 and quant_config.block_shape[1] == 128:

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @robertgshaw2-redhat.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[robertgshaw2-redhat]

replaced by:

• [MoE Refactor] Integrate Naive Prepare Finalize into MK #32567
• [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority #32414