Sm120 130

[pacoxu]

#19757
#32237

Purpose

Test Plan

Test Result

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

[gemini-code-assist]

Code Review

This pull request introduces support for NVIDIA Blackwell (SM120) architecture for Mixture-of-Experts (MoE) kernels. It updates the CUTLASS revision to v4.3.5, adds CMake logic to conditionally compile a new SM120-specific grouped GEMM kernel, and integrates this kernel into the existing dispatch mechanism. The changes appear to be a well-structured extension of the current MoE kernel infrastructure to support newer hardware capabilities.

[mgoin]

Have you tried to see if this works?

[geraldstanje]

do you also need this pr? #31089