Skip to content

Multinode_aot_prebuild_all#1501

Merged
valarLip merged 2 commits intomainfrom
multinode_aot_prebuild_all
Nov 28, 2025
Merged

Multinode_aot_prebuild_all#1501
valarLip merged 2 commits intomainfrom
multinode_aot_prebuild_all

Conversation

@zufayu
Copy link
Contributor

@zufayu zufayu commented Nov 28, 2025

Motivation

add more PREBUILD_KERNELS option for prebuild kernel so

Technical Details

PREBUILD_KERNELS == 1/2/3

ex:
PREBUILD_KERNELS=1 GPU_ARCHS="gfx942;gfx950" python3 setup.py install

Test Plan

308/355

Test Result

Submission Checklist

Copilot AI review requested due to automatic review settings November 28, 2025 02:41
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds support for PREBUILD_KERNELS modes 2 and 3 to provide more granular control over which kernels are prebuilt during installation. The change allows users to specify different levels of kernel prebuilding by setting the PREBUILD_KERNELS environment variable to 1, 2, or 3, with each mode excluding different sets of operations.

  • Introduces two new prebuild modes (2 and 3) with different kernel exclusion patterns
  • Mode 2 excludes backward operations and batch prefill while building forward operations
  • Mode 3 appears to build all kernels (all operations commented out in exclusion list)

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

@valarLip valarLip merged commit 5129567 into main Nov 28, 2025
30 of 32 checks passed
@valarLip valarLip deleted the multinode_aot_prebuild_all branch November 28, 2025 09:39
farlukas pushed a commit that referenced this pull request Dec 4, 2025
* add fmha to prebuild

* More PREBUILD_KERNELS Option

---------

Co-authored-by: zufayu <zufayu@amd.com>
nsusanto pushed a commit that referenced this pull request Dec 4, 2025
* add fmha to prebuild

* More PREBUILD_KERNELS Option

---------

Co-authored-by: zufayu <zufayu@amd.com>
zhuyuhua-v pushed a commit that referenced this pull request Dec 17, 2025
* add fmha to prebuild

* More PREBUILD_KERNELS Option

---------

Co-authored-by: zufayu <zufayu@amd.com>
valarLip pushed a commit that referenced this pull request Mar 18, 2026
* add fmha to prebuild

* More PREBUILD_KERNELS Option

---------

Co-authored-by: zufayu <zufayu@amd.com>
valarLip pushed a commit that referenced this pull request Mar 18, 2026
* add fmha to prebuild

* More PREBUILD_KERNELS Option

---------

Co-authored-by: zufayu <zufayu@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants