Skip to content

[Build] Update deep_gemm git pin to fix ambiguous calls in torch>=2.14 - #61700

Closed
cleonard530 wants to merge 7 commits into
vllm-project:mainfrom
cleonard530:git_tag_for_fix_ambiguous_torch_calls
Closed

cleonard530 wants to merge 7 commits into
vllm-project:mainfrom
cleonard530:git_tag_for_fix_ambiguous_torch_calls

Conversation

@cleonard530

@cleonard530 cleonard530 commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Overview

Update git tag for DeepGEMM.

The updated DeepGEMM (see vllm-project/DeepGEMM#37) fixes build errors due to ambiguous calls in torch >= 2.14 (bitwise_and, bitwise_or, etc.).

Validation

Rebuilt vllm pointing to this commit with torch 2.14.1. It didn't work before the commit and is working now.


Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mergify

mergify Bot commented Oct 14, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @cleonard530.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Oct 14, 2026
@khluu

khluu commented Oct 14, 2026

Copy link
Copy Markdown
Member

can we use vllm-project/DeepGEMM instead of personal fork? are you able to push to a branch on vllm-project/DeepGEMM?

@cleonard530

cleonard530 commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor Author

@khluu, yes that's the plan. Once someone merges the PR vllm-project/DeepGEMM#37 then we can update this PR to point to that new commit.

@Harry-Chen Harry-Chen changed the title [Do not Merge!] Update deep_gemm git pin to fix ambiguous calls in torch>=2.14 [Build] Update deep_gemm git pin to fix ambiguous calls in torch>=2.14 Oct 15, 2026
@mergify mergify Bot removed the needs-rebase label Oct 15, 2026
@Harry-Chen Harry-Chen added the ready ONLY add when PR is ready to merge/full CI is needed label Oct 15, 2026
@github-actions

Copy link
Copy Markdown

✅ @cleonard530, CI is now available for this PR.

  • /ci run starts upstream CI; /amd-ci run starts AMD CI only.
  • Run commands test your branch with every commit currently on its upstream target branch. If it is behind, the bot merges the target branch into it first (pull before pushing again). Append --allow-stale to a run command to test an outdated branch as is, at your own risk.
  • /ci retry retries failed jobs in the CI build for the current PR head. If the current head has no CI build, it starts a new CI build for the current head containing only jobs that failed in the latest earlier CI build for this PR.
  • /amd-ci retry retries failed jobs in AMD CI for the current PR head. Use /amd-ci run when the current head has no AMD CI build.
  • /ci cancel cancels scheduled or running CI builds for this PR branch; /amd-ci cancel does the same for AMD CI only.

@Harry-Chen

Copy link
Copy Markdown
Member

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #95072 for commit f088c5174336.

@Harry-Chen

Copy link
Copy Markdown
Member

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #95077 for commit 09b33130793e.

Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Chris Leonard <chleonar@redhat.com>
@cleonard530
cleonard530 force-pushed the git_tag_for_fix_ambiguous_torch_calls branch from 09b3313 to 0636e0a Compare October 15, 2026 10:55
@cleonard530
cleonard530 requested a review from khluu as a code owner October 15, 2026 10:55
@cleonard530

Copy link
Copy Markdown
Contributor Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #95110 for commit bae9c93195fa.

ℹ️ This PR is 1 commit behind upstream main. Merged upstream main into this branch as bae9c93195fa before starting CI. Pull the branch before pushing more changes.

Signed-off-by: Chris Leonard <chleonar@redhat.com>
@cleonard530

Copy link
Copy Markdown
Contributor Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #95112 for commit 9dd53457fe4e.

Comment thread tools/install_deepgemm.sh

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please don't update this as the file is unused and we're going to remove it - see #61265 where I've already had to resolve a... surprising number of merge conflicts due to bumps and reverts of deepgemm

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tlrmchlsmth, sorry about the reverts of deepgemm. If I remove the install_deepgemm.sh file from this PR, will it be fine to merge (assuming the CI passes again)?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, I could just combine your PR with this one if that works for you?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

both are OK by me

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Aright, I just reverted the install_deepgemm.sh updates here. I didn't include your other updates.

@cleonard530

Copy link
Copy Markdown
Contributor Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #95202 for commit 0ab4ea25bd6b.

ℹ️ This PR is 1 commit behind upstream main. Merged upstream main into this branch as 0ab4ea25bd6b before starting CI. Pull the branch before pushing more changes.

@mergify

mergify Bot commented Oct 16, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @cleonard530.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Oct 16, 2026
@cleonard530

Copy link
Copy Markdown
Contributor Author

This PR already updated the git tag so it doesn't look like this is needed anymore https://github.com/vllm-project/vllm/pull/61744/changes.

@tlrmchlsmth, looks like they updated install_deepgemm.sh file too, so you might be getting another merge conflict. Sorry about that, but hopefully this is the last time.

@Harry-Chen

Copy link
Copy Markdown
Member

Superceded by #61744

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/build needs-rebase ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants