Skip to content

[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test - #52565

Merged
AndreasKaratzas merged 2 commits into
mainfrom
akaratza_colpali_attn_backend
Aug 17, 2026
Merged

AndreasKaratzas merged 2 commits into
mainfrom
akaratza_colpali_attn_backend

Conversation

@AndreasKaratzas

@AndreasKaratzas AndreasKaratzas commented Aug 17, 2026

Copy link
Copy Markdown
Member

PR #52050 added a CUDA-specific forced FLASH_ATTN configuration to a cross-platform ColPali test, which then failed on both MI300 and MI355 because ROCm intentionally does not report a FlashAttention version. This keeps the intended CUDA regression coverage while allowing ROCm to select its supported attention backend.

  • Detect the active platform in the ColPali pooling test
  • Force the FlashAttention backend only on CUDA
  • Preserve V2 multimodal pooling coverage while using the default ROCm backend

Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
@mergify mergify Bot added multi-modality Related to multi-modality (#4194) rocm Related to AMD ROCm labels Aug 17, 2026
@github-project-automation github-project-automation Bot moved this to Todo in AMD Aug 17, 2026
@AndreasKaratzas
AndreasKaratzas marked this pull request as ready for review August 17, 2026 03:02

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

@AndreasKaratzas

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #84143 for commit f6d3e598665c.

@AndreasKaratzas
AndreasKaratzas merged commit 311b351 into main Aug 17, 2026
36 checks passed
@AndreasKaratzas
AndreasKaratzas deleted the akaratza_colpali_attn_backend branch August 17, 2026 04:08
@github-project-automation github-project-automation Bot moved this from Todo to Done in AMD Aug 17, 2026
@AndreasKaratzas

Copy link
Copy Markdown
Member Author

I forgot to unblock the test that I was targeting to fix:

Test is passing :)

zyp2014 pushed a commit to zyp2014/vllm that referenced this pull request Aug 21, 2026
wyettzeng pushed a commit to wyettzeng/vllm that referenced this pull request Aug 21, 2026
…llm-project#52565)

Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Wyett <wyettzeng@gmail.com>
zufangzhu pushed a commit to zufangzhu/vllm that referenced this pull request Aug 24, 2026
…llm-project#52565)

Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
khushali9 pushed a commit to khushali9/vllm that referenced this pull request Aug 29, 2026
…llm-project#52565)

Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

multi-modality Related to multi-modality (#4194) rocm Related to AMD ROCm

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants