Skip to content

[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test #52565

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
AndreasKaratzas merged 2 commits into from
Aug 17, 2026
+3 −1
Merged

[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test #52565

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f13d83d
[ROCm][CI] Avoid forcing FlashAttention in the ColPali pooling test
AndreasKaratzas Aug 17, 2026
f6d3e59
Merge branch 'main' into akaratza_colpali_attn_backend
AndreasKaratzas Aug 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion tests/models/multimodal/pooling/test_colpali.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@
ChatCompletionContentPartTextParam,
)
from vllm.entrypoints.pooling.scoring.typing import ScoreMultiModalParam
from vllm.platforms import current_platform

from ....conftest import VllmRunner

Expand Down Expand Up @@ -215,6 +216,7 @@ def _run_multimodal_text_query_image_docs_test(
_make_image_mm_param(red_image),
_make_image_mm_param(blue_image),
]
attention_backend = "FLASH_ATTN" if current_platform.is_cuda() else None

with vllm_runner(
model,
Expand All @@ -223,7 +225,7 @@ def _run_multimodal_text_query_image_docs_test(
max_model_len=4096,
enforce_eager=True,
gpu_memory_utilization=GPU_MEMORY_UTILIZATION,
attention_backend="FLASH_ATTN",
attention_backend=attention_backend,
kernel_config={"enable_flashinfer_autotune": False},
) as vllm_model:
assert vllm_model.llm.llm_engine.vllm_config.use_v2_model_runner
Expand Down
Loading