Skip to content

Enable uneven K#109

Merged
LucasWilkinson merged 2 commits intovllm-project:mainfrom
MatthewBonanni:uneven_k
Nov 17, 2025
Merged

Enable uneven K#109
LucasWilkinson merged 2 commits intovllm-project:mainfrom
MatthewBonanni:uneven_k

Conversation

@MatthewBonanni
Copy link
Copy Markdown

This PR removes the FLASHATTENTION_DISABLE_UNEVEN_K build flag. This will enable running vision transformers, which require head sizes of 40, 72, and 80.

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Copy link
Copy Markdown
Collaborator

@LucasWilkinson LucasWilkinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@LucasWilkinson LucasWilkinson merged commit 71bb26f into vllm-project:main Nov 17, 2025
1 check passed
@MatthewBonanni MatthewBonanni deleted the uneven_k branch November 17, 2025 18:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants