Skip to content

[BugFix] Fix missing symbol triggering FA2 fallback on Hopper#111

Merged
LucasWilkinson merged 1 commit intomainfrom
lwilkinson/fix-missing-symbol
Nov 21, 2025
Merged

[BugFix] Fix missing symbol triggering FA2 fallback on Hopper#111
LucasWilkinson merged 1 commit intomainfrom
lwilkinson/fix-missing-symbol

Conversation

@LucasWilkinson
Copy link
Copy Markdown
Collaborator

@LucasWilkinson LucasWilkinson commented Nov 20, 2025

fix (missing symbol introduced in: #105)

>>> import vllm.vllm_flash_attn._vllm_fa3_C
/home/mgoin/code/vllm/.venv/lib64/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: /home/mgoin/code/vllm/vllm/vllm_flash_attn/_vllm_fa3_C.abi3.so: undefined symbol: _Z12run_mha_fwd_ILi80EN7cutlass10bfloat16_tELi128ELi128ELb1ELb1ELb0ELb1EEvR16Flash_fwd_paramsP11CUstream_st

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
@LucasWilkinson LucasWilkinson merged commit 86f8f15 into main Nov 21, 2025
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants