Skip to content

Fix CUDA ONNX Attention: min_bias_align crash on SM<80 and MEA NaN for fully-masked batches #27831

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
titaiwangms merged 1 commit into from
Apr 4, 2026

Fix ONNX Attention: min_bias_align, UnfusedRunner decode, MEA NaN

1e59aa5
Select commit
Loading
Failed to load commit list.
Merged

Fix CUDA ONNX Attention: min_bias_align crash on SM<80 and MEA NaN for fully-masked batches #27831

Fix ONNX Attention: min_bias_align, UnfusedRunner decode, MEA NaN
1e59aa5
Select commit
Loading
Failed to load commit list.
Azure Pipelines / Python-CUDA-Packaging-Pipeline (Linux_py_GPU_Wheels_x86_64_3_13 Linux_py_GPU_Wheels_x86_64_3_13) succeeded Apr 3, 2026 in 47m 30s

Linux_py_GPU_Wheels_x86_64_3_13 Linux_py_GPU_Wheels_x86_64_3_13 succeeded

0 errors / 1 warnings

View more details on Azure Pipelines