Skip to content

[CUDA] Update Flash Attention to support head_sink for smooth softmax in GQA - #25358

Closed
tianleiwu wants to merge 2 commits into
mainfrom
tlwu/gqa_head_sink_cuda
Closed

[CUDA] Update Flash Attention to support head_sink for smooth softmax in GQA#25358
tianleiwu wants to merge 2 commits into
mainfrom
tlwu/gqa_head_sink_cuda

add test

f8cd59e
Select commit
Loading
Failed to load commit list.
Azure Pipelines / ONNX Runtime React Native CI Pipeline succeeded Jul 11, 2025 in 1h 25m 57s

Build #20250710.30 succeeded

Details

Tests

  • Failed: 0 (0.00%)
  • Passed: 36 (100.00%)
  • Other: 0 (0.00%)
  • Total: 36