[CUDA] PagedAttention: add SM<80 fp16 fallback via memory-efficient attention#28200

Merged

tianleiwu merged 10 commits intomicrosoft:mainfrom

elwhyjay:feature/paged-attention-mea-fallback

Apr 28, 2026

Commits on Apr 23, 2026

[CUDA] PagedAttention: add GatherAndExpandPagedKVCache kernel for MEA fallback
elwhyjay
committed
[CUDA] PagedAttention: add UnfusedAttention MEA fallback path
elwhyjay
committed
[CUDA] PagedAttention: populate cumulative_seqlens_kv in UnfusedAttention path
elwhyjay
committed
[CUDA] PagedAttention: wire MEA fallback dispatch + scratch allocation
elwhyjay
committed
[CUDA] PagedAttention: add MEA fallback test coverage
elwhyjay
committed
[CUDA] PagedAttention: declare LaunchGetCumulativeSeqlensKV in impl header
elwhyjay
committed
[CUDA] PagedAttention: fix OrtStreamAdapter access in ComputeInternal
elwhyjay
committed

Commits on Apr 24, 2026