Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
ab8d3bf
PagedAttention design
tianleiwu Jul 27, 2026
63ead38
update
tianleiwu Jul 27, 2026
fd1e918
paged atention stage 1
tianleiwu Jul 28, 2026
01e1bc3
quantized kv cache support in paged attention
tianleiwu Jul 28, 2026
ca0e126
Paged decode kernel
tianleiwu Jul 28, 2026
b26e49e
PagedAttention design: add schema v2 consolidated revision (section 21)
tianleiwu Jul 28, 2026
ace10bf
Add backward compatible design
tianleiwu Jul 28, 2026
e8791ba
update design
tianleiwu Jul 28, 2026
ec993c1
remove smooth_softmax, split k, v cache bit witdth attributes.
tianleiwu Jul 28, 2026
c1e6e6c
support MLA
tianleiwu Jul 28, 2026
e43e215
update doc about sliding window cache (implementation later).
tianleiwu Jul 28, 2026
961fa81
Use attributes k_cache_dtype and v_cache_dtype
tianleiwu Jul 29, 2026
e6c8057
enable XQA for paged attention
tianleiwu Jul 29, 2026
7da74b0
attention_metadata
tianleiwu Jul 29, 2026
fec4742
comment
tianleiwu Jul 29, 2026
dca2d11
fix fp16 kernel, and limit positive left_window_size in test
tianleiwu Jul 29, 2026
fd4f625
cvtS8x4ToF16x4 in XQA
tianleiwu Jul 29, 2026
fb98a94
docs(paged_attention): clarify head_size vs v_head_size notation
tianleiwu Jul 29, 2026
c032fb8
fix head sink and quantized kv
tianleiwu Jul 30, 2026
5681c31
fix(paged-attention): guard optional value_cache in shape inference
tianleiwu Jul 30, 2026
91c8a93
test(paged-attention): skip CUDA tests when torch has no CUDA
tianleiwu Jul 30, 2026
f617ca7
docs: regenerate OperatorKernels.md for PagedAttention
tianleiwu Jul 30, 2026
cc952e8
fix(cuda): include <cfloat> in paged_attention_impl.cu
tianleiwu Jul 30, 2026
b330904
Merge'origin/main'
tianleiwu Jul 30, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading