Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
45f1bb9
feat(fmha): support paged FP8 D192 with asymmetric values
sammysun0711 Aug 21, 2026
ef39d59
test(fa): guard large offset test by available VRAM
sammysun0711 Aug 26, 2026
490bb16
fix(fmha): order paged copies on the launch stream
sammysun0711 Aug 31, 2026
ff77071
fix(fmha): guard paged FP8 flattened dimensions
sammysun0711 Aug 31, 2026
e40644e
refactor(fmha): clean up paged FP8 address helpers
sammysun0711 Aug 31, 2026
a3c0d34
fix(fmha): preserve paged BF16 seqlen compatibility
sammysun0711 Aug 31, 2026
2175c2f
fix(fmha): validate paged output device
sammysun0711 Aug 31, 2026
4b04045
perf(fmha): reduce paged FP8 V192 register pressure
sammysun0711 Sep 1, 2026
5b8fe46
feat(fmha): enable paged FP8 D128 attention
sammysun0711 Sep 1, 2026
2fc285e
perf(fmha): add paired-page D128 fast path
sammysun0711 Sep 1, 2026
f56ab1f
perf(fmha): relax paged D128 P*V accumulator anchors
sammysun0711 Sep 1, 2026
aa3126c
perf(fmha): vectorize paged D128 V fragment loads
sammysun0711 Sep 1, 2026
3db264f
perf(fmha): use permlane16 for paged D128 V staging
sammysun0711 Sep 1, 2026
c554b1d
perf(fmha): keep paged D128 permlane results in native order
sammysun0711 Sep 1, 2026
b48cb40
perf(fmha): overlap paged D128 V prefetch
sammysun0711 Sep 1, 2026
fe33810
perf(fmha): defer paged D128 logit scaling
sammysun0711 Sep 1, 2026
88ff0b9
perf(fmha): overlap paged D128 V loads with QK
sammysun0711 Sep 1, 2026
9232c17
perf(fmha): defer paged D192 logit scaling
sammysun0711 Sep 1, 2026
7f4f709
perf(fmha): use direct FP8 P*V for paged V128
sammysun0711 Sep 1, 2026
7c02fdb
perf(fmha): cache compiled fp8 page attention
sammysun0711 Sep 2, 2026
fc7f9b8
perf(fmha): schedule paged BF16 V192 fragments on demand
sammysun0711 Sep 2, 2026
a3a4c4f
perf(fmha): use segmented FP8 P*V for paged V192
sammysun0711 Sep 3, 2026
9d07ca5
perf(fmha): pipeline paged FP8 V prefetch
sammysun0711 Sep 3, 2026
688884b
perf(fmha): extend paged FP8 BN128 to varlen batches
sammysun0711 Sep 3, 2026
c388f3b
perf(fmha): balance paged FP8 D192 batches
sammysun0711 Sep 3, 2026
e82ca92
refactor(fmha): use typed paged FP8 helpers
sammysun0711 Sep 3, 2026
fc99957
refactor(fmha): remove unreachable paged FP8 split-K code
sammysun0711 Sep 3, 2026
484646f
refactor(fmha): remove unreachable paged FP8 non-causal paths
sammysun0711 Sep 7, 2026
e92b34b
docs(fmha): trim paged FP8 schedule narration
sammysun0711 Sep 7, 2026
fcb549e
refactor(fmha): attach compile hints to paged launcher
sammysun0711 Sep 7, 2026
4c0912b
refactor(fmha): use architecture-dispatched paged FP8 waits
sammysun0711 Sep 7, 2026
dded5be
refactor(fmha): simplify static paged FP8 contracts
sammysun0711 Sep 7, 2026
50d98a1
fix(fmha): rebase and fix dense and paged FP8 trait integration
sammysun0711 Sep 8, 2026
c9e72fa
perf(fmha): extend paged BN128 to D192/V128
sammysun0711 Sep 8, 2026
c15f035
perf(fmha): use an eight-slot paged D128 prefetch ring
sammysun0711 Sep 8, 2026
f537e4e
perf(fmha): add compact paired-page FP8 V192 pipeline
sammysun0711 Sep 8, 2026
cfbdfb5
refactor(fmha): specialize paged FP8 layout contracts
sammysun0711 Sep 9, 2026
3791131
refactor(fmha): use explicit-width paged FP8 arithmetic
sammysun0711 Sep 9, 2026
fa3cee0
test(fmha): share the paged FP8 reference calculation
sammysun0711 Sep 9, 2026
752c52e
refactor(fmha): use public paged FP8 memory views
sammysun0711 Sep 9, 2026
7148042
refactor(fmha): share paged launch and compile preparation
sammysun0711 Sep 9, 2026
44302e9
docs(fmha): clean up paged FP8 implementation comments
sammysun0711 Sep 9, 2026
4a72f6e
refactor(fmha): keep segmented LDS offsets in tile units
sammysun0711 Sep 9, 2026
e6e7f86
perf(fmha): share a balanced maximum across paged FP8 tile pairs
sammysun0711 Sep 9, 2026
cf79b38
perf(fmha): split the D192 V128 unmasked attention prefix
sammysun0711 Sep 9, 2026
9df3371
perf(fmha): select scalar centering for native paged FP8
sammysun0711 Sep 9, 2026
9b291b2
perf(fmha): interleave paired D192/V128 batches in grid X
sammysun0711 Sep 9, 2026
1c2a27a
perf(fmha): prune bounded paged FP8 rescaling
sammysun0711 Sep 10, 2026
eb85926
perf(fmha): interleave small paired D128 batches
sammysun0711 Sep 10, 2026
3cc57af
refactor(fmha): simplify paged FP8 pipeline helpers
sammysun0711 Sep 10, 2026
9e8c5ef
refactor(fmha): centralize paged dispatch policy and test helpers
sammysun0711 Sep 10, 2026
cacbae0
docs(fmha): clarify paged FP8 layout and scheduling invariants
sammysun0711 Sep 10, 2026
3bbbeef
refactor(fmha): adopt official LLVM memory primitives
sammysun0711 Sep 10, 2026
497c76f
refactor(fmha): unify paged FP8 attention on official APIs
sammysun0711 Sep 11, 2026
9251049
perf(fmha): optimize native small-page FP8 attention
sammysun0711 Sep 11, 2026
5196a22
perf(fmha): streamline small-page FP8 data movement
sammysun0711 Sep 11, 2026
3579e32
fix(fmha): harden paged FP8 contracts and use public FMA
sammysun0711 Sep 12, 2026
08ac7cb
refactor(fmha): simplify paged FP8 scheduling and tests
sammysun0711 Sep 12, 2026
8a662b0
increase CI test timeout to 70 min
sammysun0711 Sep 14, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/flydsl.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -617,7 +617,7 @@ jobs:
docker exec flydsl_test bash -c "python3 -c 'import torch; import triton; assert tuple(map(int, triton.__version__.split(\"+\", 1)[0].split(\".\")[:3])) >= (3, 6, 0), triton.__version__; print(\"Using image Triton\", triton.__version__, \"with PyTorch\", torch.__version__)'"

- name: Run tests
timeout-minutes: 60
timeout-minutes: 70
Comment thread
coderfeli marked this conversation as resolved.
run: |
docker exec -e ROCM_PATH flydsl_test bash -c 'export PYTHONPATH=/tmp/aiter:${PYTHONPATH:-} && export AITER_REPO=/tmp/aiter && cd /flydsl-test && RUN_TESTS_FULL=1 bash scripts/run_tests.sh'

Expand Down
Loading
Loading