Repository navigation

[Triton/Gluon] [CI] [gfx942] Tuned sparse MLA prefill for DSv4.1-Flash TP4; fix attn_sink in Triton fallback - #6002

Open

juuso-oskari wants to merge 24 commits into

mainfrom

jukorhon/gfx942-sparse-prefill

Commits on Sep 30, 2026
- [Triton][gfx942] Faster sparse MLA prefill at <=16 heads; fix attn_sink in Triton fallback
  
  juuso-oskari
  and
  claude
  committed
  c69f539
Commits on Oct 6, 2026
- Address review: scope gfx942 config, keep shared kernel guards, bound has_invalid=False
  
  juuso-oskari
  and
  claude
  committed
  99004d7
- Address auto-review: tuned-config JSON, empty pool, scale and out= checks, CI scope
  
  juuso-oskari
  and
  claude
  committed
  8af778b
- Drop HAS_INVALID from the Triton kernel; out= test on every branch; bench the public entry
  
  juuso-oskari
  and
  claude
  committed
  fdf34e9
- Test out-of-pool slots, not only -1
  
  juuso-oskari
  and
  claude
  committed
  622d57a
- Merge remote-tracking branch 'origin/main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  committed
  fd133e3
- Merge branch 'main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  authored
  b8e869b
- Require a contiguous out= buffer
  
  juuso-oskari
  and
  claude
  committed
  a417225
- Benchmark: give pa_prefill_sparse an empty extend source on gfx1250
  
  juuso-oskari
  and
  claude
  committed
  35c742e
Commits on Oct 7, 2026
- Merge branch 'main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  authored
  d96e50c
- Validity check without a num_kv range assumption; keep int64 indices
  
  juuso-oskari
  and
  claude
  committed
  438a0c5
- Do not load invalid KV rows; correct gfx950 slot-handling docs
  
  juuso-oskari
  and
  claude
  committed
  69c3eeb
- Test the huge-pool validity check through the public wrapper
  
  juuso-oskari
  and
  claude
  committed
  b95d0ac
- Fix stale gather comments; vectorize bench CSR setup; update CI shard weight
  
  juuso-oskari
  and
  claude
  committed
  7e06aa7
- Merge branch 'main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  authored
  c60b2ce
Commits on Oct 8, 2026
- Merge branch 'main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  authored
  ee4390f
- Keep the existing (non-pinned) path on the original loop code
  
  juuso-oskari
  and
  claude
  committed
  04db87b
- Find and remove the shared-loop regression instead of gating it
  
  juuso-oskari
  and
  claude
  committed
  c77568c
- Triton branch: reject non-fp16/bf16 q and KV dtype mismatch; prefill-only note
  
  juuso-oskari
  and
  claude
  committed
  6258917
- Merge remote-tracking branch 'origin/main' into jukorhon/gfx942-sparse-prefill
  juuso-oskari
  committed
  72cbb65
Commits on Oct 12, 2026

Navigation Menu

Repository navigation

[Triton/Gluon] [CI] [gfx942] Tuned sparse MLA prefill for DSv4.1-Flash TP4; fix attn_sink in Triton fallback - #6002

[Triton/Gluon] [CI] [gfx942] Tuned sparse MLA prefill for DSv4.1-Flash TP4; fix attn_sink in Triton fallback#6002
juuso-oskari wants to merge 24 commits into
mainfrom
jukorhon/gfx942-sparse-prefill

Commits on Sep 30, 2026

[Triton][gfx942] Faster sparse MLA prefill at <=16 heads; fix attn_sink in Triton fallback

Commits on Oct 6, 2026

Address review: scope gfx942 config, keep shared kernel guards, bound has_invalid=False

Address auto-review: tuned-config JSON, empty pool, scale and out= checks, CI scope

Drop HAS_INVALID from the Triton kernel; out= test on every branch; bench the public entry

Test out-of-pool slots, not only -1

Merge remote-tracking branch 'origin/main' into jukorhon/gfx942-sparse-prefill

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Require a contiguous out= buffer

Benchmark: give pa_prefill_sparse an empty extend source on gfx1250

Commits on Oct 7, 2026

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Validity check without a num_kv range assumption; keep int64 indices

Do not load invalid KV rows; correct gfx950 slot-handling docs

Test the huge-pool validity check through the public wrapper

Fix stale gather comments; vectorize bench CSR setup; update CI shard weight

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Commits on Oct 8, 2026

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Keep the existing (non-pinned) path on the original loop code

Find and remove the shared-loop regression instead of gating it

Triton branch: reject non-fp16/bf16 q and KV dtype mismatch; prefill-only note

Merge remote-tracking branch 'origin/main' into jukorhon/gfx942-sparse-prefill

Commits on Oct 12, 2026

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Merge branch 'main' into jukorhon/gfx942-sparse-prefill

Merge branch 'main' into jukorhon/gfx942-sparse-prefill