Skip to content

flydsl: gfx942 FP8 MQA logits indexer kernel (+ Triton FN/FNUZ fix) #3913

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
valarLip merged 5 commits into from
Jul 7, 2026
Merged

flydsl: gfx942 FP8 MQA logits indexer kernel (+ Triton FN/FNUZ fix) #3913

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
5b01694
flydsl: add gfx942 fp8 MQA logits indexer kernel
akii96 Jun 25, 2026
19537a3
flydsl: fix i32 index overflow in fp8 MQA logits output write
akii96 Jun 25, 2026
079edff
flydsl/triton: gate FN->FNUZ conversion to gfx942
akii96 Jun 26, 2026
d0d58f0
flydsl: name MFMA tile-dim constants (MFMA_M/N/K)
akii96 Jun 26, 2026
9e8797b
flydsl: refactor fp8_mqa_logits test to aiter-op-test standard
akii96 Jul 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions aiter/ops/flydsl/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,11 @@
from .moe_kernels import flydsl_moe_stage1, flydsl_moe_stage2
from .fmha_kernels import flydsl_flash_attn_func
from .kernels.qk_norm_rope_quant import flydsl_qk_norm_rope_quant
from .kernels.fp8_mqa_logits import (
flydsl_fp8_mqa_logits,
KERNEL_VARIANTS as FP8_MQA_LOGITS_VARIANTS,
DEFAULT_VARIANT as FP8_MQA_LOGITS_DEFAULT_VARIANT,
)

# from .linear_attention_kernels import flydsl_gdr_decode

Expand All @@ -51,5 +56,8 @@
"flydsl_hgemm",
"flydsl_flash_attn_func",
"flydsl_qk_norm_rope_quant",
"flydsl_fp8_mqa_logits",
"FP8_MQA_LOGITS_VARIANTS",
"FP8_MQA_LOGITS_DEFAULT_VARIANT",
# "flydsl_gdr_decode",
]
Loading
Loading