Skip to content

Fix K-ragged Blackwell activation scales#10382

Merged
roman-openai merged 15 commits into
mainfrom
roman/fix-k-ragged-act-scale-layout
May 27, 2026
Merged

Fix K-ragged Blackwell activation scales#10382
roman-openai merged 15 commits into
mainfrom
roman/fix-k-ragged-act-scale-layout

Conversation

@roman-openai
Copy link
Copy Markdown
Collaborator

@roman-openai roman-openai commented May 26, 2026

K-ragged metadata is not row-segment metadata for BlackwellActMXScaleLayout; passing it corrupts matmul output with swizzled activation scales.

Test: GB200 test_k_ragged_mxfp8_act_scale_swizzling fails on main (77.3% mismatched elements) and passes here.

@roman-openai roman-openai changed the title Fix K-ragged act scale layout Fix K-ragged Blackwell act-scale OOB read May 26, 2026
@roman-openai roman-openai changed the title Fix K-ragged Blackwell act-scale OOB read Fix K-ragged Blackwell activation scales May 26, 2026
@roman-openai roman-openai marked this pull request as ready for review May 27, 2026 00:44
@roman-openai roman-openai requested a review from ptillet as a code owner May 27, 2026 00:44
@roman-openai roman-openai merged commit 5868810 into main May 27, 2026
19 of 20 checks passed
@roman-openai roman-openai deleted the roman/fix-k-ragged-act-scale-layout branch May 27, 2026 01:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants