feat(mla): support nhead < 16 in MLA decode via transparent head padding#2585

Open

ChuanLi1101 wants to merge 6 commits into

mainfrom

chuan/mla-nhead-lt16-support

Commits on Apr 1, 2026

feat(mla): support nhead < 16 in MLA decode via transparent head padding
ChuanLi1101
committed
Merge branch 'main' into chuan/mla-nhead-lt16-support
ChuanLi1101
authored

Commits on Apr 4, 2026

Merge branch 'main' into chuan/mla-nhead-lt16-support
ChuanLi1101
committed
fix(mla): strip padded heads from returned logits and lse when nhead < 16
ChuanLi1101
committed

Commits on Apr 5, 2026

Merge branch 'main' into chuan/mla-nhead-lt16-support
ChuanLi1101
authored

Commits on Apr 14, 2026

Merge branch 'main' into chuan/mla-nhead-lt16-support
ChuanLi1101
authored