Skip to content

fix: Fix FMHA-based MLA in the generation phase and add MLA unit test#3863

Merged
niukuo merged 7 commits intoNVIDIA:mainfrom
jinyangyuan-nvidia:dev/chore_mla_ut
Apr 29, 2025
Merged

fix: Fix FMHA-based MLA in the generation phase and add MLA unit test#3863
niukuo merged 7 commits intoNVIDIA:mainfrom
jinyangyuan-nvidia:dev/chore_mla_ut

Commits

Commits on Apr 29, 2025