Skip to content

feat: Add attention_backend config support for Megatron policy#1628

Merged
yuki-97 merged 11 commits into
NVIDIA-NeMo:mainfrom
sahgerlad:feat/attention-backend-config
Mar 31, 2026
Merged

feat: Add attention_backend config support for Megatron policy#1628
yuki-97 merged 11 commits into
NVIDIA-NeMo:mainfrom
sahgerlad:feat/attention-backend-config

Fix unit test to use bf16 since flash attention doesn't support FP32;…

c58a83f
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Mar 23, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO