Skip to content

feat: add gemma4 moe ring CP - #1914

Merged
HuiyingLi merged 114 commits into
NVIDIA-NeMo:mainfrom
khazic:feat/gemma4-context-parallelism
Jun 15, 2026
Merged

feat: add gemma4 moe ring CP#1914
HuiyingLi merged 114 commits into
NVIDIA-NeMo:mainfrom
khazic:feat/gemma4-context-parallelism

docs(cp): drop stale DTensor-SDPA comment in infrastructure CP block

6555fe6
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 15, 2026 in 0s

DCO

All commits are signed off!