Skip to content

Fix Gemma-4 GRPO catastrophic KL divergence with TRL 1.0.0+ - #4934

Merged
danielhanchen merged 6 commits into
mainfrom
gemma4-grpo-trl1.0-compat
Apr 10, 2026
Merged

Fix Gemma-4 GRPO catastrophic KL divergence with TRL 1.0.0+#4934
danielhanchen merged 6 commits into
mainfrom
gemma4-grpo-trl1.0-compat

[pre-commit.ci] auto fixes from pre-commit.com hooks

46b3522
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / CodeQL succeeded Apr 9, 2026 in 2s

No new alerts in code changed by this pull request