Skip to content

Fix Gemma-4 GRPO catastrophic KL divergence with TRL 1.0.0+#4934

Merged
danielhanchen merged 6 commits into
mainfrom
gemma4-grpo-trl1.0-compat
Apr 10, 2026
Merged

Fix Gemma-4 GRPO catastrophic KL divergence with TRL 1.0.0+#4934
danielhanchen merged 6 commits into
mainfrom
gemma4-grpo-trl1.0-compat

Commits

Commits on Apr 9, 2026