Skip to content

🔴 🔴 fix query_pre_attn_scalar different of num_heads in default gemma2 config#34540

Merged
molbap merged 8 commits intomainfrom
small_default_gemma2_fix
Nov 1, 2024
Merged

🔴 🔴 fix query_pre_attn_scalar different of num_heads in default gemma2 config#34540
molbap merged 8 commits intomainfrom
small_default_gemma2_fix

Commits

Commits on Oct 31, 2024

Commits on Nov 1, 2024