Skip to content

Validate num_attention_heads is divisible by num_query_groups in TransformerConfig - #5756

Open
huthvincent wants to merge 1 commit into
NVIDIA:mainfrom
huthvincent:fix/gqa-heads-divisibility
Open

Validate num_attention_heads is divisible by num_query_groups in TransformerConfig#5756
huthvincent wants to merge 1 commit into
NVIDIA:mainfrom
huthvincent:fix/gqa-heads-divisibility

Validate num_attention_heads is divisible by num_query_groups in Tran…

2fa33b5
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 25, 2026 in 0s

DCO

All commits are signed off!