Skip to content

Add KDA (Kimi Delta Attention) hybrid layers with GLM-style two-stage gates - #7054

Merged
kevalmorabia97 merged 16 commits into
NVIDIA:mainfrom
HollowMan6:glm5-fp8
Oct 28, 2026
Merged

kevalmorabia97 merged 16 commits into
NVIDIA:mainfrom
HollowMan6:glm5-fp8

Relax recompute tolerance

177c4f1
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 25, 2026 in 1s

DCO

All commits are signed off!