Repository navigation

torchtitan: miles-side model packages, with GLM-4.7-Flash as the first - #3252

Merged

Zhichenzzz merged 15 commits into

zhichen/training-utils-layoutfrom

zhichen/titan-glm4-moe-lite

Oct 2, 2026

Merged

torchtitan: miles-side model packages, with GLM-4.7-Flash as the first#3252
Zhichenzzz merged 15 commits into
zhichen/training-utils-layoutfrom
zhichen/titan-glm4-moe-lite

Commits on Sep 25, 2026
- torchtitan: look up model packages on the miles side first
  Zhichenzzz
  committed
  2729db8
- torchtitan: read q_lora_rank for the atomic update groups from the HF config
  Zhichenzzz
  committed
  438db21
- torchtitan: GLM-4.7-Flash as a miles-side model package
  Zhichenzzz
  committed
  2712bc5
- torchtitan: gather each grouped expert tensor once before the HF split
  Zhichenzzz
  committed
  ecec82d
- minor changes
  Zhichenzzz
  committed
  bfe63d5
- minor changes
  Zhichenzzz
  committed
  e14c8b7
- torchtitan e2e: name the GLM case like its siblings
  Zhichenzzz
  committed
  93cb30a
- minor changes
  Zhichenzzz
  committed
  406266e
Commits on Sep 30, 2026
Commits on Oct 2, 2026
- Merge commit '6aeac8b200e9ec180b2da3fd9df552bcbc6125ad' into zhichen/titan-glm4-moe-lite
  Zhichenzzz
  committed
  3e3264c