Skip to content

[feat] Generalized Tensor Parallelism (GTP) - #4967

Merged
fanshiqing merged 100 commits into
NVIDIA:mainfrom
fanshiqing:gtp_release
Jul 25, 2026
Merged

[feat] Generalized Tensor Parallelism (GTP)#4967
fanshiqing merged 100 commits into
NVIDIA:mainfrom
fanshiqing:gtp_release

Fix distributed-optimizer shard count with multiple optimizer instances

19f8482
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 25, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO