DeepSeekV3 DualPipeV with SAC#2099

Draft

H-Huang wants to merge 11 commits intopytorch:mainfrom

H-Huang:deepseek-v3-with-SAC

Commits on Dec 1, 2025

Enable PP and EP overlap for MoE

wconstab
authored and
H-Huang
committed
WIP

wconstab
authored and
H-Huang
committed
Add other ops

wconstab
authored and
H-Huang
committed
claude fix errors

wconstab
authored and
H-Huang
committed
debugging mm backwards shape error

wconstab
authored and
H-Huang
committed
fix grad_out passing

wconstab
authored and
H-Huang
committed
Refactor to avoid faketensor computation in separate grad functions

wconstab
authored and
H-Huang
committed
Refactor to avoid faketensor computation in separate grad functions

wconstab
authored and
H-Huang
committed
try to fix RMSNorm

wconstab
authored and
H-Huang
committed
Fix fused_rms_norm

wconstab
authored and
H-Huang
committed
Got past RMSNorm errors, now hitting a segfault in all2allv coming from

wconstab
authored and
H-Huang
committed