[do not merge] probe CP packed SFT larger model - #4399

Closed

cuichenx wants to merge 5 commits into

mainfrom

chcui/thd-flops-ci-probe-cp-sft-256

Commits on Jun 16, 2026

[training, perf] fix: THD-aware FLOPS via cu_seqlens (Σᵢ sᵢ²) (re-land of #3839)

cuichenx
and
claude
committed
9b05925
test(training): reduce tensor inspect memory footprint
cuichenx
committed
70cbc7d
fix(training): limit flops stats all-reduce to THD
cuichenx
committed
a386c1f
test(training): stabilize CP packed SFT checkpoint test
cuichenx
committed
1b9b525
test(training): probe CP packed SFT larger model
cuichenx
committed
9169482