[training, perf] fix: THD-aware FLOPS via cu_seqlens (Σᵢ sᵢ²) - #3839

Merged

yaoyu-33 merged 27 commits into

mainfrom

chcui/thd-flops-fix

Jun 15, 2026

Commits on May 15, 2026

[training, perf] fix: THD-aware FLOPS via cu_seqlens (Σᵢ sᵢ²)
cuichenx
committed
0e3adfb

Commits on May 28, 2026

Merge remote-tracking branch 'origin/main' into pr3839-thd-flops-conflict-nora
yaoyu-33
committed
2edde36

Commits on May 29, 2026

[training] fix: avoid flops metadata sync in forward
yaoyu-33
committed
a78f863

Commits on Jun 3, 2026

Merge branch 'main' into chcui/thd-flops-fix
yaoyu-33
authored
0494433
[training, perf] fix: DP-reduce THD FLOPS stats; address review

cuichenx
and
claude
committed
11e0862
[training, perf] refactor: model-agnostic vision_patches arg for FLOPS

cuichenx
and
claude
committed
a5b66d9

Commits on Jun 4, 2026

[training, perf] docs: correct vlm_step FLOPS comment re CP sub-seq padding

cuichenx
and
claude
committed
0631268
[training, perf] fix: migrate qwen3_vl/omni step to vision_patches API

cuichenx
and
claude
committed
d8dc0e0
[training, perf] refactor: rename vision_patches -> num_vision_patches

cuichenx
and
claude
committed
c2dc357

Commits on Jun 5, 2026

[training, perf] fix: defer FLOPS reduce/sync off the per-step hot path

cuichenx
and
claude
committed
e677391
[training, perf] fix: drop per-microbatch device sync in THD FLOPS accumulation

cuichenx
and
claude
committed
fbd8bcf
[training, perf] fix: compute THD FLOPS Σᵢ sᵢ² on host cu_seqlens (no per-mb GPU sync)

cuichenx
and
claude
committed
025e7a8
[training, perf] fix: defer THD Σᵢ sᵢ² off the per-microbatch forward path

cuichenx
and
claude
committed
1965b7e
[training, perf] fix: precompute THD Σᵢ sᵢ² in the dataloader (no per-mb torch ops)

cuichenx
and
claude
committed
2665cdc
[training, test] fix: update TestGetBatch for the 11-tuple get_batch return

cuichenx
and
claude
committed
93cf6e2

Commits on Jun 7, 2026

[training, perf] refactor: compute THD Σᵢ sᵢ² inline per microbatch

cuichenx
and
claude
committed
1f81c5f
[test] chore: update FLOPS tests for inline per-microbatch THD

cuichenx
and
claude
committed
940e144

Commits on Jun 8, 2026

[training, perf] fix: log interval-average THD throughput from cumulative FLOPs delta

cuichenx
and
claude
committed
36dba54

Commits on Jun 9, 2026

Merge branch 'main' into chcui/thd-flops-fix
yaoyu-33
authored
d443d38

Commits on Jun 10, 2026

[training, perf] fix: only use cu_seqlens THD FLOPS path for CP==1

cuichenx
and
claude
committed
82761e7

Commits on Jun 11, 2026

Merge branch 'main' into chcui/thd-flops-fix
gautham-kollu
authored
585800f

Commits on Jun 12, 2026

Merge branch 'main' into chcui/thd-flops-fix
cuichenx
authored
5d61c29

Commits on Jun 13, 2026

[data, tests] fix packed parquet existence check in CI
cuichenx
committed
9d3f709

Commits on Jun 14, 2026

Revert "[data, tests] fix packed parquet existence check in CI"
cuichenx
committed
d49dfdf
[debug] add seqpacking CP CI diagnostics
cuichenx
committed
8f9d4f5
[debug] trace seqpacking CP setup failure
cuichenx
committed
004b734

Commits on Jun 15, 2026

[tests] fix seqpacking CP test memory use
cuichenx
committed
2b8925c