feat: Enhance dataset loading efficiency with tensor parallelism#2405

Open

izikgo wants to merge 7 commits intomainfrom

izikg/broadcast-data-across-tp

Commits on Feb 23, 2026

feat: Introduce benchmark for tensor broadcast performance in TP data loading
izikgo
committed
Merge branch 'main' into izikg/broadcast-data-across-tp
izikgo
authored

Commits on Feb 24, 2026

support placing MTP layers into standalone stages for data broadcast to tp
izikgo
committed