Add mock SFT dataset and varlen dataset family - #6734

Merged

ilml merged 11 commits into

NVIDIA:mainfrom

ilml:split/3386-dataset-r2

Aug 27, 2026

Commits on Aug 21, 2026

Commits on Aug 24, 2026

Drop the pandas dependency from the mock SFT and varlen loaders

ilml
and
claude
committed
4ccffde
Require per-token loss with sequence packing and gate the dispatcher check on MoE

ilml
and
claude
committed
775c17b
Merge remote-tracking branch 'origin/main' into split/3386-dataset-r2
ilml
committed
0af6116

Commits on Aug 25, 2026

Collapse the requires_te_2_9 skipif args for black

ilml
and
claude
committed
68736e7

Commits on Aug 26, 2026

Gate the allgather variable-seq-length check on MoE

ilml
and
claude
committed
41de47f
Merge remote-tracking branch 'origin/main' into split/3386-dataset-r2
ilml
committed
0b38f86

Commits on Aug 27, 2026

Merge remote-tracking branch 'origin/main' into split/3386-dataset-r2
ilml
committed
300c9c4