Add THD-format per-rank batch fetch with padding mask for sequence packing - #6625

Merged

ilml merged 2 commits into

NVIDIA:mainfrom

ilml:split/3386-04-thd-batch-fetch

Aug 19, 2026

Commits on Aug 18, 2026

Add THD-format per-rank batch fetch with padding mask for sequence packing

ilml
and
claude
committed
4ac5297
Address review: drop the TE wrapper and reuse broadcast_scalars

ilml
and
claude
committed
e8cad32