Skip to content

feat(datasets): add cp=1 shared-prefix prefix-tree attention for rollouts - #2564

Merged
HuiyingLi merged 5 commits into
NVIDIA-NeMo:mainfrom
khazic:khazic/feat/multiturn-prefix-tree-attn
Jun 17, 2026
Merged

HuiyingLi merged 5 commits into
NVIDIA-NeMo:mainfrom
khazic:khazic/feat/multiturn-prefix-tree-attn

fix(distributed): raise on prefix-tree mask with HF magi backend

6f329f7
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Jun 17, 2026 in 0s

100.00% of diff hit (target 80.00%)

View this Pull Request on Codecov

100.00% of diff hit (target 80.00%)