feat(deepseek_v4): faithful THD context-parallel path for DS4 CSA (bounded activation memory) - #7

Merged

flameagainst merged 3 commits into

verl-project:litefrom

ISEEKYAN:feature/ds4-csa-thd-cp-verl

Jul 13, 2026

Commits on Jul 13, 2026

Add DeepSeek-V4 CSA THD context-parallel path to Megatron-Lite

ISEEKYAN
and
claude
committed
dc6342f
Fix THD-packed key shape in DSv4 CSA CP path

ISEEKYAN
and
claude
committed
6f6d39f
Thread DSv4 CSA kernel/loss knobs as impl config, default to fused

ISEEKYAN
and
claude
committed
baeed80