Repository navigation

[Qwen3.8 CP 1/4] Context parallelism for QSA attention and the sparse indexer - #39721

Merged

Fridge003 merged 7 commits into

sgl-project:mainfrom

Shunkangz:cp/1-qsa

Oct 1, 2026

Merged

[Qwen3.8 CP 1/4] Context parallelism for QSA attention and the sparse indexer#39721
Fridge003 merged 7 commits into
sgl-project:mainfrom
Shunkangz:cp/1-qsa

Commits on Sep 29, 2026
- [CP] Context parallelism for QSA attention and the sparse indexer
  
  Shunkangz
  and
  claude
  committed
  accee8c
- Refactor QSA context parallelism to reuse zigzag collectives
  Shunkangz
  committed
  6d9aeea
- Reuse layer boundaries for Qwen4 attention and FFN communication
  Shunkangz
  committed
  24c5d20
- Keep QSA CP refactor scoped to the backend and zigzag strategy
  Shunkangz
  committed
  4478d77
Commits on Sep 30, 2026