Repository navigation

[Core] Add Cosmos3 attention strategy PoC - #8583

Draft

rahul-steiger-nv wants to merge 14 commits into

vllm-project:mainfrom

rahul-steiger-nv:experiment/cosmos3-strategies-fa4

Commits on Oct 2, 2026
Commits on Oct 6, 2026
- [Core] Support strict Ulysses for static block-sparse attention
  rahul-steiger-nv
  committed
  73f0c8d
- Test sparse Ulysses and offloading for Cosmos3 and MiniMax H3
  rahul-steiger-nv
  committed
  b95ff49
Commits on Oct 8, 2026
- Merge upstream main into block-sparse foundation
  rahul-steiger-nv
  committed
  d76e163
- Clarify sparse attention composition and Ulysses offload scope
  rahul-steiger-nv
  committed
  3afc47b
Commits on Oct 9, 2026