Repository navigation

Context / Sequence Parallel 3/5: move Ulysses into the engine and pick a strategy per resource - #1138

Draft

dghosef wants to merge 18 commits into

context-parallel/2-zigzagfrom

sp/1-strategies

Draft

Context / Sequence Parallel 3/5: move Ulysses into the engine and pick a strategy per resource#1138
dghosef wants to merge 18 commits into
context-parallel/2-zigzagfrom
sp/1-strategies

Commits on Nov 2, 2026
- Drop sp_enabled_nodes from the Rust graph runtime and the unused sp_group parameter
  
  dghosef
  and
  claude
  committed
  9292637
- Sequence parallelism: per-resource strategies behind a sequence shard resource
  
  dghosef
  and
  claude
  committed
  d594762
- Docs: sequence and context parallelism as two axes
  
  dghosef
  and
  claude
  committed
  7a7e430
- Sequence shard: find the node's shard by splits_steps, not its class
  
  dghosef
  and
  claude
  committed
  2088a44
- Sequence shard: log each attention's split strategy where it binds
  
  dghosef
  and
  claude
  committed
  5ad7dba
- Steps: declare combined labels once, on SubmoduleStep
  
  dghosef
  and
  claude
  committed
  a9dd50e
- Ragged attention: pick the SP exchange at call time from the shard's plan
  
  dghosef
  and
  claude
  committed
  236afee
- AttentionCallable: route through the exchange when the attention holds a shard
  
  dghosef
  and
  claude
  committed
  411a7ac
- Sequence shard: make the exchanges' per-rank token check an assert
  
  dghosef
  and
  claude
  committed
  0365837
- AttentionCallable: write(k, v) for a K/V write without attention
  
  dghosef
  and
  claude
  committed
  d1ef9be
- Step: refuse a resource step whose combined_labels differ from its SubmoduleStep's
  
  dghosef
  and
  claude
  committed
  e69a37e
- AttentionCallable: ask the attention's public splits, not its private _shard
  
  dghosef
  and
  claude
  committed
  3e8d49c
- AttentionCallable.write: say it is a no-op where the attention writes its own K/V
  
  dghosef
  and
  claude
  committed
  a5391aa
- SeqShardStep: its segments may be its own, as LTX-2.5's are
  
  dghosef
  and
  claude
  committed
  1f6ecda
- Step: say the combined_labels refusal holds only while the SubmoduleStep sets one (cleanup-review-2 P3-1)
  
  dghosef
  and
  claude
  committed
  4c7ddea
- Merge context-parallel/2-zigzag (main through eceea1bee, #1124 ae8ff84ae) into sp/1-strategies
  
  dghosef
  and
  claude
  committed
  7e0995f
Commits on Nov 3, 2026
- test: give the reference flashinfer module a spec
  
  dghosef
  and
  claude
  committed
  7ddf79e
Commits on Nov 4, 2026
- Merge context-parallel/2-zigzag (h2d numpy staging) into sp/1-strategies
  dghosef
  committed
  173a264

Commits

Commits on Nov 2, 2026

Commits on Nov 3, 2026

Commits on Nov 4, 2026