Repository navigation

[ops, model] refactor: support packed varlen cu_seqlens splitting in attention wrapper - #1327

Merged

Coach257 merged 14 commits into

ByteDance-Seed:mainfrom

Zx55:czr/veomni-op-sdpa-wrapper

Oct 22, 2026

Merged

[ops, model] refactor: support packed varlen cu_seqlens splitting in attention wrapper#1327
Coach257 merged 14 commits into
ByteDance-Seed:mainfrom
Zx55:czr/veomni-op-sdpa-wrapper

Commits on Oct 22, 2026
- refactor: support packed varlen cu_seqlens splitting in sdpa/eager wrapper and simplify qwen2_5_omni
  
  Zx55
  and
  cursoragent
  committed
  7b12a43
- refactor: simplify remaining multimodal attention forward to use veomni_attn directly
  
  Zx55
  and
  cursoragent
  committed
  24ef77c
- chore: remove dead VARLEN_ATTENTION_TYPES and update attention docs
  
  Zx55
  and
  cursoragent
  committed
  6edbc91
- fix: support packed cu_seqlens splitting in raw flex_attention and veomni_sage_attention
  
  Zx55
  and
  cursoragent
  committed
  edd4a96
- refactor: move packed varlen attention helpers to helper.py and flatten standard/sdpa.py
  
  Zx55
  and
  cursoragent
  committed
  a3b00a5
- fix: reject raw non-SP attention calls under active Ulysses and add veomni_sdpa/sage to _VEOMNI_SP_ATTN
  
  Zx55
  and
  cursoragent
  committed
  26f5cdc
- test: stub flex_attention in qwen2_5_omni cpu test for ascend inductor
  
  Zx55
  and
  cursoragent
  committed
  51a5f67
- test: use ParallelState() in test_torch_compile fullgraph tests
  
  Zx55
  and
  cursoragent
  committed
  9816b7d
- refactor: align flex_attention short-name registration after rebase onto main
  
  Zx55
  and
  cursoragent
  committed
  bba2294
- fix: unify qwen4_exp vision attention and tighten packed varlen guards
  
  Zx55
  and
  cursoragent
  committed
  3c9782f
- docs: clarify qwen4_exp vision sp guard in upgrade_5_9_to_5_16
  
  Zx55
  and
  cursoragent
  committed
  bab6bcd
- chore: restore is_flash_attention_requested sentinel in qwen4_exp patch config
  
  Zx55
  and
  cursoragent
  committed
  d453c0b
- test: guard flash_attn.cute import in test_fa4_shared_cache_outer_compile_materializes_broadcast
  
  Zx55
  and
  cursoragent
  committed
  9392614
- test: match world size in test_torch_compile fullgraph tests
  
  Zx55
  and
  cursoragent
  committed
  6580139

Commits

Commits on Oct 22, 2026