Skip to content

[None][feat] add VisualGen SOL sparse attention backend - #8

Closed
heyuhhh wants to merge 1 commit into
user/yuhangh/update_vsafrom
user/yuhangh/primts-block-sparse-vsa-sol
Closed

[None][feat] add VisualGen SOL sparse attention backend#8
heyuhhh wants to merge 1 commit into
user/yuhangh/update_vsafrom
user/yuhangh/primts-block-sparse-vsa-sol

Conversation

@heyuhhh

@heyuhhh heyuhhh commented Sep 3, 2026

Copy link
Copy Markdown
Owner

Superseded

This draft used the compatibility branch user/yuhangh/primts-block-sparse-vsa-sol. The branch has been restacked to the final SOL head 318bf988df, but review is now tracked on the dedicated SOL integration PR #9.

No code was dropped: both branches currently point at the same commit, and the pre-restack combined implementation remains preserved at backup/primts-block-sparse-vsa-sol-before-restack-20260903 (60b572fa65).

Canonical review stack:

  1. General block-sparse FMHA #2
  2. Shared VisualGen workflow + VSA #7
  3. SOL attention #9

The SOL kernel dependency is flashinfer-ai/flashinfer#4872.

@heyuhhh
heyuhhh force-pushed the user/yuhangh/primts-block-sparse-vsa-sol branch from c3f572d to b8cdd81 Compare September 3, 2026 04:54
@heyuhhh
heyuhhh force-pushed the user/yuhangh/update_vsa branch from 02c8016 to c9cd717 Compare September 3, 2026 04:54
@heyuhhh
heyuhhh force-pushed the user/yuhangh/primts-block-sparse-vsa-sol branch 2 times, most recently from 0482d5b to f1ae5bf Compare September 3, 2026 07:37
@heyuhhh
heyuhhh force-pushed the user/yuhangh/update_vsa branch from c9cd717 to 97727ad Compare September 3, 2026 07:37
@heyuhhh
heyuhhh force-pushed the user/yuhangh/primts-block-sparse-vsa-sol branch from f1ae5bf to cf8f65c Compare September 3, 2026 11:44
@heyuhhh
heyuhhh force-pushed the user/yuhangh/update_vsa branch from 97727ad to 14602f8 Compare September 3, 2026 11:44
@heyuhhh
heyuhhh force-pushed the user/yuhangh/primts-block-sparse-vsa-sol branch from cf8f65c to cd9a22c Compare September 3, 2026 13:06
@heyuhhh
heyuhhh force-pushed the user/yuhangh/update_vsa branch from 14602f8 to 90ce012 Compare September 3, 2026 13:06
Signed-off-by: yuhangh <58161490+heyuhhh@users.noreply.github.com>
@heyuhhh
heyuhhh force-pushed the user/yuhangh/primts-block-sparse-vsa-sol branch from cd9a22c to e86650d Compare September 3, 2026 19:56
@heyuhhh
heyuhhh force-pushed the user/yuhangh/update_vsa branch from 90ce012 to 6a5b339 Compare September 3, 2026 19:56
@heyuhhh heyuhhh closed this Sep 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant