Skip to content

Conversation

@pralay-das
Copy link

@pralay-das pralay-das commented Oct 20, 2025

feat:

  • supported fused RoPE in flash attention
  • Use GMEM data (read & write) for RoPE calculation

used #498 PR as a reference for chunk prefill.
only RoPE changes: sunjiweiswift/cutlass-sycl@8048471...pralay-das:cutlass-sycl:dev/pralay-das/chunk_prefill_rope

Valentine233 and others added 10 commits September 30, 2025 23:40
This change imports `SYCLCompat` to cutlass-sycl repo as `compat`.
Previous dependencies on `syclcompat` are changed to `compat`.
This PR also fix some failures of `SYCLCompat` in oneapi 2025.2.

---------

Co-authored-by: Roland Schulz <[email protected]>
@pralay-das pralay-das changed the title [WIP] chunk prefill with rope [PYTORCHDGQ-6865] Added support for RoPE on chunk prefill [WIP] Oct 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants