-
-
Notifications
You must be signed in to change notification settings - Fork 11.7k
Open
Labels
feature requestNew feature or requestNew feature or request
Description
🚀 The feature, motivation and pitch
This PR: #25103 shows custom op for MLA
Original issue (#24620) wants to
pass q_nope and q_rope independently instead of concatenated.
This will require a sizable refactor in order to split the two in every backend, so that both are passed truly independently.
This issue tracks progress towards this task, the current pr is this: #28368
Metadata
Metadata
Assignees
Labels
feature requestNew feature or requestNew feature or request
Type
Projects
Status
To triage