Skip to content

Remove graph breaks for torch.compile() in flash_attention_forward when Lllama Model is padding free tuned #33932

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ArthurZucker merged 38 commits into from
Oct 24, 2024
+192 −20

style and pull latest changes

cb08b63
Select commit
Loading
Failed to load commit list.
Merged

Remove graph breaks for torch.compile() in flash_attention_forward when Lllama Model is padding free tuned #33932

style and pull latest changes
cb08b63
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs