🚨All attention refactor🚨 #35235

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Cyrilvallez merged 99 commits into main from all-attention-refactor

Dec 18, 2024

+5,635 −9,778

Merged

🚨All attention refactor🚨 #35235

add kwargs to _flash_attention_forward

This check has been archived and is scheduled for deletion. Learn more about checks retention

CircleCI Checks / setup_and_quality succeeded Dec 18, 2024 in 4m 15s

Workflow: setup_and_quality

View CircleCI workflow

View more details on CircleCI Checks