Skip to content

Enable Flash Attention in recompute and causal modes (#21)#862

Merged
regisss merged 13 commits into
huggingface:mainfrom
wszczurekhabana:flash_attention_causal_recompute
Apr 5, 2024
Merged

Enable Flash Attention in recompute and causal modes (#21)#862
regisss merged 13 commits into
huggingface:mainfrom
wszczurekhabana:flash_attention_causal_recompute

Commits

Commits on Mar 29, 2024

Commits on Mar 30, 2024

Commits on Mar 31, 2024

Commits on Apr 3, 2024

Commits on Apr 5, 2024