Skip to content

Support for FlashAttention in Llama2#584

Merged
regisss merged 3 commits into
huggingface:mainfrom
wszczurekhabana:llama_fused_sdpa
Dec 12, 2023
Merged

Support for FlashAttention in Llama2#584
regisss merged 3 commits into
huggingface:mainfrom
wszczurekhabana:llama_fused_sdpa

Commits

Commits on Dec 12, 2023