Support Mistral 32K input token#931

Merged

regisss merged 15 commits into

mainfrom

May 10, 2024

Commits on Apr 23, 2024

Commits on Apr 24, 2024

Commits on Apr 25, 2024

Commits on Apr 26, 2024

Merge branch 'main' into skaulintel/mistral_fp8
skaulintel
authored

Commits on Apr 29, 2024

Mistral flash attention support for longer input length
jiminha
committed

Commits on May 8, 2024

Merge remote-tracking branch 'remotes/origin/main' into jha/mistral30k
jiminha
committed

Commits on May 9, 2024