Enable Llama 3.1 405B in FP8 (#124)#1745

regisss merged 4 commits into

huggingface:mainhuggingface/optimum-habana:mainfrom

HabanaAI:auto-pr-b1b92d4HabanaAI/optimum-habana-fork:auto-pr-b1b92d4Copy head branch name to clipboard