Fixed Gemma FP8 flash_attention lower throughput issue#1510

regisss merged 1 commit into

huggingface:mainhuggingface/optimum-habana:mainfrom

kplau1128:fix_gemma_fp8_flash_attn_low_tpkplau1128/optimum-habana:fix_gemma_fp8_flash_attn_low_tpCopy head branch name to clipboard