[Hopper] optimize decoding performance for headdim 128 fp8#96

LucasWilkinson merged 1 commit intovllm-project:mainvllm-project/flash-attention:mainfrom

jmkuebler:headdim128_fp8_optimjmkuebler/flash-attention:headdim128_fp8_optimCopy head branch name to clipboard