Add Fused RMSNorm + FP8 Per-tensor Static Quantization to Llama 3 Models#789

dllehr-amd merged 2 commits into355_wipROCm/vllm:355_wipfrom

farlukas/355_wip_ll_fp8_fuse_rms_quantROCm/vllm:farlukas/355_wip_ll_fp8_fuse_rms_quantCopy head branch name to clipboard