Vllm upstream fp8#1

Merged

dllehr-amd merged 10 commits intodllehr-amd:vllm_upstreamfrom

gshtras:vllm_upstream_fp8

Mar 17, 2024

Commits on Feb 14, 2024

Support FP8-E5M2 KV Cache (#2279)

authored and
gshtras
committed
Fix compile error when using rocm (#2648)

zhaoyang-star
authored and
gshtras
committed
Add hip_fp8 datatype and conversions
gshtras
committed
Merge pull request #1 from ROCm/greg/fp8_tests

HaiShaw
authored and
gshtras
committed
Merge pull request #3 from ROCm/greg/tweaks

HaiShaw
authored and
gshtras
committed
Repeating the cleanup reintroduced by merging
gshtras
committed
Add swap_blocks unit tests (#2616)

sh1ng
authored and
gshtras
committed

Commits on Feb 15, 2024

Commits on Feb 23, 2024

Merge remote-tracking branch 'dlehr/vllm_upstream' into vllm_upstream_fp8
gshtras
committed