Vllm upstream#1

Closed

dllehr-amd wants to merge 13 commits intoROCm:mainfrom

dllehr-amd:vllm_upstream

Commits on Feb 14, 2024

Support FP8-E5M2 KV Cache (#2279)

authored and
gshtras
committed
Fix compile error when using rocm (#2648)

zhaoyang-star
authored and
gshtras
committed
Add hip_fp8 datatype and conversions
gshtras
committed
Merge pull request #1 from ROCm/greg/fp8_tests

HaiShaw
authored and
gshtras
committed
Merge pull request #3 from ROCm/greg/tweaks

HaiShaw
authored and
gshtras
committed
Repeating the cleanup reintroduced by merging
gshtras
committed
Add swap_blocks unit tests (#2616)

sh1ng
authored and
gshtras
committed

Commits on Feb 23, 2024

Merge remote-tracking branch 'dlehr/vllm_upstream' into vllm_upstream_fp8
gshtras
committed

Commits on Mar 17, 2024

Merge pull request #1 from gshtras/vllm_upstream_fp8
dllehr-amd
authored