[Feature][Rocm] add quick all reduce for rocm#19744

Merged

vllm-bot merged 44 commits intovllm-project:mainfrom

lihaoyang-amd:lhy/add_quick_all_reduce

Jun 27, 2025

Commits on Jun 26, 2025

Add quickreduce as alternative to custom allreduce

ilmarkov
authored and
lihaoyang-amd
committed
WIP

ilmarkov
authored and
lihaoyang-amd
committed
Add bf16 support

ilmarkov
authored and
lihaoyang-amd
committed
WIP

ilmarkov
authored and
lihaoyang-amd
committed
Refactor QuickReduce

ilmarkov
authored and
lihaoyang-amd
committed
Cleanup

ilmarkov
authored and
lihaoyang-amd
committed
Remove config param. Add faster low latency OneShot algo

ilmarkov
authored and
lihaoyang-amd
committed
Some fixes

ilmarkov
authored and
lihaoyang-amd
committed
fix bfloat16 recv
lihaoyang-amd
committed
fix env
lihaoyang-amd
committed
fix log info
lihaoyang-amd
committed
for env
lihaoyang-amd
committed
Add int8 quantization. Remove changes to custom_allreduce

ilmarkov
authored and
lihaoyang-amd
committed
Update after review comments

ilmarkov
authored and
lihaoyang-amd
committed
add Q6 support
lihaoyang-amd
committed
Adjusted to static constexpr int
lihaoyang-amd
committed
Remove useless functions
lihaoyang-amd
committed
fix max size err
lihaoyang-amd
committed
adjust for comments
lihaoyang-amd
committed
integrate_qr2cr
lihaoyang-amd
committed
fix message size
lihaoyang-amd
committed
Fix fp 2GB bug

ilmarkov
authored and
lihaoyang-amd
committed
adjust condition
lihaoyang-amd
committed
fix vll_config
lihaoyang-amd
committed
change comment
lihaoyang-amd
committed
Update test. Disable QR by default. Set fp16 ovfl flag.

ilmarkov
authored and
lihaoyang-amd
committed
Fix CodecQ4

ilmarkov
authored and
lihaoyang-amd
committed
Update min sizes

ilmarkov
authored and
lihaoyang-amd
committed
fix Q4

lihaoyang-amd
and
ilmarkov
committed
move bf2fp to cpp
lihaoyang-amd
committed
fix compile err
lihaoyang-amd
committed
fix qr for cuda

lihaoyang-amd
and
ilmarkov
committed
fix f-string

lihaoyang-amd
and
ilmarkov
committed
adjust test case for quick allreduce

lihaoyang-amd
and
ilmarkov
committed
del TODO and rebase

lihaoyang-amd
and
ilmarkov
committed
Optimized format

lihaoyang-amd
and
ilmarkov
committed
add test for multi modes

lihaoyang-amd
and
ilmarkov
committed
for fmt

lihaoyang-amd
and
ilmarkov
committed
Adjustable max_size
lihaoyang-amd
committed
go back to splitting

lihaoyang-amd
and
ilmarkov
committed
change default of max_size to None

lihaoyang-amd
and
ilmarkov
committed
adjust name of var

lihaoyang-amd
and
ilmarkov
committed
restore custom allreduce
lihaoyang-amd
committed

Commits on Jun 27, 2025

check rocm for qr

lihaoyang-amd
and
ilmarkov
committed