[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset#38503

Merged

tjtanaa merged 34 commits intovllm-project:mainfrom

ROCm:akaratza_fix_engine_async_kv

Apr 25, 2026

Commits on Mar 30, 2026

[Engine] Fix engine stalling when async KV offload defers block frees
AndreasKaratzas
committed

Commits on Apr 1, 2026

Commits on Apr 5, 2026

Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_async_kv
AndreasKaratzas
committed
[ROCm] Fix GPU memory leaks in engine shutdown for in-process mode
AndreasKaratzas
committed
[Core] Add synchronous flush of pending KV stores before prefix cache reset
AndreasKaratzas
committed
[ROCm][CI] Bump ROCm UCX branch to fix RIXL memory leak and create new test to detect the leak
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[CI] Fix OOM in torchrun MoE test by limiting max_model_len to 2048
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed
[ROCm][RIXL] Updated version with mem leak fix
AndreasKaratzas
committed

Commits on Apr 9, 2026

Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_async_kv
AndreasKaratzas
committed

Commits on Apr 12, 2026

Commits on Apr 15, 2026

Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_async_kv
AndreasKaratzas
committed

Commits on Apr 20, 2026

Commits on Apr 23, 2026

Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_async_kv
AndreasKaratzas
committed

Commits on Apr 24, 2026

Commits on Apr 25, 2026