Skip to content

[Perf] Batch KV cache swap copies via cuMemcpyBatchAsync#38460

Merged
orozery merged 32 commits into
vllm-project:mainfrom
Etelis:swap-blocks-batch-v2
Apr 3, 2026
Merged

[Perf] Batch KV cache swap copies via cuMemcpyBatchAsync#38460
orozery merged 32 commits into
vllm-project:mainfrom
Etelis:swap-blocks-batch-v2

Commits

Commits on Mar 29, 2026

Commits on Mar 30, 2026

Commits on Mar 31, 2026

Commits on Apr 1, 2026

Commits on Apr 2, 2026

Commits on Apr 3, 2026