Skip to content

[Disagg][Perf] Use NPU event sync instead of blocking tolist to avoid unintentional copy ops blocking across different NPU streams, improving disagg TTIT/TTFT#2788

Merged
wangxiyuan merged 16 commits into
vllm-project:mainfrom
jesse996:event-sync
Sep 24, 2025

Commits

Commits on Sep 5, 2025

Commits on Sep 6, 2025

Commits on Sep 7, 2025

Commits on Sep 11, 2025

Commits on Sep 15, 2025

Commits on Sep 16, 2025

Commits on Sep 22, 2025