Skip to content

[Disagg][Perf] Use NPU event sync instead of blocking tolist to avoid unintentional copy ops blocking across different NPU streams, improving disagg TTIT/TTFT#3209

Closed
jesse996 wants to merge 20 commits into
vllm-project:mainfrom
jesse996:event-sync
Closed

[Disagg][Perf] Use NPU event sync instead of blocking tolist to avoid unintentional copy ops blocking across different NPU streams, improving disagg TTIT/TTFT#3209
jesse996 wants to merge 20 commits into
vllm-project:mainfrom
jesse996:event-sync

Commits

Commits on Sep 5, 2025

Commits on Sep 6, 2025

Commits on Sep 7, 2025

Commits on Sep 11, 2025

Commits on Sep 15, 2025

Commits on Sep 16, 2025

Commits on Sep 22, 2025

Commits on Oct 24, 2025

Commits on Nov 3, 2025

Commits on Nov 13, 2025

Commits on Dec 8, 2025