Skip to content

[KV Connector] More async support for get_num_new_matched_tokens - #23620

Merged
simon-mo merged 8 commits into
vllm-project:mainfrom
ApostaC:local-dev/async-lookup
Sep 10, 2025
Merged

simon-mo merged 8 commits into
vllm-project:mainfrom
ApostaC:local-dev/async-lookup

Commits

  1. Commits on Aug 26, 2025

  2. Commits on Sep 1, 2025

  3. Commits on Sep 2, 2025

  4. Commits on Sep 8, 2025

  5. Commits on Sep 9, 2025