[V1] Support multiple kv connectors#17564

Merged

simon-mo merged 22 commits intovllm-project:mainfrom

neuralmagic:multi-kv-connectors

May 14, 2025

Commits on May 3, 2025

[V1] Support multiple kv connectors

mgoin
authored and
njhill
committed
Example script

mgoin
authored and
njhill
committed
.

mgoin
authored and
njhill
committed
Add test

mgoin
authored and
njhill
committed
make mypy happy

mgoin
authored and
njhill
committed
move MultiKVConnectorMetadata to multi_connector.py
njhill
committed
minor simplifications
njhill
committed
Remove script

mgoin
authored and
njhill
committed
michael inprogress
njhill
committed
Make sure we pop requests from connector dict

mgoin
authored and
njhill
committed
req_id -> request_id

mgoin
authored and
njhill
committed

Commits on May 6, 2025

Commits on May 9, 2025

Handle other new methods and latest API changes
njhill
committed

Commits on May 10, 2025

update get_finished() method with new arg
njhill
committed

Commits on May 13, 2025

remove @dataclass from KVConnectorMetadata
njhill
committed

Commits on May 14, 2025