[V0][Minor] Support custom add a new kv connector without modify vllm code#15756
[V0][Minor] Support custom add a new kv connector without modify vllm code#15756maobaolong wants to merge 3 commits intovllm-project:mainfrom
Conversation
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
c4127b6 to
afe20e1
Compare
|
This pull request has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this pull request should remain open. Thank you! |
|
This pull request has merge conflicts that must be resolved before it can be |
The motivation of this PR aimed to make it easy to use a new kv connector implementation of third-party without modify vllm code.
In the other hand, vllm should not responsible for each custom kv connector implementations.