Skip to content

fix: kvbm breaking change - Updated kv_cache_connector lib import to reflect the updates made to trtllm 1.3.0rc14 #9622

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
nv-kmcgill53 merged 2 commits into from
May 18, 2026
Merged

fix: kvbm breaking change - Updated kv_cache_connector lib import to reflect the updates made to trtllm 1.3.0rc14 #9622

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
1e0006e
kvbm breaking change: updated kv_cache_connector lib import to reflec…
nv-kmcgill53 May 15, 2026
13650d7
bumped version of required tensorrt_llm package in pyproject to 1.3.0…
nv-kmcgill53 May 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion benchmarks/pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ dependencies = [
"pandas",
"pydantic>=2",
"tabulate",
# Satisfies vLLM 0.11.0 (>=4.55.2), vLLM 0.11.2 (>=4.56.0,<5), TRT-LLM 1.3.0rc11 (==4.57.3), SGLang 0.5.8 (==4.57.1)
# Satisfies vLLM 0.11.0 (>=4.55.2), vLLM 0.11.2 (>=4.56.0,<5), TRT-LLM 1.3.0rc14 (==4.57.3), SGLang 0.5.8 (==4.57.1)
"transformers>=4.56.0",
]

Expand Down
2 changes: 1 addition & 1 deletion lib/bindings/kvbm/python/kvbm/trtllm_integration/connector/kvbm_connector_leader.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
from kvbm.trtllm_integration.rust import KvConnectorLeader as RustKvConnectorLeader
from kvbm.trtllm_integration.rust import SchedulerOutput as RustSchedulerOutput
from kvbm.utils import is_dyn_runtime_enabled, nvtx_annotate
from tensorrt_llm._torch.pyexecutor.kv_cache_connector import (
from tensorrt_llm._torch.pyexecutor.connectors.kv_cache_connector import (
Comment thread
nv-kmcgill53 marked this conversation as resolved.
KvCacheConnectorScheduler,
SchedulerOutput,
)
Comment thread
coderabbitai[bot] marked this conversation as resolved.
Expand Down
4 changes: 3 additions & 1 deletion lib/bindings/kvbm/python/kvbm/trtllm_integration/connector/kvbm_connector_worker.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,9 @@
from kvbm.trtllm_integration.rust import KvConnectorWorker as RustKvConnectorWorker
from kvbm.utils import is_dyn_runtime_enabled, nvtx_annotate
from tensorrt_llm import logger
from tensorrt_llm._torch.pyexecutor.kv_cache_connector import KvCacheConnectorWorker
from tensorrt_llm._torch.pyexecutor.connectors.kv_cache_connector import (
Comment thread
nv-kmcgill53 marked this conversation as resolved.
KvCacheConnectorWorker,
)
from tensorrt_llm.llmapi.llm_args import TorchLlmArgs

DistributedRuntime = None
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ Repository = "https://github.com/ai-dynamo/dynamo.git"
[project.optional-dependencies]
trtllm =[
"uvloop",
"tensorrt-llm==1.3.0rc11",
"tensorrt-llm==1.3.0rc14",
]

vllm = [
Expand Down
Loading