feat(grpc): add vLLM KV cache event support (SubscribeKvEvents bridge) - #1652

Merged

slin1237 merged 14 commits into

mainfrom

feat/vllm-kv-events

Jun 12, 2026

Commits on Jun 11, 2026

feat(grpc): add vLLM KV-event conversion helpers
key4ng
committed
fe2d795
fix(grpc): restore py3.10 timeout catch and harden vLLM KV-event helpers
key4ng
committed
131f9b7
test(grpc): integration-test vLLM KV-event ZMQ streaming loop
key4ng
committed
4b890d0
feat(grpc): implement SubscribeKvEvents in vLLM servicer
key4ng
committed
4306d18
docs(grpc): document vLLM KV-events worker + pin zmq/msgspec deps
key4ng
committed
c00baba
test(bench): add prefix-heavy KV-events cache-hit benchmark
key4ng
committed
db2652d
docs(grpc): clarify vLLM gRPC-mode requirement for KV events
key4ng
committed
e263cf4
fix(grpc): accept bytes block hashes in vLLM KV-event bridge
key4ng
committed
7fc376a
fix(grpc): address review feedback on vLLM KV-event bridge
key4ng
committed
8e18d2f
docs(grpc): use vLLM gRPC entrypoint in KV-events guide
key4ng
committed
f8be95c
chore(grpc): tighten vLLM KV-event comments/docs and drop benchmark script
key4ng
committed
847fe90
refactor(grpc): move vLLM KV-event imports to module top
key4ng
committed
2bbfd54
docs(grpc): launch vLLM KV-events worker with 'vllm serve --grpc'
key4ng
committed
7521d9c
docs(grpc): note vLLM block-size is learned from events
key4ng
committed
7854bcb