Skip to content

Pull requests: llm-d/llm-d-kv-cache-manager

New pull request New
25 Open 101 Closed
25 Open 101 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove redundant documentation
#198 opened Nov 28, 2025 by vMaroon Loading…
1
build: Enable clang-format for CUDA and C++ sources
#197 opened Nov 28, 2025 by kfirtoledo Loading…
fix: Single tokenizer initialization at startup
#192 opened Nov 25, 2025 by sagiahrac Loading…
7
fix: Enable local tokenizer chat template rendering
#186 opened Nov 25, 2025 by pierDipi Loading…
1
7
feat: Simplify tokenization prefix store to single-model architecture
#182 opened Nov 24, 2025 by sagiahrac Loading…
6
[fs_connector][feat]: Add Python backend implementation for fs backend of offloading connector (fs_connector)
#181 opened Nov 23, 2025 by kfirtoledo Loading…
[fs_connector][feat]: Add storage_offload CUDA kernel and setup config
#180 opened Nov 23, 2025 by kfirtoledo Loading…
[fs_connector][feat]: Add tensor copy module (tensor_copy) for GPU and CPU block transfers
#179 opened Nov 23, 2025 by kfirtoledo Loading…
[fs_connector][feat]: Add multithreaded worker pool (thread_pool)
#178 opened Nov 23, 2025 by kfirtoledo Loading…
[fs_connector][feat]: Add buffer management module (buffer)
#177 opened Nov 23, 2025 by kfirtoledo Loading…
[fs_connector][feat]: Add file management module (file_io) for fs connector
#176 opened Nov 23, 2025 by kfirtoledo Loading…
5
feat: profiling kv cache index implementations (#108)
#175 opened Nov 22, 2025 by kartikx Loading…
7
feat: avg hit rate metric
#166 opened Nov 18, 2025 by kyanokashi Loading…
1
feat: KV-block hashing consistency between vLLM and llmd
#165 opened Nov 18, 2025 by sagiahrac • Draft
[KV-Events] Add vLLM KV cache events demo with ZMQ listener
#162 opened Nov 17, 2025 by sagiahrac Loading…
10
Bump aiohttp from 3.9.5 to 3.12.14 in /services/uds_tokenizer dependencies Pull requests that update a dependency file python Pull requests that update python code
#152 opened Oct 28, 2025 by dependabot bot Loading…
Fix lexical error
#128 opened Sep 17, 2025 by romsharon98 Loading…
1
Bump pillow from 11.2.1 to 11.3.0 in /pkg/preprocessing/chat_completions dependencies Pull requests that update a dependency file python Pull requests that update python code
#105 opened Sep 4, 2025 by dependabot bot Loading…
Bump torch from 2.5.1 to 2.7.1+cpu in /pkg/preprocessing/chat_completions dependencies Pull requests that update a dependency file python Pull requests that update python code
#99 opened Aug 29, 2025 by dependabot bot Loading…
Reuse chained xxhash BlockHasher
#97 opened Aug 25, 2025 by sagiahrac Loading…
Created channel interface for KVEvents processing and added unit test cases
#77 opened Aug 3, 2025 by praddy26 • Draft
11
KV Cache aware scheduler performance enhancement. Work in Progress !!!
#70 opened Jul 29, 2025 by srampal • Draft
Bump pillow from 11.2.1 to 11.3.0 in /pkg/preprocessing/chat_completions_template dependencies Pull requests that update a dependency file python Pull requests that update python code
#60 opened Jul 19, 2025 by dependabot bot Loading…
Bump torch from 2.7.0 to 2.7.1 in /pkg/preprocessing/chat_completions_template dependencies Pull requests that update a dependency file python Pull requests that update python code
#59 opened Jul 19, 2025 by dependabot bot Loading…
Initial distributed tracing instrumentation
#48 opened Jul 9, 2025 by sallyom • Draft
3
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.