Skip to content

feat: price grouped KV handoff transfers by vLLM group rules - #791

Open
Arsene12358 wants to merge 3 commits into
yimingl/aisim-2291-grouped-prefix-caching-profile-markerfrom
yimingl/aisim-2290-simulate-pd-disaggregation-for-grouped
Open

feat: price grouped KV handoff transfers by vLLM group rules#791
Arsene12358 wants to merge 3 commits into
yimingl/aisim-2291-grouped-prefix-caching-profile-markerfrom
yimingl/aisim-2290-simulate-pd-disaggregation-for-grouped

feat: accept grouped KV caches on prefill and decode ranks

e1f2200
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar