Skip to content

feat: simulate grouped prefix caching in the vLLM scheduler and plan it from probe evidence - #781

Open
Arsene12358 wants to merge 4 commits into
yimingl/aisim-2289-simulate-prefix-caching-for-grouped-fpmfrom
yimingl/aisim-2292-grouped-prefix-caching-scheduler
Open

feat: simulate grouped prefix caching in the vLLM scheduler and plan it from probe evidence#781
Arsene12358 wants to merge 4 commits into
yimingl/aisim-2289-simulate-prefix-caching-for-grouped-fpmfrom
yimingl/aisim-2292-grouped-prefix-caching-scheduler

Commits

  1. Commits on Nov 9, 2026