[HiCache] Rework the buffer-mode storage prefetch pipeline and retry bookkeeping - #39283

[HiCache] Rework the buffer-mode storage prefetch pipeline and retry bookkeeping#39283

xiezhq-hermann merged 2 commits into

mainsgl-project/sglang:mainfrom

hicache-buffer-mode-prefetch-pipelinesgl-project/sglang:hicache-buffer-mode-prefetch-pipelineCopy head branch name to clipboard