perf(glm5next): size the persisting-L2 set-aside for the weight prefetcher - #578

perf(glm5next): size the persisting-L2 set-aside for the weight prefetcher#578

MadeBy561 wants to merge 4 commits into

local-inference-lab:dev/jovian-judgementlocal-inference-lab/vllm:dev/jovian-judgementfrom

MadeBy561:perf/glm53-l2-prefetch-persisting-set-asideMadeBy561/vllm:perf/glm53-l2-prefetch-persisting-set-asideCopy head branch name to clipboard