[HiCache] Size each rank's host pool from the full host headroom, not headroom // ranks (upstream #38157) - #14

[HiCache] Size each rank's host pool from the full host headroom, not headroom // ranks (upstream #38157)#14

Venkat2811 merged 1 commit into

kimi-k3-v0.5.22datacrunch-research/sglang:kimi-k3-v0.5.22from

venkat/v0522-0-host-budgetdatacrunch-research/sglang:venkat/v0522-0-host-budgetCopy head branch name to clipboard