[2/n] [Serve] Refactor replica rank to prepare for node local ranks#58473

abrarsheikh merged 10 commits into

masterray-project/ray:masterfrom

LLM-2497-abrar-rank-p2ray-project/ray:LLM-2497-abrar-rank-p2Copy head branch name to clipboard