fix(coordinator): run the prompt-token parity check on conditional-decode hits and stop buffering when nothing is rewritten - #3889

fix(coordinator): run the prompt-token parity check on conditional-decode hits and stop buffering when nothing is rewritten#3889

shimib wants to merge 3 commits into

llm-d:mainllm-d/llm-d-router:mainfrom

shimib:feat/prompt-token-parity-followupshimib/llm-d-inference-scheduler:feat/prompt-token-parity-followupCopy head branch name to clipboard