feat(coordinator): send rendered token ids to decode in kv_transfer_params - #3741

feat(coordinator): send rendered token ids to decode in kv_transfer_params#3741

roytman wants to merge 1 commit into

llm-d:mainllm-d/llm-d-router:mainfrom

roytman:kv_tokensroytman/llm-d-inference-scheduler:kv_tokensCopy head branch name to clipboard