Yield in busy loop to fix the high latency issue we are seeing in DI. - #151

Yield in busy loop to fix the high latency issue we are seeing in DI.#151

yarongmu-google merged 1 commit into

mainvllm-project/tpu-inference:mainfrom

fhz-1vllm-project/tpu-inference:fhz-1Copy head branch name to clipboard