tokenization: pool should report unrecoverable failures#210

evacchi wants to merge 2 commits into

llm-d:mainllm-d/llm-d-kv-cache:mainfrom

evacchi:test-tokenization-pool-error-reportingevacchi/llm-d-kv-cache:test-tokenization-pool-error-reportingCopy head branch name to clipboard