[Frontend] Exploit tokenizers "new stream" in FastIncrementalDetokenizer#34217

hmellor merged 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

njhill:detok-prefillnjhill/vllm:detok-prefillCopy head branch name to clipboard