[Refactor] Use rendered prompt for turn based /v1/realtime auto truncation - #8292

[Refactor] Use rendered prompt for turn based /v1/realtime auto truncation#8292

NickCao wants to merge 3 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

NickCao:codex/realtime-rendered-truncationNickCao/vllm-omni:codex/realtime-rendered-truncationCopy head branch name to clipboard