[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution - #6408

[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution#6408

linyueqian merged 17 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

sphinxkkkbc:feat/omnivoice_batchsphinxkkkbc/vllm-omni:feat/omnivoice_batchCopy head branch name to clipboard