[Feature] : Support disaggregated inference pipeline for Qwen3_TTS#1161

Merged

hsliuustc0106 merged 30 commits into

vllm-project:mainfrom

Sy0307:dev/tts_disaggregation

Feb 20, 2026

Commits on Feb 15, 2026

[+] Feat: Support disaggregated inference pipeline for Talker and SpeechTokenizer
Sy0307
committed
[~] Fix: Enhance compatibility in OmniConnector adapter
Sy0307
committed
[~] Fix: Enhance OmniGenerationScheduler and Qwen3TTSTokenizer functionality
Sy0307
committed
[~] Refactor: codec frame rate handling in OmniModelConfig and Qwen3TTSConfig
Sy0307
committed
[~] Refactor: Improve device handling and additional information management in Qwen3 TTS models and OmniGenerationScheduler
Sy0307
committed
[~] Refactor: Streamline prompt handling and additional information extraction in OmniInputPreprocessor and Qwen3-TTS
Sy0307
committed
[~] Refactor: Simplify payload handling and enhance metadata management in Qwen3 TTS models and OmniGPUModelRunner
Sy0307
committed
[~] Refactor: Remove unused logger initialization and streamline code in Qwen3 TTS models
Sy0307
committed
[~] Refactor: Update TTS prompt handling and introduce new configuration for Qwen3 TTS async chunk processing
Sy0307
committed
[~] Fix: Enhance TTS processing to fix audio overlap issues
Sy0307
committed
[~] Style: Fix code format errors of pre-commit
Sy0307
committed
[~] Style: Re-fix code format errors of pre-commit
Sy0307
committed
[~] Refactor: Remove Qwen3 TTS model files and update registry to reflect changes
Sy0307
committed
[~] Refactor: Optimize TTS model initialization and enhance configuration management for improved performance
Sy0307
committed
[~] Feat: Implement ref_audio resolution for TTS processing to solve SSRF issue and enhance model registry for Qwen3 TTS
Sy0307
committed
[~] Feat: Improve codec mask handling in Qwen3 TTS
Sy0307
committed
[~] Refactor: Clean up additional information handling in OmniGenerationScheduler and update compatibility comments in OmniConnectors
Sy0307
committed
[~] Style: Format error fixed
Sy0307
committed
[+] Feat: Enhance SSRF protection and improve TTS processing for cuda_graph
Sy0307
committed
[~] Style: Fix pre-commit issue
Sy0307
committed
[+] Fix: Enhance scheduling logic and chunk processing in OmniGenerationScheduler and ChunkTransferAdapter to solve v0.16.0 errors
Sy0307
committed
[~] Style: Fix ruff format error
Sy0307
committed

Commits on Feb 16, 2026

[+] CI: Add prompt length estimation for Talker stage and refactor input handling in offline test
Sy0307
committed

Commits on Feb 19, 2026

[~] CI: Fix unit-test for "talker_mtp_output_key" caller update for qwen3_tts
Sy0307
committed

Commits on Feb 20, 2026