Repository navigation
fix(examples): [release/1.6.0] change default realtime ASR model to Qwen3-ASR - #16438
Merged
nv-nmailhot merged 1 commit intoOct 14, 2026
Conversation
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com> (cherry picked from commit e09ec90) Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Contributor
akshatha-k
approved these changes
Oct 14, 2026
Contributor
✅ Dynamo PR CI passed — run 38636207227 (attempt 1) on
|
nv-nmailhot
deleted the
ptarasiewicz/qwen-default-realtime-asr-release-1.6.0
branch
October 14, 2026 22:22
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Cherry-pick #16295 onto
release/1.6.0usinggit cherry-pick -x --signoff(main commite09ec90990cd1ebb763fd27858c87e1fe7237172). The cherry-pick applied without conflicts or adaptations.Change the default realtime ASR example to
Qwen/Qwen3-ASR-0.6B, using vLLM's realtime support. This gives the release a default example that boots and transcribes audio, avoiding the reported Voxtral startup failure in the default launch path.Qwen3ASRRealtimeGenerationfor the default model when no--hf-overridesis supplied.The change is limited to one example launcher and two documentation pages. It does not fix the underlying Voxtral startup failure. No additional backport dependencies were needed.
Validation
bash -n,git diff --check, and invalid-argument checks passed. Scoped docs lint passed with zero errors and five existing navigation warnings for untouched pages.fern check: zero errors and three warnings.fern docs broken-linksreports an existing broken link in the untoucheddeepseek-v4-pro-0813.mdxpage (line 254); the page and navigation are unchanged by this backport.nvcr.io/nvstaging/ai-dynamo/vllm-runtime:1.6.0-rc.2on an RTX A6000: image packages unchanged; default model and architecture selection; worker booted, registered, and remained healthy after three audio requests.--max-model-len 4096 --max-num-seqs 2 --kv-cache-memory-bytes 1073741824. A paced 6.72-second clip emitted its first delta at 5.48 seconds, before commit at 6.83 seconds, and completed at 7.11 seconds. The documented client passed--require-incremental; residual-only audio also completed without a crash.Known Upstream Limitations
Transcript repetition and raw ASR markers also reproduced on native vLLM in the original validation. This backport does not address those upstream behaviors:
Refs DYN-4860.