From e29953b1d4a978ceb12cf97a44fa003ff93de561 Mon Sep 17 00:00:00 2001 From: lishunyang12 <125541396+lishunyang12@users.noreply.github.com> Date: Mon, 22 Jun 2026 14:31:20 +0000 Subject: [PATCH] [Doc] JoyVL recipe: describe model as retrained Qwen3-VL, not vanilla The JoyAI-VL-Interaction preview keeps the Qwen3-VL architecture but its weights are retrained for streaming interaction. Reword the recipe so it no longer markets the model as "vanilla Qwen3-VL weights", aligning with the JD authors' positioning; the operational "serve it as a standard Qwen3-VL VLM (no --omni)" guidance is preserved. Co-Authored-By: Claude Opus 4.8 (1M context) Signed-off-by: lishunyang12 <125541396+lishunyang12@users.noreply.github.com> --- recipes/JD/JoyAI-VL-Interaction.md | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/recipes/JD/JoyAI-VL-Interaction.md b/recipes/JD/JoyAI-VL-Interaction.md index 60f6e1a86dd..c2a8d245bd3 100644 --- a/recipes/JD/JoyAI-VL-Interaction.md +++ b/recipes/JD/JoyAI-VL-Interaction.md @@ -5,7 +5,7 @@ ## Summary - Vendor: JD (Joy Future Academy) -- Model: [`jdopensource/JoyAI-VL-Interaction-Preview`](https://huggingface.co/jdopensource/JoyAI-VL-Interaction-Preview) (8B, vanilla Qwen3-VL weights) +- Model: [`jdopensource/JoyAI-VL-Interaction-Preview`](https://huggingface.co/jdopensource/JoyAI-VL-Interaction-Preview) (8B, Qwen3-VL architecture with weights retrained for streaming interaction) - Task: Per-tick proactive interaction over a live video stream — the model decides on its own each second to speak, stay silent, or delegate a hard question - Mode: Online serving — an OpenAI-compatible interaction orchestrator in front of @@ -33,7 +33,7 @@ framework internals and how to add another full-duplex model, see From repository root: ```bash -# 1. Serve the model (plain `vllm serve`, NOT --omni; it is vanilla Qwen3-VL). +# 1. Serve the model (plain `vllm serve`, NOT --omni; it uses the Qwen3-VL architecture). # The image limit must cover the short-term frame window (chunk_frames, default 100 = T_s); # prefix caching keeps the accumulating window cheap. Lower both for smaller GPUs. vllm serve jdopensource/JoyAI-VL-Interaction-Preview \ @@ -176,8 +176,9 @@ the audio-track caveat. ## Notes -- `--omni` is **not** used: the model is standard Qwen3-VL, so stock `vllm serve` - runs the forward pass; this recipe only adds the interaction/serving layer. +- `--omni` is **not** used: the model keeps the Qwen3-VL architecture (only the + weights are retrained), so stock `vllm serve` runs the forward pass; this recipe + only adds the interaction/serving layer. - On a host without `nvcc` / `ninja`, `vllm serve` of the 8B can crash engine-core in the FlashInfer sampler JIT (`FileNotFoundError: 'ninja'`) during `profile_run`. Set `VLLM_USE_FLASHINFER_SAMPLER=0` (or install `ninja`) to work around it.