Skip to content

[Feature][MRV2] Default Model Runner V2 with compatibility fallbacks - #154

Merged
cursor[bot] merged 0 commit into
mainfrom
expand-mrv2-whitelist-copy-df29
Sep 21, 2026
Merged

cursor[bot] merged 0 commit into
mainfrom
expand-mrv2-whitelist-copy-df29

Conversation

@yjyang62

@yjyang62 yjyang62 commented Sep 18, 2026 •

Copy link
Copy Markdown
Owner

What this PR does / why we need it?

This PR makes Model Runner V2 the default on Ascend when VLLM_USE_V2_MODEL_RUNNER is unset. The old architecture, feature, platform, and Triton whitelist is replaced by a blacklist in vllm_ascend/mrv2_utils.py.

When the env var is unset, a request uses V2 unless it matches one of these V1 fallbacks:

Models / platform

  • Hy3-preview (HYV3*)
  • Gemma4 (Gemma4*)
  • 310P
  • encoder-decoder (Whisper)
  • pooling KV

Features

  • LoRA
  • VL encoder disaggregation (ec_transfer_config / encoder-only)
  • VL encoder graph (compilation_config.cudagraph_mm_encoder)
  • draft_window_size
  • suffix speculative decoding
  • ngram / ngram_gpu
  • parallel_drafting
  • dflash2 graph (DFlash2 without enforce_eager)

An explicit override still wins:

  • VLLM_USE_V2_MODEL_RUNNER=0 forces V1
  • VLLM_USE_V2_MODEL_RUNNER=1 forces V2

Upstream GPU / Triton V2 validation does not apply; Ascend owns runner selection.

Also drop stale VLLM_USE_V1 from the five DeepSeek-V3.2 nightlies so they take the default V2 path.

Does this PR introduce any user-facing change?

Yes. Unset VLLM_USE_V2_MODEL_RUNNER now defaults to Model Runner V2, except for the blacklist above. Keep V1 with VLLM_USE_V2_MODEL_RUNNER=0. Explicit 0 / 1 is unchanged.

How was this patch tested?

  • Unit tests: tests/ut/test_mrv2_utils.py (default V2, blacklist fallback, env override)

  • E2E / nightly: default V2 path, plus a few explicit VLLM_USE_V2_MODEL_RUNNER=0 pins

  • CI: cpu-ut / e2e on this PR

  • vLLM main: vllm-project/vllm@84030bb

Open in Web Open in Cursor 

@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch from 58fbe74 to 16786e9 Compare September 18, 2026 03:42
@cursor cursor Bot changed the title [Feature][MRV2] Default all configurations to Model Runner V2 [Feature][MRV2] Default Model Runner V2 and select V1 with VLLM_USE_V1_MODEL_RUNNER Sep 18, 2026
@cursor
cursor Bot changed the base branch from cursor/indexer-kv-fp16-66d2 to vllm-project-main September 18, 2026 03:42
@cursor cursor Bot changed the title [Feature][MRV2] Default Model Runner V2 and select V1 with VLLM_USE_V1_MODEL_RUNNER [Feature][MRV2] Default Model Runner V2 for all configurations Sep 18, 2026
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch from 02a9aa5 to dbeb3d1 Compare September 18, 2026 07:48
@cursor cursor Bot changed the title [Feature][MRV2] Default Model Runner V2 for all configurations [Feature][MRV2] Default Model Runner V2 with compatibility fallbacks Sep 18, 2026
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch from ec0ffef to fb33286 Compare September 18, 2026 16:51
@cursor
cursor Bot changed the base branch from vllm-project-main to main September 18, 2026 16:51
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch 3 times, most recently from 09a974a to a8fd770 Compare September 20, 2026 06:20
@yjyang62
yjyang62 force-pushed the expand-mrv2-whitelist-copy-df29 branch from a8fd770 to 2f052a7 Compare September 20, 2026 09:12
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch from 2f052a7 to d905b3c Compare September 20, 2026 12:21
@yjyang62
yjyang62 force-pushed the expand-mrv2-whitelist-copy-df29 branch from d905b3c to efc890d Compare September 20, 2026 12:38
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch 2 times, most recently from b804e7d to 37d61a4 Compare September 21, 2026 01:37
@yjyang62
yjyang62 force-pushed the expand-mrv2-whitelist-copy-df29 branch from 37d61a4 to 71a8bbf Compare September 21, 2026 01:37
@cursor
cursor Bot force-pushed the expand-mrv2-whitelist-copy-df29 branch from b5fc2d5 to 52152e6 Compare September 21, 2026 06:31
@cursor
cursor Bot merged commit 3a6dd56 into main Sep 21, 2026
1 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant