Skip to content

[Doc] Add Qwen3 AWQ models to documentation - #40034

Merged
yewentao256 merged 4 commits into
vllm-project:mainfrom
YM2132:add-new-model-support-batch-invariance
Apr 21, 2026
Merged

yewentao256 merged 4 commits into
vllm-project:mainfrom
YM2132:add-new-model-support-batch-invariance

Conversation

@YM2132

@YM2132 YM2132 commented Apr 16, 2026

Copy link
Copy Markdown
Contributor

Purpose

Recently added AWQ model support to batch invariant feature (#38670). This PR updates the documentation to reflect two models with which I have tested batch invariance on.

The addition of this to docs was discussed in #27433.

Test Plan

Ran the following commands to verify the two models added to the docs:

VLLM_TEST_MODEL=Qwen/Qwen3-4B-AWQ .venv/bin/python -m pytest tests/v1/determinism/test_batch_invariance.py -v --timeout=1000
VLLM_TEST_MODEL=Qwen/Qwen3-8B-AWQ .venv/bin/python -m pytest tests/v1/determinism/test_batch_invariance.py -v --timeout=1000

Test Result

Both tests passed all batch invariance tests.

Signed-off-by: Yusuf <yusufmohammad@live.com>
@mergify

mergify Bot commented Apr 16, 2026

Copy link
Copy Markdown
Contributor

Documentation preview: https://vllm--40034.org.readthedocs.build/en/40034/

@mergify mergify Bot added documentation Improvements or additions to documentation qwen Related to Qwen models labels Apr 16, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the batch invariance documentation to include Qwen3-4B-AWQ and Qwen3-8B-AWQ in the list of verified dense models. I have no feedback to provide.

@YM2132

YM2132 commented Apr 16, 2026

Copy link
Copy Markdown
Contributor Author

Hi @yewentao256, added two new AWQ models which I tested locally to the batch invariance documentation.

@yewentao256 yewentao256 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for the work!

@yewentao256 yewentao256 added the ready ONLY add when PR is ready to merge/full CI is needed label Apr 16, 2026
@yewentao256
yewentao256 merged commit ec5ef0a into vllm-project:main Apr 21, 2026
8 checks passed
Copilot AI pushed a commit to hongbolv/vllm that referenced this pull request Apr 22, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: hongbolv <33214277+hongbolv@users.noreply.github.com>
avinashsingh77 pushed a commit to avinashsingh77/vllm that referenced this pull request Apr 27, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Avinash Singh <avinashsingh.rcoem@gmail.com>
Copilot AI pushed a commit to hongbolv/vllm that referenced this pull request May 7, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: hongbolv <33214277+hongbolv@users.noreply.github.com>
weifang231 pushed a commit to weifang231/eb-vllm that referenced this pull request May 13, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request May 15, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
mfylcek pushed a commit to mfylcek/vllm that referenced this pull request May 19, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
brian-dellabetta pushed a commit to neuralmagic/vllm that referenced this pull request May 29, 2026
Signed-off-by: Yusuf <yusufmohammad@live.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation qwen Related to Qwen models ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants