Skip to content

[Bugfix] add inject model_arch to hf_overrides#2178

Merged
Gaohan123 merged 1 commit into
vllm-project:mainfrom
lengrongfu:fix/model_arch
Mar 25, 2026
Merged

[Bugfix] add inject model_arch to hf_overrides#2178
Gaohan123 merged 1 commit into
vllm-project:mainfrom
lengrongfu:fix/model_arch

Conversation

@lengrongfu
Copy link
Copy Markdown
Contributor

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Fixes: #2170

Test Plan

python -m vllm_omni.entrypoints.cli.main serve fishaudio/s2-pro --stage-configs-path vllm_omni/model_executor/stage_configs/fish_speech_s2_pro.yaml --omni --trust-remote-code --enforce-eager --gpu-memory-utilization 0.95
image

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan. Please provide the test scripts & test commands. Please state the reasons if your codes don't require additional test scripts. For test file guidelines, please check the test style doc
  • The test results. Please paste the results comparison before and after, or the e2e results.
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model. Please run mkdocs serve to sync the documentation editions to ./docs.
  • (Optional) Release notes update. If your change is user-facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

Signed-off-by: rongfu.leng <lenronfu@gmail.com>
@david6666666
Copy link
Copy Markdown
Collaborator

@wuhang2014 ptal thx

@Gaohan123 Gaohan123 changed the title add inject model_arch to hf_overrides [Bugfix] add inject model_arch to hf_overrides Mar 25, 2026
@Gaohan123 Gaohan123 added the ready label to trigger buildkite CI label Mar 25, 2026
Copy link
Copy Markdown
Collaborator

@Gaohan123 Gaohan123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!

@Gaohan123 Gaohan123 enabled auto-merge (squash) March 25, 2026 15:32
@Gaohan123 Gaohan123 merged commit b569cb5 into vllm-project:main Mar 25, 2026
8 checks passed
zhangj1an pushed a commit to zhangj1an/vllm-omni that referenced this pull request Mar 26, 2026
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
zhangj1an pushed a commit to zhangj1an/vllm-omni that referenced this pull request Mar 26, 2026
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
vraiti pushed a commit to vraiti/vllm-omni that referenced this pull request Apr 9, 2026
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
lengrongfu added a commit to lengrongfu/vllm-omni that referenced this pull request May 1, 2026
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
clodaghwalsh17 pushed a commit to clodaghwalsh17/nm-vllm-omni-ent that referenced this pull request May 12, 2026
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready label to trigger buildkite CI

Projects

None yet

3 participants