Skip to content

adhoc fix replicas connector port with env variable#4

Merged
chickeyton merged 1 commit into
chickeyton:omni_coord_itg_rebase2from
herotai214:hero_adhoc_fix_connector
May 15, 2026
Merged

adhoc fix replicas connector port with env variable#4
chickeyton merged 1 commit into
chickeyton:omni_coord_itg_rebase2from
herotai214:hero_adhoc_fix_connector

Conversation

@herotai214
Copy link
Copy Markdown

@herotai214 herotai214 commented May 15, 2026

Purpose

Verified with cross-node 1A1D, 1A2D, 2A2D cases with Bagel.

Saves omni_replica_id of the replica each individual process to its os.environ["VLLM_OMNI_REPLICA_ID"] under
vllm_omni/engine/stage_engine_core_proc.py

For each process, retrieve replica_id = int(os.environ.get("VLLM_OMNI_REPLICA_ID", "0")) and pass to kv_zmq_port to compute port

Test Plan

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan. Please provide the test scripts & test commands. Please state the reasons if your codes don't require additional test scripts. For test file guidelines, please check the test style doc
  • The test results. Please paste the results comparison before and after, or the e2e results.
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model. Please run mkdocs serve to sync the documentation editions to ./docs.
  • (Optional) Release notes update. If your change is user-facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

Signed-off-by: herotai214 <herotai214@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants