Repository navigation
[test only] PR #92 tests on vLLM v0.33.0 (PR #96) - do not merge - #97
Draft
aung-san-i wants to merge 11 commits into
Draft
aung-san-i wants to merge 11 commits into
aung-san-i wants to merge 11 commits into
Conversation
… tests Implements section 2 of .ci/test/dynamo-heterog/XPU_CI_Test_Plan.md. New heterogeneous matrix legs (xpu-heterogeneous-run.yml, 7 -> 13 legs): - agg-x (INT-1): one aggregated XPU worker, the baseline - agg-router-2x (INT-11): two aggregated XPU workers behind the KV router - px2-dn-router (INT-12): 2 XPU prefill + NVIDIA decode behind the KV router - px-dn-8b (INT-6): px-dn on Qwen/Qwen3-8B - ex-pdx (EXT-15): XPU encode + XPU prefill-decode on one host, Qwen3-VL-2B - omni-ar-dit-1node-xpu (EXT-19): GLM-Image AR and DiT both on XPU Re-enabled pytest coverage (EXT-12/13), skipped since ai-dynamo#15406: - qwen3-vl-2b agg and agg_router profiles in vllm_xpu.py - xpu_1 marker on test_vllm_mm_router_e2e.py Issue ai-dynamo#15417 is still open; these need a run on the v0.31.0 XPU base. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…y omni leg px2-dn-router: set UCX_IB_GID_INDEX=1 on Prefill and Decode. The prefill replicas run on SR-IOV VFs that keep only their link-local GIDs; without a pinned index decode's UCX endpoint create failed with "Address not valid" and every request errored (run 41087132745). Same fix as omni_ar-dit_2nodes. omni-ar-dit-1node-xpu: removed from the matrix (13 -> 12 legs). GLM-Image's AR stage took 18.88 GiB on one 24 GB B60 and left -2.68 GiB for KV cache. It needs AR at TP=2, i.e. three B60s, more than intel01-b60 has. The manifest is kept, with the measured result in its header. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The XPU workers run as root and create Qwen3-VL-2B's folder in the shared HF cache root-owned. huggingface_hub writes a lock file there even on a cache hit, so the bench pod failed to load the tokenizer with "Permission denied" (run 41127269054), after the encode -> prefill-decode request itself had succeeded. runAsUser: 0 matches the workers. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Re-captures the amd64 licence baseline in the same commit as the tag bump. The licences stage subtracts on (name, version), so bumping the tag alone leaves every moved package unsubtracted and fails the policy gate in compliance.Dockerfile before any test can run. Image digest: sha256:be3a9aea234be64ffc2816ac561c597e0f0b1f44a61a7f4912780e4d77450086 Baseline stem: vllm-openai-xpu@be3a9aea Opened by .github/workflows/xpu-base-image-watch.yaml Signed-off-by: dynamo-ops <170655669+dynamo-ops@users.noreply.github.com>
…LLM v0.33.0 vLLM v0.33.0's NIXL connector refuses NIXL < 1.5.0, and the XPU image inherited the framework-level nixl_ref v1.4.1, so every disaggregated XPU worker exited at engine start (run 41492764713: px-dn, pn-dx, px-dn-hnd-tp2, px-dx). vLLM-Omni 0.31.0rc1 imports get_engine_zmq_addresses, which vLLM 0.33 renamed, so the omni DiT worker failed on import (omni-ar-dit-2nodes). No Omni release targets vLLM 0.33 yet; 0.32.0 has the renamed import. Transformers 5.14.1 / tokenizers 0.22.2 are below vLLM 0.33's floors (>=5.16.1, >=0.23.2). 5.19.0 is the newest release inside both vLLM 0.33's range (<5.21) and Omni 0.32's (<5.20). All three pins are scoped to vllm.xpu; CUDA and CPU are unchanged. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
….0' into test/xpu-v0.33-heterog-plan
Signed-off-by: Aung San aka Mike <41126828+aung-san-i@users.noreply.github.com>
The merge of main dropped vllm.xpu.nixl_ucx_ref, so the XPU image fell back to the dynamo-wide nixl_ucx_ref v1.22.0. main builds XPU with UCX v1.23.0-rc1 next to NIXL 1.5.0 (args.Dockerfile reads the per-device value first), so keep that pairing here. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
….0' into test/xpu-v0.33-heterog-plan
…pu-v0.33-heterog-plan
…-v0.33-heterog-plan
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Test only. Do not merge. Close this PR once the results are in.
This branch runs PR #92's heterogeneous test matrix against the vLLM v0.33.0 XPU image from PR #96.
The head commit is:
ci/heterog-plan-section2-tests(PR ci(xpu-heterog): add six test-plan legs and re-enable Qwen3-VL-2B XPU tests #92) at589b5bf, which adds the new test legs and manifests;deps/xpu-vllm-v0.33.0(PR chore(xpu): bump vllm-openai-xpu to v0.33.0 #96) at4e437a2, which moves the XPU image to vLLM v0.33.0 with NIXL 1.5.0, vLLM-Omni 0.32.0 and Transformers 5.19.0.container/is identical to PR #96, and.ci/and.github/are identical to PR #92.Expected failures:
omni-ar-dit-2nodesandomni_ar-dit_1node_xpu. vLLM-Omni 0.32.0 importsFrontendArgsfromvllm.entrypoints.launchers.cli_args, which vLLM 0.33 moved tovllm.entrypoints.common.cli_args. No vLLM-Omni release for vLLM 0.33 exists yet (vllm-project/vllm-omni#9648 is a draft).🤖 Generated with Claude Code