Repository navigation
[XPU] update docs intel xpu for docker and baremetal usage - #23
Merged
Merged
Conversation
Collaborator
Author
|
This Dockerfile / pr version represent vllm0.29.0 and runnable with FSDP1, FSDP2 |
…ocker / from-source options Checked on 1x Arc Pro B60 (verl 5b550b0c, this plugin e5ab532, vLLM 0.29.0+xpu), in an image and in a fresh venv, with system oneAPI present and hidden. - install_guidance: system oneAPI is not required (torch/vLLM wheels bring their own SYCL runtime and oneCCL); document the Level Zero driver prerequisite; add Docker (docker/xpu in verl-core) and from-source options; warn that `pip install -e .` on verl can replace the XPU torch; VERL_PLATFORM is an override, auto-detection already selects intel once the plugin is installed. - quick_start: the GRPO command failed on verl main (needs ppo_micro_batch_size_per_gpu and the log_prob micro batch sizes) and ran ~467 steps instead of the described single step; add the batch-size overrides and total_training_steps=1, align ZE_AFFINITY_MASK with the 1-GPU command, and replace the stale throughput numbers with measured ones (2-GPU number flagged as not re-measured). - README: list patches/ray_device_pin_patch.py, link the Docker image. - profiling: the plugin is auto-discovered in Ray workers; VERL_USE_EXTERNAL_MODULES is not needed.
…ick start - install_guidance.md: Option A shows the docker build/run commands; Option B lists the exact dependency install (the one the Docker image runs) instead of linking to verl-core files that do not exist yet, plus the host packages it needs (g++, libnuma-dev, libze-dev, ffmpeg). Mention pip >= 26.2.2, uv >= 0.13.4 and certifi >= 2026.10.19. - quick_start.md: run two steps so the "step 1 / step 2" figures can be reproduced; replace the benchmark numbers with ones re-measured on the current stack (1 and 2 GPUs, batch 16); fix the "2-GPU run below" reference; note the multi-node status. - README.md: drop the link to a verl-core directory that is not on main.
…rfile (verl#8401) Update versions (vLLM 0.32.0, torch 2.14.0, transformers from verl's window), image tag, driver stack and oneCCL TMP_BUF variables, and link the Dockerfile in verl-core.
…n libraries Checked on a bare ubuntu:24.04 job with one B60: the Option B commands install the same versions as the image and platform detection works, but an xccl all_reduce crashes in oneCCL plugin loading until LD_LIBRARY_PATH=/opt/venv/lib:/usr/local/lib is set.
Remove the step-time, throughput and memory numbers (and the run dates and stack versions they came from) from the expected output and the feature matrix. They depend on the GPU and the software stack and go stale; the launch commands and what a successful run looks like stay.
kahlun
force-pushed
the
feature/xpu-docker
branch
from
November 4, 2026 08:22
9eae17b to
b48f49f
Compare
kahlun
marked this pull request as ready for review
November 4, 2026 08:27
kahlun
requested review from
heavyrain-lzy and
physics31415926
as code owners
November 4, 2026 08:27
kahlun
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Added the docs or polish the docs on verl hardware plugin. will points the verl doc to here until further plan
Motivation
the docs in the verl hardware plugin did not polish after verl side added the dockerfile that utilize the plugin for intel gpu
Changes