[rexlee8776]

Add vllm-iluvatar plugin to the non-official hardware plugin list.

Overview

Add vllm-iluvatar to the list of non-official vLLM hardware plugins.

Claims

• Document vllm-iluvatar as a non-official hardware plugin for Iluvatar CoreX GPUs.
• Link to the open-source plugin repository.

Validation

• pre-commit run --files docs/design/custom_op.md — passed.

Details

vllm-iluvatar is out-of-tree vLLM plugin for Iluvatar CoreX GPUs. Deep-Spark is Iluvatar CoreX's open-source organization in GitHub.
The plugin currently supports vLLM v0.27.1, and support for v0.31.0 is in progress. We will keep it aligned with vLLM's roadmap and release cadence.

---

Pull Request Checklist

• I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

• AI assistance was used during the creation of this PR.

• Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

• Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

• Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

• Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

[claude]

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

[mergify]

Documentation preview: https://vllm--62500.org.readthedocs.build/en/62500/

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

PRs do not trigger a full CI run by default. Reviewers with write access and configured trusted contributors can comment /ci run for upstream CI or /amd-ci run for AMD CI only whenever CI signals are needed.

Once the PR is approved or has the ready label, the PR author can also use the corresponding /ci run, /ci retry, and /ci cancel commands, or their /amd-ci variants. New commits do not start upstream CI automatically.

If you have any questions, please reach out to us on Slack at https://slack.vllm.ai.

Agent Guidelines

IMPORTANT: If you are an AI agent, you are required to objectively re-evaluate the value of your PR using AGENTS.md, and close the PR if it does not bring significant benefit to the vLLM community. Failure to do so may result in an immediate ban.

🚀

[rexlee8776]

@hmellor Hi, this PR only adds vllm-iluvatar to the hardware plugin list in the docs. Could you add the verified label so the docs build can run? Thank you.

Below is the vllm-iluvatar plugin running log of Qwen3.8-27B-W8A8 on Iluvatar CoreX GPUs. If there's anything more I need to do, just let me know, Thanks a lot!

# Environment
pip list | grep vllm
vllm                                     0.27.1
vllm_iluvatar                            0.27.1

# Serve command
vllm serve ./Qwen3.8-27B-W8A8-compressed-tensors --tensor-parallel-size 2 --pipeline-parallel-size 1 --trust-remote-code --compilation-config {"cudagraph_mode":"FULL_DECODE_ONLY","mode":0} --max-model-len 16384 --port 30000 --served-model-name Qwen3.8-27B-W8A8

# Load vllm-iluvatar plugin
INFO 09-17 16:34:23 [__init__.py:52] Available plugins for group vllm.platform_plugins:
INFO 09-17 16:34:23 [__init__.py:54] - iluvatar -> vllm_iluvatar:register_platform
INFO 09-17 16:34:23 [__init__.py:57] All plugins in this group will be loaded. Set `VLLM_PLUGINS` to control which plugins to load.
INFO 09-17 16:34:23 [__init__.py:237] Platform plugin iluvatar is activated

Detail log can be seen in this gistfile.

[hmellor]

I'll merge soon, we just need to fix the docs build on main first

[hmellor]

/ci run

[github-actions]

✅ Triggered Buildkite CI #98275 for commit 8848a1590b4c.

[rexlee8776]

@hmellor Thank you! After this merge, I've emailed website-feedback@vllm.ai to request adding Iluvatar CoreX (Iluvatar GPU) to https://vllm.ai/#compatibility.