Skip to content

docs: audit supported devices matrix and clarify support status #684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Adii-45 wants to merge 4 commits into
base: master
Choose a base branch
from
Open

docs: audit supported devices matrix and clarify support status #684

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
01dcd18
docs: audit supported devices matrix and clarify support status
Adii-45 Jul 29, 2026
8ca8888
docs: address review feedback for supported devices matrix
Adii-45 Jul 30, 2026
4a74834
docs: address review feedback for supported devices matrix
Adii-45 Jul 31, 2026
980f983
docs: add device guide references and clarify documentation scope
Adii-45 Aug 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
60 changes: 46 additions & 14 deletions docs/userguide/device-supported.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,18 +4,50 @@ title: Device supported by HAMi

The table below lists the devices supported by HAMi:

@maishivamhoo123 maishivamhoo123 Aug 1, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Adii-45 great start.
I want to point out a few things that are still missing

  1. No links to device setup guides or tracking issues.
  2. No HAMi version or last‑verification date .
  3. Limitations not mentioned.
    4.Missing device guide references.

@Adii-45 Adii-45 Aug 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed the remaining documentation feedback in the latest commit!

Changes made:

  • Added a release version statement for the device support matrix
  • Added references to the primary device guides for each supported device
  • Clarified that the linked guides include device-specific setup instructions, configuration notes, and known limitations/constraints

I intentionally did not add a "last verified" date because I couldn't find an existing verification convention or a reliable source of truth for that metadata anywhere in the repository. Rather than introducing information that could quickly become stale or inconsistent, I left that part out. I'm happy to add it if there's a preferred convention or source that the project follows..!

Please let me know if there's anything else you'd like me to update. Thanks!

@mesutoezdil mesutoezdil Aug 2, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed the remaining documentation feedback in the latest commit!

Changes made:

  • Added a release version statement for the device support matrix
  • Added references to the primary device guides for each supported device
  • Clarified that the linked guides include device-specific setup instructions, configuration notes, and known limitations/constraints

I intentionally did not add a "last verified" date because I couldn't find an existing verification convention or a reliable source of truth for that metadata anywhere in the repository. Rather than introducing information that could quickly become stale or inconsistent, I left that part out. I'm happy to add it if there's a preferred convention or source that the project follows..!

Please let me know if there's anything else you'd like me to update. Thanks!

Reminder: Answers must be written by human being. You can view the relevant rule here.
https://github.com/Project-HAMi/HAMi/blob/master/CONTRIBUTING.md#contribution-gates
"4. Review replies. The reply you post must be written by you and must address the specific point raised. Verbatim or canned AI replies, or replies that do not engage the comment, lead to the PR being closed."


This matrix reflects HAMi v2.9.0, the latest released version.

<!-- prettier-ignore -->
| Type | Manufacturer | Models | MemoryIsolation | CoreIsolation | MultiCard Support |
| ---- | ------------- | ----------------------- | --------------- | ------------- | ----------------- |
| GPU | NVIDIA | All | Yes | Yes | Yes |
| MLU | Cambricon | 370, 590 | Yes | Yes | No |
| DCU | Hygon | All | Yes | Yes | No |
| NPU | Huawei Ascend | 910B, 910B3, 910C, 310P | Yes | Yes | No |
| GPU | Iluvatar | All | Yes | Yes | No |
| GPU | Mthreads | MTT S4000 | Yes | Yes | No |
| GPU | MetaX | MXC500 | Yes | Yes | No |
| GCU | Enflame | S60 | Yes | Yes | No |
| XPU | Kunlunxin | P800 | Yes | Yes | No |
| GPU | Vastai | VA16 | Yes | Yes | No |
| GPU | Biren | Biren166M | Yes | Yes | No |
| DPU | Teco | Checking | In progress | In progress | No |
| Type | Manufacturer | Models | Status | MemoryIsolation | CoreIsolation | MultiCard Support |
| ------ | ------------- | ------------------------ | ----------------- | --------------- | ------------- | ----------------- |
| GPU | NVIDIA | All | Stable | Yes | Yes | Yes |
| MLU | Cambricon | 370, 590 | Stable | Yes | Yes | No |
| DCU | Hygon | All | Stable | Yes | Yes | No |
| NPU | Huawei Ascend | 910B, 910B3, 910C, 310P | Stable | Yes | Yes | No |
| GPU | Iluvatar | All | Stable | Yes | Yes | No |
| GPU | Mthreads | MTT S4000 | Stable | Yes | Yes | No |
| GPU | MetaX | MXC500 | Stable | Yes | Yes | No |
| GCU | Enflame | S60 | Stable | Yes | Yes | No |
| XPU | Kunlunxin | P800 | Stable | Yes | Yes | No |
| GPU | Vastai | VA16 | Stable | Yes | Yes | No |
| Neuron | AWS | Inf, Trn | Stable | No | No | Yes |
| GPU | Biren | Biren166M | Stable | Yes | Yes | No |
| DPU | Teco | Checking | Under Validation | No | No | No |

Support status:

- **Stable** - Available in the latest released HAMi version.
- **Experimental** - Implemented in HAMi but not yet included in a released version.
- **Under Validation** - Support is still being implemented; not yet functional.

Capability columns:

- **MemoryIsolation** - Whether HAMi enforces a hard VRAM limit per container: workloads that exceed their requested memory are rejected instead of drawing on the full physical device memory.
- **CoreIsolation** - Whether HAMi enforces a hard compute usage limit per container: kernel execution is throttled to stay within the requested share instead of using the physical device's compute freely.
- **MultiCard Support** - Whether a single Pod can request and be scheduled onto more than one physical card of that type, with HAMi coordinating placement across the selected cards.

## Device Guides

Each linked guide covers device-specific setup instructions, configuration notes, and known limitations and constraints; consult it before deploying that device.

@mesutoezdil mesutoezdil Aug 20, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

heads up: pr 806 renames this file to allocate-device-memory-usage. whoever merges second must update.

- **NVIDIA**: [Allocate device memory to container](nvidia-device/specify-device-memory-usage.md)
- **Cambricon**: [Enable Cambricon MLU Sharing](cambricon-device/enable-cambricon-mlu-sharing.md)
- **Hygon**: [Enable Hygon DCU sharing](hygon-device/enable-hygon-dcu-sharing.md)
- **Huawei Ascend**: [Enable Huawei Ascend sharing](ascend-device/enable-ascend-sharing.md)
- **Iluvatar**: [Enable Iluvatar GPU Sharing](iluvatar-device/enable-iluvatar-gpu-sharing.md)
- **Mthreads**: [Enable Mthreads GPU sharing](mthreads-device/enable-mthreads-gpu-sharing.md)
- **MetaX**: [Enable MetaX GPU sharing](metax-device/metax-sgpu/enable-metax-gpu-sharing.md)
- **Enflame**: [Enable Enflame GCU Sharing](enflame-device/enable-enflame-gcu-sharing.md)
- **Kunlunxin**: [Enable Kunlunxin GPU Topology-Aware Scheduling](kunlunxin-device/enable-kunlunxin-schedule.md)
- **Vastai**: [Enable Vastai Sharing](vastai/enable-vastai-sharing.md)
- **AWS Neuron**: [Enable AWS-Neuron device Sharing](awsneuron-device/enable-awsneuron-managing.md)
- **Biren**: [Enable Biren Sharing](biren-device/enable-biren-sharing.md)
4 changes: 4 additions & 0 deletions i18n/zh/docusaurus-plugin-content-docs/current.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,10 @@
"message": "管理 AWS Neuron 设备",
"description": "The label for category 'Managing AWS Neuron devices' in sidebar 'docs'"
},
"sidebar.docs.category.Managing Biren devices": {
"message": "管理壁仞设备",
"description": "The label for category 'Managing Biren devices' in sidebar 'docs'"
},
"sidebar.docs.category.Managing Vastai devices": {
"message": "管理 Vastai 设备",
"description": "The label for category 'Managing Vastai devices' in sidebar 'docs'"
Expand Down
59 changes: 46 additions & 13 deletions i18n/zh/docusaurus-plugin-content-docs/current/userguide/device-supported.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,17 +5,50 @@ translated: true

HAMi 支持的设备如下表所示：

本表反映的是 HAMi 最新发布版本 v2.9.0。

<!-- prettier-ignore -->
| 设备类型 | 制造商 | 支持型号 | 显存隔离 | 核心隔离 | 多卡支持 |
| -------- | ------------------------- | --------------------------- | -------- | -------- | -------- |
| GPU | 英伟达（NVIDIA） | 全系列 | 是 | 是 | 是 |
| MLU | 寒武纪（Cambricon） | 370、590 | 是 | 是 | 否 |
| DCU | 海光（Hygon） | 全系列 | 是 | 是 | 否 |
| NPU | 华为昇腾（Huawei Ascend） | 910B、910B3、910C、310P | 是 | 是 | 否 |
| GPU | 天数智芯（Iluvatar） | 全部 | 是 | 是 | 否 |
| GPU | 摩尔线程（Mthreads） | MTT S4000 | 是 | 是 | 否 |
| GPU | 沐曦（MetaX） | MXC500 | 是 | 是 | 否 |
| GCU | 燧原科技（Enflame） | S60 | 是 | 是 | 否 |
| XPU | 昆仑芯（Kunlunxin） | P800 | 是 | 是 | 否 |
| GPU | 瀚博（Vastai） | VA16 | 是 | 是 | 否 |
| DPU | 太初元碁（Teco） | 检查中 | 进行中 | 进行中 | 否 |
| 设备类型 | 制造商 | 支持型号 | 状态 | 显存隔离 | 核心隔离 | 多卡支持 |
| ---------- | ------------------------- | --------------------------- | ------------ | -------- | -------- | -------- |
| GPU | 英伟达（NVIDIA） | 全系列 | 稳定 | 是 | 是 | 是 |
| MLU | 寒武纪（Cambricon） | 370、590 | 稳定 | 是 | 是 | 否 |
| DCU | 海光（Hygon） | 全系列 | 稳定 | 是 | 是 | 否 |
| NPU | 华为昇腾（Huawei Ascend） | 910B、910B3、910C、310P | 稳定 | 是 | 是 | 否 |
| GPU | 天数智芯（Iluvatar） | 全部 | 稳定 | 是 | 是 | 否 |
| GPU | 摩尔线程（Mthreads） | MTT S4000 | 稳定 | 是 | 是 | 否 |
| GPU | 沐曦（MetaX） | MXC500 | 稳定 | 是 | 是 | 否 |
| GCU | 燧原科技（Enflame） | S60 | 稳定 | 是 | 是 | 否 |
| XPU | 昆仑芯（Kunlunxin） | P800 | 稳定 | 是 | 是 | 否 |
| GPU | 瀚博（Vastai） | VA16 | 稳定 | 是 | 是 | 否 |
| Neuron | AWS | Inf、Trn | 稳定 | 否 | 否 | 是 |
| GPU | 壁仞（Biren） | Biren166M | 稳定 | 是 | 是 | 否 |
| DPU | 太初元碁（Teco） | 检查中 | 验证中 | 否 | 否 | 否 |

支持状态：

- **稳定（Stable）** - 已在最新发布版本中提供。
- **实验性（Experimental）** - 已在 HAMi 中实现，但尚未包含在正式发布版本中。
- **验证中（Under Validation）** - 支持仍在实现中，尚不可用。

能力列：

- **显存隔离（MemoryIsolation）** - 是否为每个容器强制执行显存硬限制：超出请求显存的工作负载会被拒绝，而不能使用整块物理设备显存。
- **核心隔离（CoreIsolation）** - 是否为每个容器强制执行算力硬限制：内核执行会被限流以保持在请求的份额内，而不能自由使用物理设备的算力。
- **多卡支持（MultiCard Support）** - 单个 Pod 是否可以请求并调度到该类型的多张物理卡，由 HAMi 协调所选卡之间的分配。

## 设备指南

每份指南均包含该设备的具体搭建步骤、配置说明以及已知限制和约束条件；部署该设备前请先查阅对应指南。

- **NVIDIA**：[为容器分配设备显存](nvidia-device/specify-device-memory-usage.md)
- **寒武纪（Cambricon）**：[启用寒武纪 MLU 共享](cambricon-device/enable-cambricon-mlu-sharing.md)
- **海光（Hygon）**：[启用 Hygon DCU 共享](hygon-device/enable-hygon-dcu-sharing.md)
- **华为昇腾（Huawei Ascend）**：[启用 Huawei Ascend 共享](ascend-device/enable-ascend-sharing.md)
- **天数智芯（Iluvatar）**：[启用天数智芯 GPU 共享](iluvatar-device/enable-iluvatar-gpu-sharing.md)
- **摩尔线程（Mthreads）**：[启用 Mthreads GPU 共享](mthreads-device/enable-mthreads-gpu-sharing.md)
- **沐曦（MetaX）**：[启用沐曦 GPU 共享](metax-device/metax-sgpu/enable-metax-gpu-sharing.md)

@mesutoezdil mesutoezdil Aug 20, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

enflame is a gcu, not gpu. use 启用燧原 GCU 共享.

- **燧原科技（Enflame）**：[启用燧原 GPU 共享](enflame-device/enable-enflame-gcu-sharing.md)
- **昆仑芯（Kunlunxin）**：[启用昆仑芯 GPU 拓扑感知调度](kunlunxin-device/enable-kunlunxin-schedule.md)
- **瀚博（Vastai）**：[启用瀚博半导体设备共享](vastai/enable-vastai-sharing.md)
- **AWS Neuron**：[启用 AWS-Neuron 设备共享](awsneuron-device/enable-awsneuron-managing.md)
- **壁仞（Biren）**：[启用壁仞设备共享](biren-device/enable-biren-sharing.md)