Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion blog/hami-cncf-incubating/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ This is an important milestone following HAMi joining the CNCF as a Sandbox proj

Our sincere thanks to CNCF TOC Chair [Karena Angell](https://www.linkedin.com/feed/update/urn:li:activity:7478594903292399616/), who led the due diligence, TOC member Kevin Wang, TAG-Runtime for its technical review, and all the adopters who shared their insights.

HAMi is a heterogeneous compute virtualization and scheduling middleware for Kubernetes. Through container-level hard isolation, it finely partitions GPU memory and compute so that multiple workloads can safely share a single accelerator. Founded by maintainers [Xiao Zhang](https://github.com/wawa0210) and [Mengxuan Li](https://github.com/archlitchi), it is built by developers worldwide under CNCF governance.
HAMi is a heterogeneous compute virtualization and scheduling middleware for Kubernetes. Without changing the GPU driver or the application, it virtualizes the GPU at the software layer through CUDA API interception (HAMi-core), finely partitioning GPU memory and compute so that multiple workloads can safely share a single accelerator. Founded by maintainers [Xiao Zhang](https://github.com/wawa0210) and [Mengxuan Li](https://github.com/archlitchi), it is built by developers worldwide under CNCF governance.

Today, HAMi is used by hundreds of organizations across a dozen-plus accelerators including NVIDIA, Ascend, Cambricon, Hygon, Moore Threads, Enflame, Kunlunxin, MetaX, AWS Neuron, and Vastai (see the [supported device list](/docs/userguide/device-supported)). [CNCF case studies](/case-studies) document production practices at China Merchants Bank, SNOW Corp., NIO, KE Holdings, DaoCloud, SF Technology, and PREP EDU, spanning finance, automotive, mobility, logistics, education, and cloud services. HAMi-core integrates with the Kubernetes default scheduler, [Volcano](https://github.com/volcano-sh/volcano/blob/master/docs/user-guide/how_to_use_gpu_sharing.md), [Kueue](https://github.com/kubernetes-sigs/kueue), [Koordinator](https://koordinator.sh/docs/user-manuals/device-scheduling-gpu-share-with-hami), and the [KAI Scheduler](/blog/hami-core-adopted-by-nvidia-kai-scheduler).

Expand Down
2 changes: 1 addition & 1 deletion blog/hami-core-adopted-by-nvidia-kai-scheduler/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ This is exactly where HAMi's core capability lives.

## What is HAMi?

HAMi is a CNCF Sandbox project focused on heterogeneous AI compute virtualization middleware. Its core capability is container-level hard isolation of GPU memory and compute, through a CUDA interception library (HAMi-core).
HAMi is a CNCF Sandbox project focused on heterogeneous AI compute virtualization middleware. Its core capability is enforcing GPU memory and compute limits at the CUDA API layer through a CUDA interception library (HAMi-core), so a workload cannot oversubscribe its allocated share.

A simple way to understand HAMi's position:

Expand Down
133 changes: 133 additions & 0 deletions blog/lfx-mentorship-2026-term-3/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,133 @@
---
title: "LFX Mentorship 2026 Term 3: Four Open-Source GPU Sharing Projects Open for Applications"
date: "2026-08-03"
description: "HAMi joins the Linux Foundation LFX Mentorship 2026 Term 3 (September to November). Mentee applications are open August 3 to August 18. Here is a guide to the four projects, mentors, timeline, and how to apply."
authors: [hami_community]
tags: ["LFX", "Mentorship", "CNCF", "Community"]
---
Comment on lines +1 to +7

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟠 Major | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== git status short =="
git status --short

echo "== target file =="
git ls-files | rg '(^|/)blog/.*\.mdx?$|lfx-mentorship-2026-term-3' || true

echo "== directory files =="
fd -a 'index\.mdx?$' . | rg 'blog/.*/index\.(md|mdx)$' | sed -n '1,200p'

echo "== sample blog dirs =="
git ls-files 'blog/*' | sed 's#/.*$##' | sort -u | sed -n '1,200p'

echo "== target contents frontmatter and key links =="
if [ -f blog/lfx-mentorship-2026-term-3/index.md ]; then
  sed -n '1,180p' blog/lfx-mentorship-2026-term-3/index.md
fi

echo "== related zh paths =="
git ls-files | rg '(^|/)blog/lfx-mentorship-2026-term-3/.*|lfx-mentorship-2026-term-3' || true

Repository: Project-HAMi/website

Length of output: 20547


🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== config files =="
git ls-files | rg '(^|/)(docusaurus\.config\.(js|mjs|ts)\.?|package\.json|README\.md|redirects|i18n/zh/docusaurus-plugin-content-blog/)' | sed -n '1,200p'

echo "== docusaurus config excerpts =="
for f in $(git ls-files 'docusaurus.config.*' | head -20); do
  echo "--- $f ---"
  sed -n '1,240p' "$f"
done

echo "== redirects refs =="
rg -n "redirect|redirects|lfx-mentorship-2026-term-3|/blog/" docusaurus.config.* i18n/zh/docusaurus-plugin-content-blog/blog/** i18n/zh/docusaurus-plugin-content-blog/lfx-mentorship-2026-term-3 2>/dev/null || true

Repository: Project-HAMi/website

Length of output: 12662


Rename the blog directories to the dated convention.

blog/lfx-mentorship-2026-term-3/index.md and i18n/zh/docusaurus-plugin-content-blog/lfx-mentorship-2026-term-3/index.md currently follow the repository’s non-dated blog directories, but the blog guideline requires YYYY-MM-DD-title/index.md. Rename both directories to blog/2026-08-03-lfx-mentorship-2026-term-3 and i18n/zh/docusaurus-plugin-content-blog/2026-08-03-lfx-mentorship-2026-term-3, then add redirects for both localized routes to preserve existing links.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@blog/lfx-mentorship-2026-term-3/index.md` around lines 1 - 7, Rename the
English and Chinese blog directories to the dated YYYY-MM-DD-title convention
using 2026-08-03-lfx-mentorship-2026-term-3, and add redirects from both
existing localized routes to their renamed destinations. Preserve the article
content and front matter while ensuring old links continue resolving.

Sources: Coding guidelines, Learnings


The **Linux Foundation LFX Mentorship Program** 2026 Term 3 is live, and **HAMi** is mentoring four open-source projects from September to November 2026.

Mentee applications open **August 3, 2026** and close **August 18, 2026**. Whether your interest is low-level C/C++ performance, GPU observability, container isolation security, or developer education, there is a project for you.

<!-- truncate -->

## What is the LFX Mentorship Program?

The LFX Mentorship Program is a Linux Foundation open-source mentorship initiative. Over a three-month term, accepted contributors work one-on-one with project maintainers on a defined deliverable. Selected mentees may receive a stipend from the LFX Mentorship Program (an educational grant; amount and disbursement are the organizer's responsibility, not the HAMi community's — see the FAQ below), plus hands-on production experience and a public contribution record in a CNCF community.

Each HAMi project in Term 3 represents roughly **350 hours** of work over the 12-week mentorship.

## Why HAMi?

HAMi is a CNCF Incubating project and the heterogeneous compute virtualization and scheduling middleware for Kubernetes. Without changing the GPU driver or the application, it virtualizes the GPU at the software layer through CUDA API interception (HAMi-Core, the `libvgpu.so` library injected into the container), partitioning GPU memory and compute so that multiple workloads safely share a single accelerator. It is used in production by hundreds of organizations across more than a dozen accelerator types, integrates with the Kubernetes default scheduler, Volcano, Kueue, Koordinator, and the NVIDIA KAI Scheduler, and is built by a global community of nearly 500 contributors.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔒 Security & Privacy | 🟠 Major | ⚡ Quick win

Qualify the GPU isolation guarantee in both locale pages.

Both Line 23 statements say that workloads “safely” share one accelerator. Both articles state at Line 47 that child, SSH, and new-shell processes may not retain the expected GPU memory limit. Replace the unqualified guarantee with a bounded statement or disclose this limitation near the overview.

  • blog/lfx-mentorship-2026-term-3/index.md#L23-L23: qualify “safely share”.
  • i18n/zh/docusaurus-plugin-content-blog/lfx-mentorship-2026-term-3/index.md#L23-L23: qualify “安全共享”.
📍 Affects 2 files
  • blog/lfx-mentorship-2026-term-3/index.md#L23-L23 (this comment)
  • i18n/zh/docusaurus-plugin-content-blog/lfx-mentorship-2026-term-3/index.md#L23-L23
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@blog/lfx-mentorship-2026-term-3/index.md` at line 23, Qualify the GPU
isolation claim at blog/lfx-mentorship-2026-term-3/index.md lines 23-23 by
replacing “safely share” with a bounded statement or adding the documented
process-inheritance limitation near the overview. Apply the equivalent
qualification to “安全共享” at
i18n/zh/docusaurus-plugin-content-blog/lfx-mentorship-2026-term-3/index.md lines
23-23, keeping both locale pages consistent.


Joining HAMi means doing open source at the center of the AI infrastructure wave.

## The Four Term 3 Projects

### 1. HAMi GPU Sharing Workshop and Documentation

- Upstream issue: [Project-HAMi/website#656](https://github.com/Project-HAMi/website/issues/656)
- LFX page: [HAMi GPU Sharing Workshop and Documentation](https://mentorship.lfx.linuxfoundation.org/project/ab5693b7-9759-48e2-b609-f48af6b82206)
- Stack: Kubernetes, HAMi, Markdown, Docusaurus
- Skills: Technical writing, documentation testing, troubleshooting, GitHub workflow
- Mentors: Reza Jelveh ([@fishman](https://github.com/fishman)), Jimmy Song ([@rootsongjc](https://github.com/rootsongjc))

This project creates practical, reproducible learning materials that help users and new contributors deploy HAMi, understand GPU sharing, and troubleshoot common installation, scheduling, and allocation problems. Expected outcomes include hands-on workshop labs for HAMi GPU sharing, examples for AI inference workloads such as vLLM, Ray, or SGLang, troubleshooting guides, tested manifests with verification steps, and at least one contribution to the HAMi website or another mentor-approved HAMi repository.

### 2. Fix GPU Memory Isolation for Child and SSH Processes

- Upstream issue: [Project-HAMi/HAMi#2125](https://github.com/Project-HAMi/HAMi/issues/2125)
- LFX page: [Fix GPU Memory Isolation for Child and SSH Processes](https://mentorship.lfx.linuxfoundation.org/project/e5e55e8c-fab1-4453-9d49-a4a5e013c4c5)
- Stack: Kubernetes, Linux containers, NVIDIA GPU, HAMi-core
- Skills: Linux debugging, container runtime analysis, security reasoning, C/C++, testing
- Mentors: Mengxuan Li ([@archlitchi](https://github.com/archlitchi)), Jimmy Song ([@rootsongjc](https://github.com/rootsongjc))

Processes started later inside a HAMi-managed container, including child processes and processes reached through SSH or a new login shell, may not retain the expected GPU memory limit. This project investigates and fixes that isolation boundary. Expected outcomes include a reproducible test case and documented root cause, a maintainer-reviewed design covering the intended isolation boundary, compatibility, and failure modes, a maintainer-approved implementation (or a validated design or prototype when platform constraints limit delivery), regression tests covering the original process, child process, SSH, and new-shell scenarios, plus configuration and migration documentation.

### 3. Reduce HAMi-core Initialization Lock Contention

- Upstream issue: [Project-HAMi/HAMi#1662](https://github.com/Project-HAMi/HAMi/issues/1662)
- LFX page: [Reduce HAMi-core Initialization Lock Contention](https://mentorship.lfx.linuxfoundation.org/project/ce2ebae3-6936-409d-a9d7-c98b109ec814)
- Stack: C/C++, Linux, CUDA, NVML, HAMi-core
- Skills: Linux concurrency, performance profiling, benchmarking, synchronization design, testing
- Mentors: Mengxuan Li ([@archlitchi](https://github.com/archlitchi)), Shouren Yang ([@Shouren](https://github.com/Shouren))

When hundreds of processes initialize CUDA concurrently and compete for the shared unified lock, HAMi-core startup performance degrades noticeably. This project reduces initialization latency and contention while preserving correctness. Expected outcomes include a reproducible benchmark for concurrent HAMi-core initialization, a maintainer-approved locking design, an implementation with concurrency and regression tests, performance measurements of startup latency, throughput, and relevant resource usage, plus design and operational-impact documentation.

### 4. HAMi GPU Observability: Metrics and Dashboards

- Upstream issue: [Project-HAMi/HAMi#2126](https://github.com/Project-HAMi/HAMi/issues/2126)
- LFX page: [HAMi GPU Observability: Metrics and Dashboards](https://mentorship.lfx.linuxfoundation.org/project/dd302799-03ec-4184-b289-4d59a41fe7ed)
- Stack: Prometheus, Grafana, OpenTelemetry, Kubernetes, Go, HAMi
- Skills: Metrics instrumentation, PromQL, dashboard design, observability, Kubernetes debugging, HAMi internals
- Mentors: Mesut Oezdil ([@mesutoezdil](https://github.com/mesutoezdil)), Reza Jelveh ([@fishman](https://github.com/fishman)), Jimmy Song ([@rootsongjc](https://github.com/rootsongjc))

This project improves the usefulness, consistency, and documentation of HAMi GPU observability for operators running shared GPU workloads. The focus is on practical metrics and dashboards, while keeping tracing work bounded to a design and proof of concept for one mentor-approved control-plane path. Expected outcomes include a gap analysis of current HAMi metrics, exporters, labels, dashboards, and documentation, maintainer-reviewed improvements to Prometheus metrics and labels across the device plugin and scheduler extension, a versioned Grafana dashboard, documentation covering metric semantics, units, labels, cardinality, and example PromQL, an OpenTelemetry trace design and bounded proof of concept for one selected workflow, practical alerting or SLO guidance, and at least one reviewed and merged contribution involving metrics, dashboards, tests, or documentation.

## Mentor Team

The four projects are guided by five HAMi maintainers:

- **Mengxuan Li** ([@archlitchi](https://github.com/archlitchi))
- **Jimmy Song** ([@rootsongjc](https://github.com/rootsongjc))
- **Shouren Yang** ([@Shouren](https://github.com/Shouren))
- **Mesut Oezdil** ([@mesutoezdil](https://github.com/mesutoezdil))
- **Reza Jelveh** ([@fishman](https://github.com/fishman))

Each project has at least one technical mentor and one community mentor, covering architecture and code review as well as onboarding and CNCF workflow guidance.

## Timeline

| Phase | Dates |
| ----------------------------- | ------------------------------------ |
| Project proposals (completed) | July 1 to July 28, 2026 |
| **Mentee applications** | **August 3 to August 18, 2026** |
| Application review | August 19 to September 1, 2026 |
| **Mentorship period** | **September 7 to November 27, 2026** |

The 12-week mentorship breaks into three phases:

- **Month 1 (September): onboarding.** Understand HAMi architecture and community workflow, set up your environment, open a first issue, and aim to get it merged.
- **Month 2 (October): main implementation.** Drive the core work, join community discussions, and share progress in meetings or on Slack.
- **Month 3 (November): delivery.** Finish deliverables, add documentation, and present results to the community.

## How to Apply

Applications go through the LFX platform. Materials to prepare (see each project's LFX page for specifics):

1. Resume
2. Cover letter
3. School enrollment verification (or equivalent)
4. Participation permission from school or employer
5. Coding challenge
6. A project-specific custom prerequisite (requires file submission)

Suggested steps:

1. Create an account on the [LFX Mentorship platform](https://mentorship.lfx.linuxfoundation.org/).
2. Review the four projects above, pick the one that best matches your skills and interests, and open its LFX page.
3. Submit all materials and complete the coding challenge before the **August 18** deadline.
4. Wait for review results (**August 19 to September 1**).

## FAQ

**Can I apply for more than one project?** We recommend focusing on the one that best matches your skills and interests, and investing in a high-quality application.

**Do I need to be a student?** No. LFX is open to a broad range of contributors, but you will need to provide school enrollment verification or an employer participation permission, per platform requirements.

**What is the stipend amount?** The stipend is administered by the LFX Mentorship Program (run by the Linux Foundation, funded by the Linux Foundation, Intel, and others). It is an educational grant, not wages. Under the Fairer Stipend Model, it is calculated by Purchasing Power Parity (PPP) and ranges from 1,000 to 6,600 USD depending on the mentee's country of residence, paid in two installments after the midterm evaluation (October 21) and the final evaluation (November 25). Amount determination and disbursement are the organizer's responsibility, not the HAMi community's. See the [Linux Foundation announcement](https://www.linuxfoundation.org/blog/strengthening-lfx-mentoring-a-fairer-stipend-model-and-a-shared-standard-of-excellence) for details.

**Can I apply without prior HAMi experience?** Yes. Familiarizing yourself with the [HAMi GitHub](https://github.com/Project-HAMi/HAMi) codebase and tackling a good-first-issue beforehand will make your application more competitive.

## Get Started

The application deadline is **August 18, 2026**, so time is short. Pick your project now:

- LFX application pages for all four projects are in their sections above
- HAMi repository: [Project-HAMi/HAMi](https://github.com/Project-HAMi/HAMi)
- Join the HAMi Discord: [discord.gg/Amhy7XmbNq](https://discord.gg/Amhy7XmbNq)
- More community channels: [HAMi community](/community)

We look forward to doing open source with you in Term 3.
2 changes: 1 addition & 1 deletion blog/vllm-meetup-shanghai-2026-recap/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ description: "On July 16, 2026, Li Mengxuan, Co-founder & CTO of Dynamia and HAM
image: /img/vllm-meetup-shanghai-2026-recap/title.webp
tags:
[
"vLLM",
{ label: "vLLM", permalink: "vllm" },
"GPU Virtualization",
"PD Disaggregation",
"LLM-D",
Expand Down
24 changes: 17 additions & 7 deletions docusaurus.config.js
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,22 @@ const defaultLocale = "en";
const siteUrl = (process.env.DOCUSAURUS_SITE_URL || "https://project-hami.io").replace(/\/$/, "");
const githubEditBaseUrl = "https://github.com/Project-HAMi/website/edit/master/";

// Site-wide announcement bar switch. Flip to true to show it; keep `id` stable
// so visitors who dismissed a previous announcement stay dismissed (bump `id`
// only when you publish a genuinely new announcement you want everyone to see).
const announcementBarEnabled = false;
const announcementBar = announcementBarEnabled
? {
id: "announcement-bar",
// `content` is a translation key resolved per-locale from
// i18n/<locale>/docusaurus-theme-classic/announcementBar.json
content: "community",
backgroundColor: "#20232a",
textColor: "#ffffff",
isCloseable: true,
}
: undefined;

function getDocEditUrl(versionDocsDirPath, docPath) {
return `${githubEditBaseUrl}${[versionDocsDirPath, docPath].filter(Boolean).join("/")}`;
}
Expand Down Expand Up @@ -293,13 +309,7 @@ module.exports = {
defaultMode: "dark",
respectPrefersColorScheme: false,
},
announcementBar: {
id: "kubecon_japan_2026",
content: "kubecon_japan_2026",
backgroundColor: "#20232a",
textColor: "#ffffff",
isCloseable: true,
},
announcementBar,
navbar: {
title: "HAMi",
logo: {
Expand Down
3 changes: 1 addition & 2 deletions i18n/en/docusaurus-theme-classic/announcementBar.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
{
"kubecon_india_2026": "🇮🇳 Meet the HAMi team at <strong>KubeCon + CloudNativeCon India 2026</strong>! Visit us at <strong>Booth T-10</strong> in the Project Pavilion (Jasmine Hall 1, Level 3) on <strong>June 18, 3:30–7:30 PM IST</strong>. <a href=\"https://events.linuxfoundation.org/kubecon-cloudnativecon-india/\" style=\"text-decoration:underline;color:#66b2ff\">Learn more →</a>",
"kubecon_japan_2026": "🇯🇵 Meet HAMi at <strong>KubeCon + CloudNativeCon Japan 2026</strong> in Yokohama, Jul 28–30. Find us at <strong>Booth T-6</strong>, Project Pavilion (Pacifico Yokohama 3F). <a href=\"https://events.linuxfoundation.org/kubecon-cloudnativecon-japan/program/schedule/\" style=\"text-decoration:underline;color:#66b2ff\">View schedule →</a>",
"community": "Join the HAMi community on <a href=\"https://discord.gg/Amhy7XmbNq\" style=\"text-decoration:underline;color:#66b2ff\">Discord</a>",
"theme.announcementBar.message": ""
}
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ tags: ["CNCF", "Incubating"]

衷心感谢主导本次尽职调查的 CNCF TOC 主席 [Karena Angell](https://www.linkedin.com/feed/update/urn:li:activity:7478594903292399616/) 与 TOC 成员王泽峰(Kevin Wang),为项目完成技术评审的 TAG-Runtime,以及所有提供反馈的采用者。

HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,通过容器级硬隔离精细切分 GPU 显存与算力,让多个工作负载安全共享同一张加速器。项目由 [张潇](https://github.com/wawa0210)、[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。
HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,不改驱动、不改应用,通过 CUDA API 劫持(HAMi-core)在软件层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一张加速器。项目由 [张潇](https://github.com/wawa0210)、[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

Use a valid measure word for 加速器.

一张加速器 is not idiomatic Chinese. Replace it with 一个加速器 or 一块加速卡.

Proposed fix
-HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,不改驱动、不改应用,通过 CUDA API 劫持(HAMi-core)在软件层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一张加速器。项目由 [张潇](https://github.com/wawa0210)、[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。
+HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,不改驱动、不改应用,通过 CUDA API 劫持(HAMi-core)在软件层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一个加速器。项目由 [张潇](https://github.com/wawa0210)、[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,不改驱动、不改应用,通过 CUDA API 劫持(HAMi-core)在软件层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一张加速器。项目由 [张潇](https://github.com/wawa0210)[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。
HAMi 是面向 Kubernetes 的异构算力虚拟化与调度中间件,不改驱动、不改应用,通过 CUDA API 劫持(HAMi-core)在软件层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一个加速器。项目由 [张潇](https://github.com/wawa0210)[李孟轩](https://github.com/archlitchi) 等维护者发起,在 CNCF 治理下由全球开发者共建。
🧰 Tools
🪛 LanguageTool

[uncategorized] ~17-~17: “张” 不能与 “加速器” 搭配,请更换量词。
Context: ...层实现 GPU 虚拟化,精细切分 GPU 显存与算力,让多个工作负载安全共享同一张加速器。项目由 张潇、[...

(wa5)

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@i18n/zh/docusaurus-plugin-content-blog/hami-cncf-incubating/index.md` at line
17, 将项目简介中的“多个工作负载安全共享同一张加速器”改为使用有效量词的表达,替换为“一个加速器”或“一块加速卡”,并保持其余内容不变。

Source: Linters/SAST tools


今天,HAMi 已被数百家组织采用,覆盖 NVIDIA、昇腾、寒武纪、海光、摩尔线程、燧原、昆仑芯、MetaX、AWS Neuron、Vastai 等十余种加速器(见[支持设备列表](/docs/userguide/device-supported)),并以 [CNCF 案例研究](/zh/case-studies)的形式记录了招商银行、SNOW Corp.、蔚来、贝壳、DaoCloud、顺丰科技、PREP EDU 等的落地实践,横跨金融、汽车、出行、物流、教育与云服务。HAMi-core 已与 Kubernetes 默认调度器、[Volcano](https://github.com/volcano-sh/volcano/blob/master/docs/user-guide/how_to_use_gpu_sharing.md)、[Kueue](https://github.com/kubernetes-sigs/kueue)、[Koordinator](https://koordinator.sh/docs/user-manuals/device-scheduling-gpu-share-with-hami) 以及 [KAI Scheduler](/zh/blog/hami-core-adopted-by-nvidia-kai-scheduler) 完成集成。

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ KAI Scheduler 的 GPU 共享是「协作式」的:调度器确保请求的显

## 什么是 HAMi?

HAMi 是 CNCF 沙箱项目,专注于异构 AI 算力虚拟化中间件。其核心能力是通过 CUDA 拦截库(HAMi-core),在容器级别实现 GPU 显存和算力的硬隔离
HAMi 是 CNCF 沙箱项目,专注于异构 AI 算力虚拟化中间件。其核心能力是通过 CUDA 拦截库(HAMi-core)在 CUDA API 层强制限制 GPU 显存和算力,使工作负载无法超额使用所分配的份额

简单理解 HAMi 的定位:

Expand Down
Loading