Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/key-features/device-resource-isolation.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ A simple demonstration for device isolation: A task with the following resources
resources:
limits:
Comment thread
Wangmin362 marked this conversation as resolved.
nvidia.com/gpu: 1 # requesting 1 vGPU
nvidia.com/gpumem: 3000 # Each vGPU contains 3000m device memory
nvidia.com/gpumem: 3000 # Each vGPU contains 3000 MiB device memory
```

will see 3G device memory inside container
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ HAMi now integrates with the [Neuron scheduler extension](https://awsdocs-neuron

## Enabling Neuron-sharing Support

- Deploy neuron-device-plugin on EC2 neuron nodes according to the AWS document: [Neuro Device Plugin](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/kubernetes-getting-started.html#neuron-device-plugin)
- Deploy neuron-device-plugin on EC2 neuron nodes according to the AWS document: [Neuron Device Plugin](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/kubernetes-getting-started.html#neuron-device-plugin)

- Deploy HAMi

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Allocate a certain size of device memory by specifying resources such as `nvidia
resources:
limits:
Comment thread
Wangmin362 marked this conversation as resolved.
nvidia.com/gpu: 1 # requesting 1 GPU
nvidia.com/gpumem: 3000 # Each GPU contains 3000m device memory
nvidia.com/gpumem: 3000 # Each GPU contains 3000 MiB device memory
```

Allocate a percentage of device memory by specifying resource `nvidia.com/gpumem-percentage`. Optional, each unit of `nvidia.com/gpumem-percentage` equals 1% of device memory.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ translated: true
resources:
limits:
nvidia.com/gpu: 1 # 请求 1 个 vGPU
nvidia.com/gpumem: 3000 # 每个 vGPU 包含 3000m 设备显存
nvidia.com/gpumem: 3000 # 每个 vGPU 包含 3000 MiB 设备显存
```

将在容器内看到 3G 设备显存。
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ translated: true
resources:
limits:
nvidia.com/gpu: 1 # 请求 1 个 GPU
nvidia.com/gpumem: 3000 # 每个 GPU 包含 3000m 设备显存
nvidia.com/gpumem: 3000 # 每个 GPU 包含 3000 MiB 设备显存
```

通过指定资源 `nvidia.com/gpumem-percentage` 来分配设备显存的百分比。可选项,每个 `nvidia.com/gpumem-percentage` 单位等于设备显存的 1% 百分比。
Expand Down