Skip to content

[AMD] Update AMD MI300X, MI325X, MI355X GPT-OSS vLLM images to v0.16.0#806

Merged
functionstackx merged 6 commits intomainfrom
claude/issue-803-20260226-0556
Feb 26, 2026
Merged

[AMD] Update AMD MI300X, MI325X, MI355X GPT-OSS vLLM images to v0.16.0#806
functionstackx merged 6 commits intomainfrom
claude/issue-803-20260226-0556

Conversation

@cquil11
Copy link
Collaborator

@cquil11 cquil11 commented Feb 26, 2026

MI300X & MI325X: Bump image from v0.15.1 to v0.16.0 (scripts compatible) MI355X: Major rewrite from custom ROCm v0.10.1 to upstream v0.16.0:

  • Fix env var names (VLLM_ROCM_USE_AITER_UNIFIED_ATTENTION)
  • Add missing VLLM_ROCM_USE_AITER=1 master toggle
  • Remove non-existent VLLM_ROCM_USE_AITER_FUSED_MOE_A16W4
  • Remove deprecated --max-seq-len-to-capture and --async-scheduling
  • Simplify compilation config to cudagraph_mode FULL_AND_PIECEWISE
  • Add HIP_VISIBLE_DEVICES Ray compatibility and MEC firmware check

Closes #803

MI300X & MI325X: Bump image from v0.15.1 to v0.16.0 (scripts compatible)
MI355X: Major rewrite from custom ROCm v0.10.1 to upstream v0.16.0:
  - Fix env var names (VLLM_ROCM_USE_AITER_UNIFIED_ATTENTION)
  - Add missing VLLM_ROCM_USE_AITER=1 master toggle
  - Remove non-existent VLLM_ROCM_USE_AITER_FUSED_MOE_A16W4
  - Remove deprecated --max-seq-len-to-capture and --async-scheduling
  - Simplify compilation config to cudagraph_mode FULL_AND_PIECEWISE
  - Add HIP_VISIBLE_DEVICES Ray compatibility and MEC firmware check

Closes #803

Co-authored-by: Cameron Quilici <cquil11@users.noreply.github.com>
github-actions bot and others added 2 commits February 26, 2026 06:30
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
github-actions bot and others added 2 commits February 26, 2026 06:34
Co-authored-by: Cameron Quilici <cquil11@users.noreply.github.com>
Copy link
Contributor

@functionstackx functionstackx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@functionstackx functionstackx merged commit 3450ced into main Feb 26, 2026
131 checks passed
@functionstackx functionstackx deleted the claude/issue-803-20260226-0556 branch February 26, 2026 22:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

[AMD] update MI300X, MI325X, MI355X GPT OSS vLLM image to latest 0.16.0

2 participants