Skip to content

[AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image - #1041

Merged
cquil11 merged 4 commits into
SemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/qwen3.5_fp4_mi355x_sglang
Apr 16, 2026
Merged

[AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image #1041
cquil11 merged 4 commits into
SemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/qwen3.5_fp4_mi355x_sglang

Conversation

@ajith-sirra-amd

@ajith-sirra-amd ajith-sirra-amd commented Apr 16, 2026

Copy link
Copy Markdown
Collaborator

Overview

Add benchmark configuration and testing support for AMD MI355X hardware.

Changes

  • Added benchmark script for Qwen3.5 FP4 model on MI355X to run with Updated SGLang Image.
  • Updated GitHub Actions configuration for AMD master branch

Testing

  • Verify benchmark execution on MI355X hardware
  • Validate configuration settings

e2e Test run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/24503738833

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Comment thread .github/configs/amd-master.yaml Outdated
Comment thread .github/configs/amd-master.yaml Outdated
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@seungrokj seungrokj changed the title Qwen3.5 FP4 MI355x Perf - New SGLang Image [AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image Apr 16, 2026
@seungrokj seungrokj added the AMD label Apr 16, 2026
@seungrokj

Copy link
Copy Markdown
Collaborator

/sweep test-config --config-files .github/configs/amd-master.yaml --config-keys qwen3.5-fp4-mi355x-sglang

@github-actions

Copy link
Copy Markdown
Contributor

@seungrokj Kicking off a sweep.

Run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/24503738833
Command: test-config --config-files .github/configs/amd-master.yaml --config-keys qwen3.5-fp4-mi355x-sglang
Pinned ref: 7719878
Approval: not required (trusted collaborator).

@seungrokj

Copy link
Copy Markdown
Collaborator

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@ajith-sirra-amd

Copy link
Copy Markdown
Collaborator Author

@seungrokj : Updated the perf-changelog.yaml. Please let me know.

@seungrokj

Copy link
Copy Markdown
Collaborator

hi @functionstackx @cquil11 can you help merging this ?

@seungrokj
seungrokj self-requested a review April 16, 2026 11:29

@seungrokj seungrokj left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@chunfangamd chunfangamd left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@cquil11
cquil11 merged commit ac38c52 into SemiAnalysisAI:main Apr 16, 2026
13 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Development

Successfully merging this pull request may close these issues.

4 participants