[AMD] Add RyzenAI 8D + MLPerf recipes (Qwen3-8B, Phi-4, Llama-3.1-8B) - #559
Open
Pooja Ganesh (poganesh) wants to merge 1 commit into
Open
[AMD] Add RyzenAI 8D + MLPerf recipes (Qwen3-8B, Phi-4, Llama-3.1-8B)#559Pooja Ganesh (poganesh) wants to merge 1 commit into
Pooja Ganesh (poganesh) wants to merge 1 commit into
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
This PR updates and expands the AMD RyzenAI recipe set to align with the “8D” drop, adding new RyzenAI configurations (including MLPerf-oriented full_fusion and hybrid variants) and updating RyzenAI dependency pins across multiple existing model recipes.
Changes:
- Added RyzenAI recipe configs + documentation for
Qwen/Qwen3-8B, including MLPerffull_fusionandhybridvariants and a newinfo.yaml. - Added MLPerf
full_fusionandhybridRyzenAI recipes (plus README/info updates) formicrosoft/Phi-4-mini-instructandmeta-llama/Llama-3.1-8B-Instruct. - Updated many existing RyzenAI
requirements_ryzenai_llm.txtfiles to the new pinned versions (e.g., Olive 1.8.0-8D index,amd-quark==0.12.post1,onnx==1.22.0,numpy==2.5.1,onnxruntime-genai==0.14.0) and updated several token_fusion configs to includemax_seq_leninextra_options.
Reviewed changes
Copilot reviewed 81 out of 81 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| Qwen-Qwen3-8B/RyzenAI/requirements_ryzenai_llm.txt | New RyzenAI dependency set for Qwen3-8B aligned to 8D pins. |
| Qwen-Qwen3-8B/RyzenAI/README.md | New/updated setup + run instructions for Qwen3-8B (token/full/hybrid). |
| Qwen-Qwen3-8B/RyzenAI/Qwen3-8B_quark_ryzenai_llm.json | New Qwen3-8B token_fusion RyzenAI recipe. |
| Qwen-Qwen3-8B/RyzenAI/Qwen3-8B_quark_ryzenai_llm_hybrid.json | New Qwen3-8B MLPerf hybrid RyzenAI recipe. |
| Qwen-Qwen3-8B/RyzenAI/Qwen3-8B_quark_ryzenai_llm_full_fusion.json | New Qwen3-8B MLPerf full_fusion RyzenAI recipe. |
| Qwen-Qwen3-8B/RyzenAI/info.yaml | New recipe registration for Qwen3-8B RyzenAI variants. |
| Qwen-Qwen2.5-Coder-7B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-Coder-7B-Instruct/RyzenAI/Qwen2.5-Coder-7B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-Coder-1.5B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-Coder-1.5B-Instruct/RyzenAI/Qwen2.5-Coder-1.5B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-Coder-0.5B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-Coder-0.5B-Instruct/RyzenAI/Qwen2.5-Coder-0.5B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-7B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-7B-Instruct/RyzenAI/Qwen2.5-7B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-3B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-3B/RyzenAI/Qwen2.5-3B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-3B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-3B-Instruct/RyzenAI/Qwen2.5-3B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-1.5B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-1.5B-Instruct/RyzenAI/Qwen2.5-1.5B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2.5-0.5B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2.5-0.5B-Instruct/RyzenAI/Qwen2.5-0.5B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2-7B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2-7B/RyzenAI/Qwen2-7B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen2-1.5B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen2-1.5B/RyzenAI/Qwen2-1.5B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| Qwen-Qwen1.5-7B-Chat/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| Qwen-Qwen1.5-7B-Chat/RyzenAI/Qwen1.5-7B-Chat_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| mistralai-Mistral-7B-v0.3/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| mistralai-Mistral-7B-v0.3/RyzenAI/Mistral-7B-v0.3_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| mistralai-Mistral-7B-Instruct-v0.3/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| mistralai-Mistral-7B-Instruct-v0.3/RyzenAI/Mistral-7B-Instruct-v0.3_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| mistralai-Mistral-7B-Instruct-v0.2/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| mistralai-Mistral-7B-Instruct-v0.2/RyzenAI/Mistral-7B-Instruct-v0.2_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| mistralai-Mistral-7B-Instruct-v0.1/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| mistralai-Mistral-7B-Instruct-v0.1/RyzenAI/Mistral-7B-Instruct-v0.1_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| microsoft-Phi-4-mini-reasoning/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| microsoft-Phi-4-mini-reasoning/RyzenAI/Phi-4-mini-reasoning_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| microsoft-Phi-4-mini-instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| microsoft-Phi-4-mini-instruct/RyzenAI/README.md | Updated docs to include MLPerf full_fusion and hybrid recipe variants. |
| microsoft-Phi-4-mini-instruct/RyzenAI/Phi-4-mini-instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| microsoft-Phi-4-mini-instruct/RyzenAI/Phi-4-mini-instruct_quark_ryzenai_llm_hybrid.json | Added new MLPerf hybrid RyzenAI recipe. |
| microsoft-Phi-4-mini-instruct/RyzenAI/Phi-4-mini-instruct_quark_ryzenai_llm_full_fusion.json | Added new MLPerf full_fusion RyzenAI recipe. |
| microsoft-Phi-4-mini-instruct/RyzenAI/info.yaml | Registered new Phi-4-mini-instruct RyzenAI MLPerf variants. |
| microsoft-Phi-3.5-mini-instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| microsoft-Phi-3.5-mini-instruct/RyzenAI/Phi-3.5-mini-instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| microsoft-Phi-3-mini-4k-instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| microsoft-Phi-3-mini-4k-instruct/RyzenAI/Phi-3-mini-4k-instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| microsoft-Phi-3-mini-128k-instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| microsoft-Phi-3-mini-128k-instruct/RyzenAI/Phi-3-mini-128k-instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Meta-Llama-3-8B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Meta-Llama-3-8B/RyzenAI/Meta-Llama-3-8B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.2-3B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.2-3B/RyzenAI/Llama-3.2-3B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.2-3B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.2-3B-Instruct/RyzenAI/Llama-3.2-3B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.2-1B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.2-1B/RyzenAI/Llama-3.2-1B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.2-1B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.2-1B-Instruct/RyzenAI/Llama-3.2-1B-Instruct_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.1-8B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.1-8B/RyzenAI/Meta-Llama-3.1-8B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/README.md | Updated docs to include MLPerf full_fusion and hybrid recipe variants. |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/Llama-3.1-8B-Instruct_quark_ryzenai_llm.json | Updated token_fusion recipe with RyzenGenerateModelLLM extra_options (model_type). |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/Llama-3.1-8B-Instruct_quark_ryzenai_llm_hybrid.json | Added new MLPerf hybrid RyzenAI recipe. |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/Llama-3.1-8B-Instruct_quark_ryzenai_llm_full_fusion.json | Added new MLPerf full_fusion RyzenAI recipe. |
| meta-llama-Llama-3.1-8B-Instruct/RyzenAI/info.yaml | Registered new Llama-3.1-8B-Instruct RyzenAI MLPerf variants. |
| meta-llama-Llama-2-7b-hf/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| meta-llama-Llama-2-7b-hf/RyzenAI/Llama-2-7b-hf_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| meta-llama-Llama-2-7b-chat-hf/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| gpt-oss-20b/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| gpt-oss-20b/RyzenAI/README.md | Cleaned up incorrect/irrelevant comment in run instructions. |
| deepseek-ai-DeepSeek-R1-Distill-Qwen-7B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| deepseek-ai-DeepSeek-R1-Distill-Qwen-7B/RyzenAI/DeepSeek-R1-Distill-Qwen-7B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B/RyzenAI/DeepSeek-R1-Distill-Qwen-1.5B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| deepseek-ai-DeepSeek-R1-Distill-Llama-8B/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| deepseek-ai-DeepSeek-R1-Distill-Llama-8B/RyzenAI/DeepSeek-R1-Distill-Llama-8B_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
| codellama-CodeLlama-7b-Instruct-hf/RyzenAI/requirements_ryzenai_llm.txt | Updated RyzenAI dependency pins to 8D versions. |
| codellama-CodeLlama-7b-Instruct-hf/RyzenAI/CodeLlama-7b-Instruct-hf_quark_ryzenai_llm.json | Added max_seq_len extra option to token_fusion recipe. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Pooja Ganesh (poganesh)
force-pushed
the
8D-MS
branch
from
July 22, 2026 22:10
2fb7a5d to
13271fa
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note: on-device runtime validation is pending an internal fix to transaction-binary filtering; the recipes generate correctly.