[AMD] Add ATOM+MTP, dsr1 fp8/fp4 - #673
Conversation
Signed-off-by: seungrokj <seungrok.jung@amd.com>
Signed-off-by: seungrokj <seungrok.jung@amd.com>
Signed-off-by: seungrokj <seungrok.jung@amd.com>
Signed-off-by: seungrokj <seungrok.jung@amd.com>
|
/sweep test-config --config-files .github/configs/amd-master.yaml --runner-config .github/configs/runners.yaml --config-keys dsr1-fp8-mi355x-atom-mtp dsr1-fp4-mi355x-atom-mtp |
|
@seungrokj Kicking off a sweep. Run: https://github.com/InferenceMAX/InferenceMAX/actions/runs/21861432813 |
|
@cquil11 or @Oseltamivir can u review this plz? |
|
@pr-claude review please |
|
Claude finished @functionstackx's task in 3m 20s —— View job Review of PR #673
SummaryNo blocking issues found. Two minor warnings posted as inline comments:
Validation checklist
Overall the PR is well-structured and consistent with existing atom configs. LGTM with the minor nits above. |
|
@seungrokj Sweep completing now, then we will merge. |
Hi @cquil11 @functionstackx
This is an MTP enablement of ATOM with a new docker img.
--use-chat-template is applied.
DS R1 FP4 / FP8 with MTP is enabled.
Regards,
Seungrok