Skip to content

[CI][AMD] Add configurable native test execution without DinD - #402

Merged
khluu merged 14 commits into
mainfrom
akaratza_reflect_ci_base_amd_ci
Jul 14, 2026
Merged

khluu merged 14 commits into
mainfrom
akaratza_reflect_ci_base_amd_ci

Conversation

@AndreasKaratzas

@AndreasKaratzas AndreasKaratzas commented Jul 8, 2026 •

Copy link
Copy Markdown
Member

Summary

  • Make native_ci an explicit runtime switch: true selects the native AMD Kubernetes pod, while false or omission preserves legacy DinD. ci-infra does not infer runtime mode from the device family or queue name.
  • Complete the native pod contract with the per-commit ci_base image, explicit GPU/no-GPU quantities, 16 GiB /dev/shm, isolated workspace, IPC_LOCK, restricted security context, image pull policy, artifact/checksum parameters, job-local runtime settings, and Docker-hook suppression.
  • Reject non-boolean native_ci, native multi-node jobs, and native no_plugin jobs during pipeline generation.
  • Preserve the legacy runner for every AMD queue unless its configuration explicitly opts into native execution.
  • Preserve upstream AMD mirror soft-fail behavior, per-step timeouts, and the latest upstream main.

This is paired with vllm-project/vllm#48387. The current vLLM configuration explicitly opts MI300 jobs into native execution while MI250, MI325, and MI355 remain on DinD. Future AMD queues can choose either mode without an infra code change.

@AndreasKaratzas
AndreasKaratzas force-pushed the akaratza_reflect_ci_base_amd_ci branch from 6053b11 to 308bc85 Compare July 8, 2026 04:38
@AndreasKaratzas AndreasKaratzas changed the title Mirror ROCm base image setup in AMD-CI Mirror ROCm base image setup in AMD-CI and deprecate docker in docker for ROCm Jul 8, 2026
@AndreasKaratzas AndreasKaratzas changed the title Mirror ROCm base image setup in AMD-CI and deprecate docker in docker for ROCm [CI][AMD] Run MI300 tests natively without DinD Jul 12, 2026
@AndreasKaratzas AndreasKaratzas changed the title [CI][AMD] Run MI300 tests natively without DinD [CI][AMD] Add configurable native test execution without DinD Jul 12, 2026
@AndreasKaratzas
AndreasKaratzas force-pushed the akaratza_reflect_ci_base_amd_ci branch from ce539dd to 0b769d3 Compare July 12, 2026 23:07
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@khluu

khluu commented Jul 13, 2026

Copy link
Copy Markdown
Member

This would add to many things into buildkite_step.py. Can you make sure to utilize all other files like constants.py or k8s_plugin.py?

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@AndreasKaratzas
AndreasKaratzas force-pushed the akaratza_reflect_ci_base_amd_ci branch from 3a069ea to 07fb65b Compare July 13, 2026 21:06
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@AndreasKaratzas

Copy link
Copy Markdown
Member Author

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@khluu
khluu merged commit 2ae4b6a into main Jul 14, 2026
1 check passed
@AndreasKaratzas
AndreasKaratzas deleted the akaratza_reflect_ci_base_amd_ci branch July 14, 2026 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants