Skip to content

[AMD][CI] Increase native shared-memory capacity - #448

Closed
AndreasKaratzas wants to merge 2 commits into
vllm-project:mainfrom
AndreasKaratzas:akaratza_expand_amd_shm
Closed

AndreasKaratzas wants to merge 2 commits into
vllm-project:mainfrom
AndreasKaratzas:akaratza_expand_amd_shm

Conversation

@AndreasKaratzas

@AndreasKaratzas AndreasKaratzas commented Aug 3, 2026 •

Copy link
Copy Markdown
Member
  • Increase the native AMD test pod's memory-backed /dev/shm size limit from 16 GiB to 32 GiB.
  • Preserve the existing emptyDir mount and IPC locking configuration while giving large multi-GPU tests usable allocation headroom.

PR #46893 configured the DeepSeek KV-offload correctness test with a 16 GiB host cache, PR #37206 made the shared region populate its pages eagerly, and ci-infra PR #402 introduced the exact 16 GiB AMD pod limit. CUDA H100 CI can run that configuration because its memory-backed /dev/shm has no explicit 16 GiB cap, while AMD native CI currently caps the entire mount at exactly the requested allocation size. Build 11570 first exposes the job's missing AITER setting in the KV-offload step; after enabling AITER, the exact local reproduction reaches this shared-memory limit. Raising the infrastructure limit preserves the original test coverage instead of reducing its cache size only for AMD.

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@AndreasKaratzas
AndreasKaratzas marked this pull request as ready for review August 3, 2026 03:40
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@AndreasKaratzas

Copy link
Copy Markdown
Member Author

Closing as covered in #447

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant