[CI/Build][Intel] Enable benchmarks on Intel Gaudi 3 runner

[jakub-sochacki]

• Add linux.hpu.gaudi3.8 runner to benchmark matrix (placeholder)
• Create test-[throughput | latency | serving]-hpu.json files with benchmark configurations
• Add gaudi3 to default runners list in workflow dispatch
• Implement HPU device detection using hl-smi command
• Add HPU-specific Docker image suffix (-hpu)
• Add special commit selection for HPU that queries vllm-gaudi history
• Clone vllm-gaudi vllm/last-good-commit-for-vllm-gaudi branch to get compatibility history (N most recent VLLM_STABLE_COMMIT updates)
• Search through commit history to find most recent vLLM version with existing Docker image built by CI

The commit selection mechanism solves the race condition where VLLM_STABLE_COMMIT might change between CI image builds and benchmark runs (every 12 hours), ensuring benchmarks always find an existing compatible Docker image.

[meta-cla]

Hi @jakub-sochacki!

Thank you for your pull request and welcome to our community.

Action Required

In order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks!

[meta-cla]

Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks!

[louie-tsai]

looks good to me. thanks

[huydhn]

Nit: Is there a way to write something as follows in the requirements file?

torch; platform_system == 'Linux' and platform_machine != 'hpu'

Probably no, I haven't seen this syntax before, so just want to check

[huydhn]

I don't think we need to install pytorch here now, but let me follow up on this in a separate PR to just remove torch from requirements.txt

[Jacob-Intel]

Alright @huydhn, so please let me know if you removed torch from requirements there in other PR. Then i will remove the line which filters out torch for gaudi.

[xuechendi]

@huydhn , this change is to make sure we don't re-install torch. Since HPU is using special torch version. I hope it is OK to leave the grep -v "^torch==" .github/scripts/requirements.txt > /tmp/requirements_no_torch.txt just in case.

[huydhn]

LGTM! Plz rebase and I can help land this