[FEATURE]: Heterogeneous Device Support on Dynamo

[zxue2]

Feature request

Given ai-dynamo is a fully open-source framework, please kindly share if any special requirements for other devices (e.g., Intel XPU, etc.) related source code upstream to dynamo.

Or just need to follow the common open source guideline and dynamo CI/CD process for review and merge. thx

Describe the problem you're encountering

Heterogeneous Device support upstream

Describe alternatives you've tried

No response

[grahamking]

Yup, common open source guideline. Support depends on the engine you use, vllm, sglang or trtllm, and matches upstream.

[zxue2]

@grahamking , thanks for confirmation. #3548 has been raised as the first patch to enable intel GPU on dynamo. Please kindly review/assign it with corresponding owners.
Will raise another patch about vllm engine with Intel GPU supported post PR #3548 gets processed.