Skip to content

Conversation

@umangb-09
Copy link
Contributor

Added support for engine validation check for EP Context models.

Motivation and Context

We wanted to implement the GetModelCompatibilityForEpDevices() API support and thus have an end user available API for the engine validation check for EP context models. Added this support and the necessary function implementation

@umangb-09
Copy link
Contributor Author

@ishwar-raut1 @gedoensmax Can you give this a go?

Copy link
Contributor

@gedoensmax gedoensmax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good but we are missing testing for this change.

@umangb-09 umangb-09 marked this pull request as draft January 12, 2026 05:47
@umangb-09
Copy link
Contributor Author

Moving this to draft as there is new approach recommended by Microsoft. Will raise new PR changes with that

@umangb-09 umangb-09 marked this pull request as ready for review January 21, 2026 06:07
@umangb-09 umangb-09 force-pushed the main_engine_validation_API branch from 48069c4 to 1aff515 Compare January 21, 2026 06:25
@adrianlizarraga
Copy link
Contributor

/azp run Linux QNN CI Pipeline, Win_TRT_Minimal_CUDA_Test_CI, Windows ARM64 QNN CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@adrianlizarraga
Copy link
Contributor

/azp run Test Linux CUDA x64 Release, Test Linux TensorRT x64 Release

@azure-pipelines
Copy link

No pipelines are associated with this pull request.

@adrianlizarraga
Copy link
Contributor

/azp run Linux QNN CI Pipeline, Win_TRT_Minimal_CUDA_Test_CI, Windows ARM64 QNN CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@adrianlizarraga adrianlizarraga merged commit 727db0d into microsoft:main Jan 25, 2026
87 of 88 checks passed
tianleiwu pushed a commit that referenced this pull request Jan 27, 2026
Added support for engine validation check for EP Context models.

### Motivation and Context
We wanted to implement the GetModelCompatibilityForEpDevices() API
support and thus have an end user available API for the engine
validation check for EP context models. Added this support and the
necessary function implementation
tianleiwu added a commit that referenced this pull request Jan 27, 2026
| Commit | Commit Title | Author |
| :--- | :--- | :--- |
| `11dde2d9e` | [NV TensorRT RTX EP] Fix external tensorrt_plugins load
path (#26814) | keshavv27 |
| `080d96818` | Move model compatibility checks ahead of session
initialization (#27037) | adrastogi |
| `ec4f6bfa1` | [QNN EP] Fix error messages being logged as VERBOSE
instead of ERROR (#24931) | Copilot |
| `0432e7125` | perftest: support plugin eps for compile_ep_context
(#27121) | Jaskaran Singh Nagi |
| `727db0d3d` | Engine compatibility validity API implementation
(#26774) | umangb-09 |
| `27013522f` | Deprecate transformers model examples (#27156) | Jambay
Kinley |
| `f83d4d06e` | [QNN-EP] Implement file mapped weights feature (#26952)
| quic-calvnguy |

---------

Co-authored-by: keshavv27 <[email protected]>
Co-authored-by: adrastogi <[email protected]>
Co-authored-by: Aditya Rastogi <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: vraspar <[email protected]>
Co-authored-by: yuslepukhin <[email protected]>
Co-authored-by: Dmitri Smirnov <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dmitri Smirnov <[email protected]>
Co-authored-by: Jaskaran Singh Nagi <[email protected]>
Co-authored-by: umangb-09 <[email protected]>
Co-authored-by: Jambay Kinley <[email protected]>
Co-authored-by: quic-calvnguy <[email protected]>
Co-authored-by: quic_calvnguy <quic_calvnguy@quic_inc.com>
@tianleiwu tianleiwu added cherry-picked Cherry-picked for a cherrypicks branch and removed release:1.24.0 labels Jan 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cherry-picked Cherry-picked for a cherrypicks branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants