Skip to content

Conversation

@guoyu-wang
Copy link
Contributor

Description: Let execution fall back to CPU EP if Compile of a partition on current EP fails

Motivation and Context

  • This is a feature request from 1p customer
  • When EP::Compile fails, currently we will fail the entire execution, add a way to let the particular partition which fails the EP::Compile fall back to next EP
  • This is only valid for EP using FilteredGraphViewer for now, to be specific, NNAPI and CoreML EP, all other EP will not be affected by this change
  • This logic only works for using ORT format for mobile scenario, onnx model will not be affected by this change
  • The user scenario is, NNAPI EP gives correct Capabilities for all the devices, if user want to restrict use certain devices (such as GPU), you can only get the error when you compile the NNAPI model if this is not possible

@guoyu-wang guoyu-wang requested a review from skottmckay February 5, 2021 02:59
@guoyu-wang guoyu-wang requested a review from a team as a code owner February 5, 2021 02:59
@jywu-msft
Copy link
Member

This is nice. Let's see how we can apply the learnings here to other EP's besides the ones for mobile scenarios.
+@HectorSVC , +@stevenlix

Copy link
Contributor

@skottmckay skottmckay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@guoyu-wang guoyu-wang merged commit 68193e2 into master Feb 5, 2021
@guoyu-wang guoyu-wang deleted the gwang-msft/ep_fallback_compile_failure branch February 5, 2021 20:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants