Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FrontEnd] Loading frontends only when needed #8235

Merged
merged 3 commits into from
Dec 1, 2021
Merged

[FrontEnd] Loading frontends only when needed #8235

merged 3 commits into from
Dec 1, 2021

Conversation

nosovmik
Copy link
Contributor

@nosovmik nosovmik commented Oct 26, 2021 •
edited
Loading

Details:

  • On creation of FrontEndManager - search for available FrontEnd plugins but do not load them
  • Reworked logic for loading frontends using FrontendManager::load_by_model
    1. Check model extension. If it is '.xml' - try load with IR FE. If it is '.onnx' - try with ONNX FE. For others, go to next steps
    2. If 'input stream' is passed instead of file name - try IR, then ONNX, then others
    3. Check already loaded frontends: if there is suitable one ('supports' returns true) - use it
    4. Load unloaded frontends until suitable one is found
  • This significantly reduces 'ReadNetwork' time for most common case where IR is used
  • Testing is done only manually, no new auto-tests were created

Tickets:

  • 61780, 68177, 69168

@nosovmik nosovmik requested a review from a team as a code owner October 26, 2021 15:51
@nosovmik nosovmik requested review from a team, avladimi and GlebKazantaev and removed request for a team October 26, 2021 15:51
@openvino-pushbot openvino-pushbot added category: inference OpenVINO Runtime library - Inference category: IE Tests OpenVINO Test: plugins and common category: MO Model Optimizer category: Core OpenVINO Core (aka ngraph) category: tools OpenVINO C++ / Python tools labels Oct 26, 2021
@ilya-lavrenov ilya-lavrenov added this to the 2022.1 milestone Oct 26, 2021
@nosovmik nosovmik marked this pull request as draft November 15, 2021 07:11
@nosovmik nosovmik marked this pull request as ready for review November 30, 2021 09:23
@azhogov azhogov merged commit caf1f22 into openvinotoolkit:master Dec 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilyachur ilyachur ilyachur left review comments

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

@mateusztabaka mateusztabaka Awaiting requested review from mateusztabaka

@avladimi avladimi Awaiting requested review from avladimi avladimi was automatically assigned from openvinotoolkit/openvino-docs-maintainers

@GlebKazantaev GlebKazantaev Awaiting requested review from GlebKazantaev

Assignees
No one assigned
Labels
category: Core OpenVINO Core (aka ngraph) category: IE Tests OpenVINO Test: plugins and common category: inference OpenVINO Runtime library - Inference category: MO Model Optimizer category: tools OpenVINO C++ / Python tools
Projects
None yet
Milestone
2022.1
Development

Successfully merging this pull request may close these issues.
5 participants
@nosovmik @ilya-lavrenov @ilyachur @azhogov @openvino-pushbot