Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU] Reduced overheads in inference stage #6794

Merged
merged 7 commits into from
Dec 1, 2021
Merged

[CPU] Reduced overheads in inference stage #6794

merged 7 commits into from
Dec 1, 2021

Conversation

a-sidorova
Copy link
Contributor

@a-sidorova a-sidorova commented Jul 26, 2021 •
edited
Loading

Details:

  • Added some changes to reduce method call overheads
  • Moved Inplace check to model loading stage from inference

Tickets:

  • 56307
  • 56314

@a-sidorova a-sidorova added the category: CPU OpenVINO CPU plugin label Jul 27, 2021
@a-sidorova a-sidorova added this to the 2022.1 milestone Jul 27, 2021
@a-sidorova a-sidorova force-pushed the feature/data_overhead branch 2 times, most recently from 9398d7b to 6112e87 Compare July 27, 2021 10:18
@a-sidorova a-sidorova marked this pull request as ready for review July 27, 2021 13:18
@a-sidorova a-sidorova requested review from a team July 27, 2021 13:18
@a-sidorova a-sidorova force-pushed the feature/data_overhead branch from 6112e87 to 75266cd Compare July 27, 2021 19:14
@dmitry-gorokhov
Copy link
Contributor

@maxnick please review the PR

@a-sidorova a-sidorova force-pushed the feature/data_overhead branch from 75266cd to 6ad81ef Compare August 16, 2021 07:52
maxnick
maxnick requested changes Aug 16, 2021
View reviewed changes
inference-engine/src/mkldnn_plugin/mkldnn_graph.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_graph.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_graph.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Outdated Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_infer_request.cpp Show resolved Hide resolved
inference-engine/src/mkldnn_plugin/mkldnn_graph.cpp Outdated Show resolved Hide resolved
@a-sidorova a-sidorova requested a review from maxnick August 23, 2021 10:39
@a-sidorova
Copy link
Contributor Author

@maxnick thank you!

@dmitry-gorokhov take a look please

@a-sidorova
reduced some overheads in inference stage
1b43ecc 
moved initinplace after all nodes creations && many minor optimizations
@a-sidorova a-sidorova force-pushed the feature/data_overhead branch from 185a38b to 1b43ecc Compare September 13, 2021 10:19
dmitry-gorokhov
dmitry-gorokhov reviewed Nov 28, 2021
View reviewed changes
Copy link
Contributor

@dmitry-gorokhov dmitry-gorokhov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please rebase on latest master

inference-engine/src/mkldnn_plugin/mkldnn_node.h Show resolved Hide resolved
@dmitry-gorokhov
Copy link
Contributor

@a-sidorova please rebase on latest master

@dmitry-gorokhov dmitry-gorokhov merged commit 802b5bc into openvinotoolkit:master Dec 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@maxnick maxnick maxnick approved these changes

@dmitry-gorokhov dmitry-gorokhov Awaiting requested review from dmitry-gorokhov

Assignees

@dmitry-gorokhov dmitry-gorokhov

Labels
category: CPU OpenVINO CPU plugin
Projects
None yet
Milestone
2022.1
Development

Successfully merging this pull request may close these issues.
3 participants
@a-sidorova @dmitry-gorokhov @maxnick