Skip to content

Conversation

@yiliu30
Copy link
Contributor

@yiliu30 yiliu30 commented Dec 7, 2022

Type of Change

  • Feature
  • API changed or not: Add optimization_level to select the tuning strategy

Description

detail description
JIRA ticket: ILITV-2212

Expected Behavior & Potential Risk

  • Add conservative traverse logic
    - Start with fp32 model, convert op(s) into lower-precision(bf16/fp16/int8).
    - Convert ops into lower precision by op-type wise.
    - Convert op into lower precision one by one based on the result of the previous step.
  • Add optimization level
    - 0: using conservative strategy
    - 1: using basic strategy by default
  • UTs
  • Doc, will be submitted by another PR

How has this PR been tested?

Dependency Change?

None

Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
Signed-off-by: yiliu30 <[email protected]>
@ftian1
Copy link
Contributor

ftian1 commented Dec 7, 2022

pls change the commit message to not include "[Strategy]" words.

@yiliu30 yiliu30 changed the title [Strategy] Add optimization level(conservative tuning) for tuning strategy Add optimization level(conservative tuning) for tuning strategy Dec 7, 2022
@ftian1
Copy link
Contributor

ftian1 commented Dec 7, 2022

this PR should be merged after PR222

@yiliu30 yiliu30 requested a review from yuwenzho December 7, 2022 06:22
@chensuyue chensuyue merged commit 4612e08 into master Dec 7, 2022
@chensuyue chensuyue deleted the opt_level2 branch December 7, 2022 12:10
zehao-intel pushed a commit that referenced this pull request Dec 9, 2022
zehao-intel pushed a commit that referenced this pull request Dec 20, 2022
VincyZhang pushed a commit that referenced this pull request Feb 12, 2023
* add submodel onednngraph

* add innerproduct and softmax fp32

* reformat

* fix onednn graph version
yiliu30 pushed a commit that referenced this pull request Jun 3, 2025
* [SW-228061] define ScaleMethod in better way

* bug fixes and new scale_method_config file

* copilot cr

* tiny fix

* rebase

* some cr fixes

* bug+cr fixes

* cr fix

* cr fix
xin3he pushed a commit that referenced this pull request Jul 15, 2025
* [SW-228061] define ScaleMethod in better way

* bug fixes and new scale_method_config file

* copilot cr

* tiny fix

* rebase

* some cr fixes

* bug+cr fixes

* cr fix

* cr fix

Signed-off-by: Xin He <[email protected]>
XuehaoSun pushed a commit that referenced this pull request Jul 19, 2025
* [SW-228061] define ScaleMethod in better way

* bug fixes and new scale_method_config file

* copilot cr

* tiny fix

* rebase

* some cr fixes

* bug+cr fixes

* cr fix

* cr fix

Signed-off-by: Xin He <[email protected]>
This was referenced Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants