Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[op conformance] Fix threshold bugs in ov::test::utils::compare #22972

Merged
merged 2 commits into from
Feb 23, 2024

Conversation

sbalandi
Copy link
Contributor

@sbalandi sbalandi commented Feb 20, 2024

Details:

  • fixed problem, when all actual values are 0 -> rel_error 0, abs_error more then 0 -> but test is PASS
  • fixed problem, when one threshold is set by user, another threshold is set to default values std::numeric_limits::max and some problem appears in test -> but test is PASS, because one of thresholds is very big

Tickets:

@github-actions github-actions bot added the category: IE Tests OpenVINO Test: plugins and common label Feb 20, 2024
@sbalandi sbalandi force-pushed the accuracy1 branch 3 times, most recently from 1ef76c6 to 828e681 Compare February 21, 2024 17:26
@sbalandi sbalandi changed the title test [op conformance] Fix threshold bugs in ov::test::utils::compare Feb 21, 2024
@sbalandi sbalandi marked this pull request as ready for review February 21, 2024 17:26
@sbalandi sbalandi requested review from a team as code owners February 21, 2024 17:26
@iefode
Copy link
Contributor

iefode commented Feb 23, 2024

@eshoguli FYI

@iefode iefode added this pull request to the merge queue Feb 23, 2024
Merged via the queue into openvinotoolkit:master with commit 1e5d0e5 Feb 23, 2024
104 checks passed
@sbalandi sbalandi mentioned this pull request Feb 27, 2024
sbalandi added a commit to sbalandi/openvino that referenced this pull request Feb 28, 2024
sbalandi added a commit to sbalandi/openvino that referenced this pull request Feb 28, 2024
github-merge-queue bot pushed a commit that referenced this pull request Feb 28, 2024
…re (#22972) (#23119)

This reverts commit 1e5d0e5.

### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*
github-merge-queue bot pushed a commit that referenced this pull request Feb 29, 2024
### Details:
 - *Revert #22972
- *Partly revert #21783

### Tickets:
 - *ticket-id*
github-merge-queue bot pushed a commit that referenced this pull request May 16, 2024
…NN deconv OP from conv_backward_data (#23596)

### Details:
- *Re-enable conv with brgemm implement on avx2 platform with fp32 ,
also heuristic cause by wavernn-upsampler regression*
- *Switch OV cpu deconv implement from ONEDNN convbackward_data
primitive to deconv primitive. Support const and non-const weight;
Always expose planar weight layout to cpu graph; weight cache to save
blocked const weight ; runtime reorder for none-const weight*
 - *enable bias fusing for fp32 to replace legacy depthwise fusing*
 - *enable deconv brgconv for fp32 and INT8 deconv*
 - *update test case*

### About test case/WA update:
- *OV has feature to set the output shape of conv_backward_data. Which
would cause pad_r < 0 && pad_r + dil < 0, so applied the WA in onednn to
create deconv OP*
- *Deconv only has one ref entry(CPU_INSTANCE(ref_deconvolution_fwd_t)
for JIT,gemm and c++ reference implement. So one layout can't use RTinfo
to filter implement. Update test cases with 1x1 related or SSE related.
     For example:  backward data has 2 entries when input is nChw16C :
       jit_avx512_common_1x1_convolution_bwd_data_f32_t 
      jit_avx512_common_convolution_bwd_data_t<f32> to support
So OV filter can work to get desired implement type. However, deconv
only has only, it means that nChw16C would only get one implement type.
So filter would not work.*
 - *Change stride to 1 unit because of brgemm limitation*
- *subgraph concat deconv test can't hit ref implement because the gemm
and ref share one entry implement.*
- *Conformance test conv related failed, but can pass when merging 3.3
with brg. Failed caused by
![PR22972](#22972).
Seems threshold changes. Also AMX and avv512 core would fail on these
conformance test but not enabled on Azure platforms. Guess the expected
result is based on avx2 jit. So current just remove these test*

### Tickets:
 - *CVS-133120, CVS-122688*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: IE Tests OpenVINO Test: plugins and common
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants