Skip to content

[BUG] TFLite quantized ResNet50 test output mismatch when run on arm_cpu target #16534

@lhutton1

Description

@lhutton1

Expected behaviour:

No output mismatch.

Actual behaviour:

When compiled on an arm_cpu target, the model results in an output mismatch:

E       AssertionError:
E       Not equal to tolerance rtol=1e-07, atol=1e-07
E
E       Mismatched elements: 3 / 3 (100%)
E       Max absolute difference: 878
E       Max relative difference: 8.69306931
E        x: array([979, 972, 970])
E        y: array([101, 386, 385])

Environment:

Tested with TVM at 6a3fadc. The issue was found as a result of the changes in #16513, however it can be reproduced without as described below.

Run on a Graviton 3 instance.

How to reproduce:

Run the test pytest tests/python/frontend/tflite/test_forward.py -k test_forward_tflite2_qnn_resnet50
with an arm_cpu target. Note: Reminder to remove any skip condition that exists in the test currently.

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triagePRs or issues that need to be investigated by maintainers to find the right assignees to address itrelay:qnnsrc/relay/qnnstatus:stalePR is stale and not being acted on for a whiletopipython/tvm/topitype: bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions