Flaky ONNX test TestNode.test_imports

[larroy]

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-13834/2/pipeline

============================= test session starts ==============================

platform linux -- Python 3.5.2, pytest-3.4.0, py-1.7.0, pluggy-0.6.0

rootdir: /work/mxnet, inifile:

plugins: cov-2.5.1

collected 2 items



tests/python-pytest/onnx/test_node.py .F                                 [100%]



=================================== FAILURES ===================================

____________________________ TestNode.test_imports _____________________________



self = <test_node.TestNode testMethod=test_imports>



    def test_imports(self):

        for test in import_test_cases:

            test_name, onnx_name, inputs, np_op, attrs = test

            with self.subTest(test_name):

                names, input_tensors, inputsym = get_input_tensors(inputs)

                np_out = [np_op(*inputs, **attrs)]

                output_shape = np.shape(np_out)

                onnx_model = get_onnx_graph(test_name, names, input_tensors, onnx_name, output_shape, attrs)

                bkd_rep = backend.prepare(onnx_model, operation='import')

                mxnet_out = bkd_rep.run(inputs)

>               npt.assert_almost_equal(np_out, mxnet_out)

E               AssertionError: 

E               Arrays are not almost equal to 7 decimals

E               

E               (mismatch 10.0%)

E                x: array([2.1891336, 1.2304349, 1.2308753, 1.6621659, 1.4207152, 2.1186988,

E                      1.6284282, 1.7537684, 1.5224308, 1.8105199, 1.6884999, 0.9593497,

E                      1.4970635, 1.3806013, 2.0596354, 0.8462211, 1.613757 , 2.3153749,...

E                y: array([2.1891336, 1.2304349, 1.2308753, 1.6621659, 1.4207152, 2.1186988,

E                      1.6284282, 1.7537684, 1.5224308, 1.8105198, 1.6884999, 0.9593497,

E                      1.4970635, 1.3806013, 2.0596354, 0.846221 , 1.613757 , 2.3153749,...



tests/python-pytest/onnx/test_node.py:183: AssertionError

====================== 1 failed, 1 passed in 1.91 seconds ======================