Skip to content

TEST: 1.12.x + blas variants#267

Closed
h-vetinari wants to merge 9 commits into
conda-forge:mainfrom
h-vetinari:1.12_blas_vars
Closed

TEST: 1.12.x + blas variants#267
h-vetinari wants to merge 9 commits into
conda-forge:mainfrom
h-vetinari:1.12_blas_vars

Conversation

@h-vetinari

Copy link
Copy Markdown
Member

Following the same scheme as #242, #224, #223, #199, #172, #153 & #130.

@conda-forge-webservices

Copy link
Copy Markdown

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

@isuruf

isuruf commented Jan 23, 2024

Copy link
Copy Markdown
Member

@h-vetinari, azure is backed up at the moment. Is it okay to cancel the builds right now and restart a few hours later?

@h-vetinari

Copy link
Copy Markdown
Member Author

@h-vetinari, azure is backed up at the moment. Is it okay to cancel the builds right now and restart a few hours later?

Sorry, I didn't notice that and had started the job just before going to bed. It's nonessential, so please feel free to cancel these if we're ever congested

@h-vetinari

h-vetinari commented Mar 18, 2024

Copy link
Copy Markdown
Member Author

Scipy 1.12.0

TL;DR: Cautiously improving, but OpenBLAS-related problems remain (new ones on windows)

From 45 failures out of 113 runs for 1.11.4, we're now at 35 failures out of 113 CI runs (not counting the failure of test_multiple_ellipsis_slicing absolutely everywhere)

Notable

Good News

Bad News

  • Complete failure of test_multiple_ellipsis_slicing on all platforms
  • Many new failures on win+openblas
  • Apparently emulation-related failures on aarch remain

Restrictions

  • due to test_multiple_ellipsis_slicing failing everywhere, these 20 tests failures were discounted from the failure matrix
  • test on aarch64/ppc64le resp. for PyPy only run tests with label='fast', not the full test suite
  • the following test skips:
# on the slowest agents, these tests take more than 20min in emulation
{% set tests_to_skip = tests_to_skip + " or test_mixed_threads_processes" %}                      # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_lsq_linear and test_large_rank_deficient)" %}   # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_iterative and test_precond_inverse[case1])" %}  # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_multiprocess and fft)" %}                       # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_optimize and TestBrute and test_workers)" %}    # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestLevyStable and test_location_scale)" %}          # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestShgoArguments and test_19_parallelization)" %}   # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestDifferentialEvolutionSolver and (test_immediate_updating or test_parallel))" %}    # [aarch64 or ppc64le]
# tests that run into timeouts (set in scipy test suite) in emulation
{% set tests_to_skip = tests_to_skip + " or (test_propack and test_examples)" %}                  # [aarch64 or ppc64le]
# occasionally runs out of memory on windows + pypy
{% set tests_to_skip = tests_to_skip + " or test_bootstrap_against_" %}                           # [(python_impl == "pypy") and win]
{% set tests_to_skip = tests_to_skip + " or test_more_converged" %}                               # [(python_impl == "pypy") and win]
# fails on windows + pypy due to some file access race
{% set tests_to_skip = tests_to_skip + " or (test_read_over64bit and _fast_matrix_market)" %}     # [(python_impl == "pypy") and win]
# very slow tests for pypy in emulation
[several]

Details

lib for 1.11.4 now updated
version
updated
build
scipy 1.11.4 1.12.0 X
numpy 1.26.3 1.26.4 X
libblas 3.9.0-20 3.9.0-21 X
blis 0.9.0-1 0.9.0-1
openblas 0.3.25-0 0.3.26-0 X
mkl 2023.2.0-50496 (linux)
2023.2.0-50500 (osx)
2023.2.0-50497 (win)
2024.0.0-49657 (linux)
2023.2.0-50500 (osx)
2024.0.0-49657 (win)
X
netlib 3.9.0-5 3.9.0-5
pypy 7.3.13-1 7.3.15-1 X
pythran 0.15.0-0 0.15.0-1 X
qemu-user-static 8.1.3-1 8.1.3-1

Excludes scipy/scipy#15533 now, as it's too much of a hassle to track in this matrix; see section below.

variant 1.11.4 now
linux + x64 + blis - new failure: test_x0_working[tfqmr]
linux + aarch64 + openblas 60 failures, mostly QR-related;
apparently due to emulation
remain
linux + {aarch64,ppc64le} 6 failures in test_distribution_outside_support gone 🥳
osx + x64 + accelerate 1 flaky test failure
(minor tolerance violation)
remains (non-flaky)
osx + x64 + mkl + PyPy 1-2 test failures remain
win + openblas 1 failure 9-12 failures

variant accelerate blis mkl
w/ avx512
mkl
w/o avx512
netlib openblas
w/ avx512
openblas
w/o avx512
sum**
linux / x64 ✔️ ✔️ ✔️ ✔️ 10F
linux /
aarch64
✔️ 4F
linux /
ppc64le
✔️ ✔️ -
osx / arm -
osx / x64 ✔️ ✔️/
❌(PyPy)
✔️ ✔️ 6F
win / x64 ✔️ ✔️ ✔️ 15F
sum** 5F 5F - 11F - 5F 9F 35F

** sum of Segfaults (S), Failures (F), resp. Timeouts (T); out of a total of 113 CI combinations being tested

Build logs:
Azure

The curious case of test_x0_equals_Mb[nonsymposdef-bicgstab]

For main discussion see scipy/scipy#15533.

1.11.0 1.11.4 1.12.0
linux + x64 + blis + avx2 ✔️ ✔️ ✔️
linux + x64 + blis + avx512 ✔️ ✔️ ✔️
linux + x64 + mkl + avx2 ✔️ ✔️
linux + x64 + mkl + avx512 ✔️
linux + x64 + netlib + avx2 ✔️ ✔️ ✔️
linux + x64 + netlib + avx512 ✔️ ✔️ ✔️
linux + x64 + openblas + avx2 ✔️ ✔️ ✔️
linux + x64 + openblas + avx512 ✔️ ✔️
linux + aarch64 + netlib ✔️ ✔️ ✔️
linux + aarch64 + openblas ✔️ ✔️
osx + x64 + accelerate ✔️ ✔️ ✔️/❌
win + x64 + blis + avx2 ✔️ ✔️
win + x64 + blis + avx512 ✔️ ✔️
win + x64 + mkl + avx2 ✔️ ✔️
win + x64 + mkl + avx512 ✔️ ✔️
win + x64 + openblas + avx2 ✔️ ✔️ ✔️
win + x64 + openblas + avx512 ✔️ ✔️ ✔️

everywhere: 20 failures for test_multiple_ellipsis_slicing
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestBSR::test_multiple_ellipsis_slicing - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::TestBSRNonCanonical::test_multiple_ellipsis_slicing - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::TestCOO::test_multiple_ellipsis_slicing - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestCOONonCanonical::test_multiple_ellipsis_slicing - TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestDIA::test_multiple_ellipsis_slicing - Failed: TypeError: 'dia_matrix' object is not subscriptable
linux + x64 + blis: 1 failure
____________________________ test_x0_working[tfqmr] ____________________________
[gw1] linux -- Python 3.10.13 $PREFIX/bin/python
$PREFIX/lib/python3.10/site-packages/scipy/sparse/linalg/_isolve/tests/test_iterative.py:507: in test_x0_working
    assert norm(A @ x - b) <= 2e-6*norm(b)
E   assert 3.5355292454346426e-06 <= (2e-06 * 1.240298651028214)
E    +  where 3.5355292454346426e-06 = norm(((array([[3.68514493, 2.22433683, 2.80424149, 2.06524296, 2.82772901,\n        1.70134349, 2.98806253, 2.88379072, 1.9578..., 2.29515724, 2.77591422, 1.55001596, 1.93969785,\n        1.88091968, 2.24894423, 2.49791763, 1.66944017, 2.12310297]]) @ array([ -1.22142941, -23.52880604,  -4.72398545, -21.36850239,\n       -12.68971238,  -0.96740459,  32.8587725 , -11.40286367,\n        10.993623  ,  30.93083318])) - array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,\n       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921])))
E    +  and   1.240298651028214 = norm(array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,\n       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921]))
        A          = array([[3.68514493, 2.22433683, 2.80424149, 2.06524296, 2.82772901,
        1.70134349, 2.98806253, 2.88379072, 1.9578..., 2.29515724, 2.77591422, 1.55001596, 1.93969785,
        1.88091968, 2.24894423, 2.49791763, 1.66944017, 2.12310297]])
        b          = array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,
       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921])
        info       = 0
        kw         = {'atol': 0, 'rtol': 1e-06}
        n          = 10
        rng        = Generator(PCG64) at 0x7F5F881FF680
        solver     = <function tfqmr at 0x7f5f8ef58ee0>
        x          = array([ -1.22142941, -23.52880604,  -4.72398545, -21.36850239,
       -12.68971238,  -0.96740459,  32.8587725 , -11.40286367,
        10.993623  ,  30.93083318])
        x0         = array([0.63685093, 0.46836296, 0.0677924 , 0.52832101, 0.49467215,
       0.68333247, 0.3392967 , 0.57867322, 0.25729156, 0.60952728])
linux + x64 + mkl + non-avx512 / linux + aarch64 + openblas / osx + x64 + accelerate: 1 failure
___________________ test_x0_equals_Mb[nonsymposdef-bicgstab] ___________________
[gw0] linux -- Python 3.9.18 $PREFIX/bin/python
$PREFIX/lib/python3.9/site-packages/scipy/sparse/linalg/_isolve/tests/test_iterative.py:520: in test_x0_equals_Mb
    assert info == 0
E   assert -11 == 0
        A          = <10x10 sparse matrix of type '<class 'numpy.float64'>'
	with 19 stored elements in Compressed Sparse Row format>
        b          = array([0., 1., 2., 3., 4., 5., 6., 7., 8., 9.])
        case       = <nonsymposdef-bicgstab>
        info       = -11
        rtol       = 1e-08
        x          = array([0.        , 0.52361589, 1.32356787, 2.15281624, 3.        ,
       4.        , 5.        , 6.        , 7.        , 8.        ])
        x0         = 'Mb'

on aarch, we get assert -10 == 0 instead of assert -11 == 0...

linux + aarch64: 60 failures
FAILED linalg/tests/test_basic.py::TestLstsq::test_random_overdet - AssertionError: 
Not equal to tolerance rtol=2.98023e-06, atol=2.98023e-06
driver: gelsd
Mismatched elements: 45 / 45 (100%)
Max absolute difference: 23.948622
Max relative difference: 1.0819286
 x: array([[-2.175595e-02,  1.430921e-01,  1.740819e-02],
       [ 2.515154e-02,  2.834489e-02, -6.470084e-03],
       [-5.744661e-05,  1.434425e-02,  4.162818e-02],...
 y: array([[  4.199296,   5.158111,   2.723422],
       [ 11.47436 ,  11.579989,   5.939486],
       [  0.678561,   0.932052,   0.4389  ],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_tall_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_tall_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.38513473
Max relative difference: 1.38513473
 x: array([[ 0.194025,  0.271456,  0.193257, -0.103866,  0.639289,  0.325098,
        -0.308913,  0.225063,  0.009908,  0.531324,  0.418844,  0.486349],
       [ 0.271456, -0.024757,  0.531958, -0.127783,  0.087164,  0.124488,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_delete_last_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.39604267
Max relative difference: 1.39604267
 x: array([[ 7.312894e-01,  2.936634e-02, -2.486336e-01, -3.261323e-01,
         4.044664e-03, -1.884397e-02,  4.260744e-01,  4.652548e-01,
         4.959358e-02,  2.202561e-04, -5.590688e-01, -1.013507e-04],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_unit_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_unit_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_neg_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_neg_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_itemize_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_itemize_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_native_byte_order_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_native_byte_order_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_sqr_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_sqr_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 169 / 169 (100%)
Max absolute difference: 1.47401035
Max relative difference: 1.47401035
 x: array([[ 0.522431, -0.118259, -0.003304,  0.450749, -0.030897,  0.1499  ,
         0.07167 , -0.145986, -0.025632, -0.278439, -0.021617, -0.100983,
        -0.252881],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 225 / 225 (100%)
Max absolute difference: 1.21126013
Max relative difference: 1.21126013
 x: array([[ 0.008006,  0.003634,  0.082993, -0.105183,  0.469302, -0.159896,
        -0.186092,  0.237852,  0.166177, -0.004724,  0.300496, -0.172572,
         0.054354,  0.01367 ,  0.251432],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_tall - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.29536363
Max relative difference: 1.29536363
 x: array([[ 1.839437e-01,  3.666864e-03,  5.269710e-01, -9.558372e-02,
         4.485931e-01, -1.068802e-01, -3.599494e-01,  2.523912e-01,
         5.202088e-01,  7.875285e-02, -2.388350e-01,  1.856074e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.22226353
Max relative difference: 1.22226353
 x: array([[ 0.30203 ,  0.289442,  0.491229,  0.232481,  0.069349, -0.017829,
         0.0731  , -0.101897, -0.061624,  0.032908, -0.294819, -0.209391],
       [ 0.289442, -0.027515, -0.225598, -0.00597 ,  0.261011,  0.194242,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 100 / 100 (100%)
Max absolute difference: 1.52807027
Max relative difference: 1.52807027
 x: array([[ 0.476516,  0.678434,  0.487398,  0.170842, -0.530036, -0.049983,
        -0.051561, -0.034272,  0.340691, -0.532899],
       [ 0.678434, -0.52807 , -0.086754,  0.512772,  0.126919,  0.114655,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.33379635
Max relative difference: 1.33379635
 x: array([[ 0.407052,  0.457873, -0.2282  ,  0.20684 ,  0.335016, -0.217718,
         0.024833, -0.165538,  0.372844,  0.298751, -0.199244, -0.277085],
       [ 0.457873, -0.333796,  0.153424,  0.595791, -0.424009,  0.076896,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_tall - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 196 / 196 (100%)
Max absolute difference: 1.45184031
Max relative difference: 1.45184031
 x: array([[ 1.306703e-01,  2.308598e-01,  1.503783e-02,  4.989481e-01,
         2.612073e-01, -6.566251e-02, -1.365806e-02, -4.439392e-01,
        -9.274840e-02, -3.816905e-02,  2.477478e-01,  1.054653e-01,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_eco - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 100 / 100 (100%)
Max absolute difference: 1.37845999
Max relative difference: 1.37845999
 x: array([[ 0.488817,  0.293726,  0.560871, -0.452365,  0.316418,  0.060158,
         0.176355,  0.412072, -0.13077 ,  0.404673],
       [ 0.293726,  0.266032, -0.246029,  0.125679, -0.167877,  0.233249,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.60243899
Max relative difference: 1.60243899
 x: array([[-3.211651e-01,  3.666854e-03,  5.269712e-01, -1.675753e-01,
         5.411102e-01, -1.068804e-01, -3.599494e-01,  1.086038e-02,
         4.765480e-01,  7.875297e-02, -2.388351e-01,  4.631867e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.22226353
Max relative difference: 1.22226353
 x: array([[ 0.038019,  0.289442,  0.491229,  0.232482,  0.065881, -0.01783 ,
         0.073099, -0.101897,  0.340713,  0.032909, -0.294819, -0.209391],
       [ 0.289442, -0.027515, -0.225598, -0.00597 ,  0.170632,  0.194242,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_Mx1_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.35482377
Max relative difference: 1.35482377
 x: array([[ 0.204203,  0.081063,  0.547405, -0.497832,  0.44612 , -0.364956,
         0.282041,  0.048404, -0.144208],
       [ 0.081063,  0.102958, -0.048356,  0.717492,  0.188318, -0.23341 ,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_Mx1_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.33370879
Max relative difference: 1.33370879
 x: array([[ 0.421005,  0.417547, -0.32667 , -0.29249 ,  0.282903,  0.253645,
        -0.110355, -0.220882, -0.263948, -0.180241,  0.751357],
       [ 0.417547, -0.047571, -0.367514, -0.214091, -0.303108, -0.364512,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_tall_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_tall_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_unit_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_unit_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_neg_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_neg_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_itemsize_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_itemsize_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_native_byte_order_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_native_byte_order_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_lapack.py::test_pftri - AssertionError: 
Arrays are not almost equal to 4 decimals

Mismatched elements: 21 / 400 (5.25%)
Max absolute difference: 0.00037931
Max relative difference: 0.64988735
 x: array([[ 5.0451e-02, -1.1576e-03,  2.7290e-04, -1.5024e-03, -1.7656e-03,
        -1.3410e-03, -1.4870e-03, -7.1398e-04, -1.4734e-03, -2.5769e-03,
        -2.0850e-03, -9.8616e-04, -7.3829e-04, -1.9978e-03,  1.7069e-04,...
 y: array([[ 5.0565e-02, -1.0042e-03,  2.1366e-04, -1.5335e-03, -1.5981e-03,
        -1.4567e-03, -1.5799e-03, -5.9890e-04, -1.4266e-03, -2.5949e-03,
        -2.0850e-03, -9.8616e-04, -7.3829e-04, -1.9978e-03,  1.7069e-04,...
FAILED linalg/tests/test_lapack.py::test_sfrk_hfrk - AssertionError: 
Arrays are not almost equal to 4 decimals

Mismatched elements: 165 / 400 (41.2%)
Max absolute difference: 1.14951146
Max relative difference: 14.46566384
 x: array([[ 3.9575e+01,  1.3012e+00,  5.5721e-02,  1.6919e+00,  1.3906e+00,
         1.7789e+00,  8.5231e-01,  8.1178e-01,  1.2308e+00,  2.1547e+00,
         1.7334e+00,  6.0473e-01,  2.1888e-01,  2.0501e+00, -1.1836e-01,...
 y: array([[ 3.9575e+01,  1.3012e+00,  2.2163e-01,  1.2076e+00,  1.4051e+00,
         1.8348e+00,  1.0907e+00,  1.0859e+00,  1.3009e+00,  2.1895e+00,
         1.3301e+00,  1.5722e+00,  1.7302e-01,  1.5784e+00,  1.6231e-01,...
FAILED linalg/tests/test_lapack.py::TestBlockedQR::test_geqrt_gemqrt - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-05

Mismatched elements: 320 / 400 (80%)
Max absolute difference: 1.4186668
Max relative difference: 1.4186668
 x: array([[ 4.153938e-01,  3.214427e-01, -1.697152e-01, -2.782870e-01,
         2.549522e-01,  3.815206e-01, -1.836173e-01, -8.294257e-03,
         2.499608e-01,  1.465432e-02,  1.211796e-01, -2.663902e-01,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
        0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,...
FAILED linalg/tests/test_lapack.py::TestBlockedQR::test_tpqrt_tpmqrt - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-05

Mismatched elements: 1024 / 1600 (64%)
Max absolute difference: 1.2731317
Max relative difference: 1.2731317
 x: array([[ 3.782889e-03,  1.856932e-02,  1.523624e-02, ..., -1.549972e-01,
         2.169387e-01, -3.143149e-01],
       [ 1.856932e-02,  4.894961e-02, -5.576465e-02, ...,  2.150272e-02,...
 y: array([[1., 0., 0., ..., 0., 0., 0.],
       [0., 1., 0., ..., 0., 0., 0.],
       [0., 0., 1., ..., 0., 0., 0.],...
FAILED linalg/tests/test_lapack.py::test_pstrf - AssertionError: 
Not equal to tolerance rtol=0, atol=0.000119209

Mismatched elements: 85 / 100 (85%)
Max absolute difference: 3.529682
Max relative difference: 1.4060138
 x: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 3.422926, 2.103169],
       [2.2597  , 2.130606, 1.477844, 1.633565, 2.117459, 1.866201,...
 y: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 0.      , 0.      ],
       [2.2597  , 2.38366 , 1.007861, 2.456765, 2.693789, 1.169568,...
FAILED linalg/tests/test_lapack.py::test_pstf2 - AssertionError: 
Not equal to tolerance rtol=0, atol=0.000119209

Mismatched elements: 85 / 100 (85%)
Max absolute difference: 3.529682
Max relative difference: 1.4060138
 x: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 3.422926, 2.103169],
       [2.2597  , 2.130606, 1.477844, 1.633565, 2.117459, 1.866201,...
 y: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 0.      , 0.      ],
       [2.2597  , 2.38366 , 1.007861, 2.456765, 2.693789, 1.169568,...
osx + x64 + accelerate: 1 failure
FAILED interpolate/tests/test_rbfinterp.py::TestRBFInterpolatorNeighbors20::test_pickleable - AssertionError: 
Arrays are not equal

Mismatched elements: 4 / 50 (8%)
Max absolute difference: 5.55111512e-17
Max relative difference: 9.28510161e-16
 x: array([-0.238461,  0.257024, -0.811244,  0.295313,  0.132623,  0.2038  ,
       -0.99615 ,  0.29755 , -0.019889,  0.230791, -0.516801,  0.279867,
        0.227767,  0.178071, -0.172756,  0.251327, -0.406818,  0.271919,...
 y: array([-0.238461,  0.257024, -0.811244,  0.295313,  0.132623,  0.2038  ,
       -0.99615 ,  0.29755 , -0.019889,  0.230791, -0.516801,  0.279867,
        0.227767,  0.178071, -0.172756,  0.251327, -0.406818,  0.271919,...
osx + x64 + mkl + pypy: 2 failures
FAILED linalg/tests/test_decomp_cossin.py::test_cossin[True-40-12-20-float32] - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-06

Mismatched elements: 166 / 1600 (10.4%)
Max absolute difference: 1.2262093
Max relative difference: 2.0001094
 x: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [-0.233614, -0.048775, -0.223086, ...,  0.      ,  0.      ,...
 y: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048775,  0.223086, ...,  0.      ,  0.      ,...
FAILED linalg/tests/test_decomp_cossin.py::test_cossin[False-40-12-20-float32] - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-06

Mismatched elements: 156 / 1600 (9.75%)
Max absolute difference: 1.1218276
Max relative difference: 2.0000126
 x: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048776,  0.223085, ...,  0.      ,  0.      ,...
 y: array([[ 0.088203, -0.328941, -0.031065, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048776,  0.223085, ...,  0.      ,  0.      ,...
windows + openblas: 9-12 failures
FAILED _lib/tests/test_import_cycles.py::test_public_modules_importable - AssertionError: Failed to import scipy.cluster
assert 1 == 0
 +  where 1 = <bound method Popen.wait of <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>>()
 +    where <bound method Popen.wait of <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>> = <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>.wait
FAILED interpolate/tests/test_interpnd.py::TestCloughTocher2DInterpolator::test_dense
FAILED linalg/tests/test_basic.py::TestLstsq::test_random_exact
FAILED linalg/tests/test_decomp.py::TestEig::test_bad_geneig - AssertionError: 
Not equal to tolerance rtol=1e-07, atol=1e-07

array([[ 1.    ,  0.    ,  0.    ,  0.    ],
       [ 0.    ,  1.    ,  0.    ,  0.    ],
       [ 0.    ,  0.    , -8.9975,  0.    ],
       [ 0.    ,  0.    ,  0.    , -8.9975]])
array([[ 0. ,  0. ,  1. ,  0. ],
       [ 0. ,  0. ,  0. ,  1. ],
       [ 1. ,  0. ,  0. , -0.1],
       [ 0. ,  1. ,  0.1,  0. ]])
Mismatched elements: 3 / 4 (75%)
Max absolute difference: 6.
Max relative difference: 2.03389831
 x: array([0.000000e+00-3.05j, 0.000000e+00+3.05j, 1.001943e-16-2.95j,
       1.001943e-16+2.95j])
 y: array([0.-3.05j, 0.-2.95j, 0.+2.95j, 0.+3.05j])
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-float32]
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-float64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-complex64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-float32]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-float64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-complex64]
FAILED spatial/tests/test_qhull.py::TestUtilities::test_more_barycentric_transforms
FAILED spatial/tests/test_qhull.py::TestUtilities::test_degenerate_barycentric_transforms

@h-vetinari

Copy link
Copy Markdown
Member Author

While preparing the update for 1.13, I noticed that I had failed to mention/count the new failures on linux+blis correctly; updated the previous comment accordingly.

@h-vetinari

Copy link
Copy Markdown
Member Author

Closing as obsolete now that 1.14 is out (and 1.12 patch releases basically an impossibility)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants