fix: remove flaky test from compat tests #6001

Job	Run time
manylinux.aarch64.py${{ matrix.config.version }}.build	0s
manylinux.amd64.py3.6.build	4m 13s
manylinux.amd64.py3.7.build	4m 3s
ubuntu-latest.amd64.py3.8.sdist-bundle	1m 3s
manylinux.amd64.py3.8.build	4m 14s
manylinux.amd64.py3.9.build	4m 6s
macos.amd64.py3.6.build	5m 18s
manylinux.amd64.py3.10.build	4m 9s
windows-2019.amd64.py3.6.build	13m 19s
macos.amd64.py3.7.build	6m 56s
windows-2019.amd64.py3.7.build	6m 36s
macos.amd64.py3.8.build	5m 59s
windows-2019.amd64.py3.8.build	6m 37s
macos.amd64.py3.9.build	5m 10s
windows-2019.amd64.py3.9.build	6m 30s
macos.amd64.py3.10.build	4m 51s
windows-2019.amd64.py3.10.build	6m 40s
manylinux.aarch64.py${{ matrix.config.version }}.test	0s
ubuntu-latest.amd64.py3.8.sdist-build-test	4m 54s
manylinux.amd64.py3.6.test	3m 25s
manylinux.amd64.py3.7.test	3m 4s
manylinux.amd64.py3.8.test	2m 38s
manylinux.amd64.py3.9.test	2m 47s
manylinux.amd64.py3.10.test	2m 22s
macos.amd64.py3.6.test	3m 39s
macos.amd64.py3.7.test	3m 19s
macos.amd64.py3.8.test	6m 22s
macos.amd64.py3.9.test	8m 22s
macos.amd64.py3.10.test	7m 33s
windows-2019.amd64.py3.6.test	5m 0s
windows-2019.amd64.py3.7.test	5m 0s
windows-2019.amd64.py3.8.test	5m 1s
windows-2019.amd64.py3.9.test	5m 1s
windows-2019.amd64.py3.10.test	5m 0s
	2h 43m 11s

Provide feedback