Skip to content

[ci] MacOS CI failing in RPC tests #13185

New issue
New issue
Closed
Closed
[ci] MacOS CI failing in RPC tests#13185
Labels
type:ciRelates to TVM CI infrastructure
@driazati

Description

@driazati
driazati
opened on Oct 24, 2022
``` ============================= test session starts ============================== platform darwin -- Python 3.7.13, pytest-7.1.2, pluggy-1.0.0 -- /usr/local/miniconda/envs/tvm-build/bin/python cachedir: .pytest_cache rootdir: /Users/runner/work/tvm/tvm collecting ... collected 12 items

tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session FAILED [ 8%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_standalone PASSED [ 16%]
tests/python/contrib/test_rpc_server_device.py::test_cleanup_workspace_after_session_end XFAIL [ 25%]
tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run FAILED [ 33%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_standalone PASSED [ 41%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_proxy PASSED [ 50%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_proxy PASSED [ 58%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_tracker PASSED [ 66%]
tests/python/contrib/test_rpc_server_device.py::test_check_auto_schedule_tuning XFAIL [ 75%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_tracker PASSED [ 83%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_tracker_via_proxy PASSED [ 91%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_tracker_via_proxy PASSED [100%]

=================================== FAILURES ===================================
___________________ test_basic_functionality_of_rpc_session ____________________

def wrapper():
    with server_ios_launcher.ServerIOSContextManager(
        mode=server_ios_launcher.RPCServerMode.standalone.value,
        host=HOST_URL,
        port=HOST_PORT,
        key=DEVICE_KEY,
    ) as ios_server:

      f(host=ios_server.host, port=ios_server.port)

tests/python/contrib/test_rpc_server_device.py:81:

tests/python/contrib/test_rpc_server_device.py:320: in test_basic_functionality_of_rpc_session
lib = remote_session.load_module(DSO_NAME)
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/rpc/client.py:159: in load_module
return _ffi_api.LoadRemoteModule(self._sess, path)
tvm/_ffi/_cython/./packed_func.pxi:331: in tvm._ffi._cy3.core.PackedFuncBase.call
???
tvm/_ffi/_cython/./packed_func.pxi:262: in tvm._ffi._cy3.core.FuncCall
???
tvm/_ffi/_cython/./packed_func.pxi:251: in tvm._ffi._cy3.core.FuncCall3
???

???
E tvm.error.RPCError: Traceback (most recent call last):
E [bt] (8) 9 libtvm.dylib 0x0000000122160577 tvm::runtime::RPCWrappedFunc::operator()(tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) const + 1431
E [bt] (7) 8 libtvm.dylib 0x00000001221598ac tvm::runtime::RPCClientSession::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)> const&) + 124
E [bt] (6) 7 libtvm.dylib 0x00000001221513d7 tvm::runtime::RPCEndpoint::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)>) + 327
E [bt] (5) 6 libtvm.dylib 0x000000012214fcfe tvm::runtime::RPCEndpoint::HandleUntilReturnEvent(bool, std::__1::function<void (tvm::runtime::TVMArgs)>) + 814
E [bt] (4) 5 libtvm.dylib 0x000000012214ffae tvm::runtime::RPCEndpoint::EventHandler::HandleNextEvent(bool, bool, std::__1::function<void (tvm::runtime::TVMArgs)>) + 494
E [bt] (3) 4 libtvm.dylib 0x0000000122154162 tvm::runtime::RPCEndpoint::EventHandler::HandleProcessPacket(std::__1::function<void (tvm::runtime::TVMArgs)>) + 386
E [bt] (2) 3 libtvm.dylib 0x0000000122156235 tvm::runtime::RPCEndpoint::EventHandler::HandleReturn(tvm::runtime::RPCCode, std::__1::function<void (tvm::runtime::TVMArgs)>) + 213
E [bt] (1) 2 libtvm.dylib 0x000000012038fff9 tvm::runtime::detail::LogFatal::Entry::Finalize() + 89
E [bt] (0) 1 libtvm.dylib 0x00000001220cba18 tvm::runtime::Backtrace() + 24
E [bt] (8) 9 libtvm_runtime.dylib 0x000000010db74d0d tvm::runtime::LocalSession::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)> const&) + 61
E [bt] (7) 8 tvmrpc 0x000000010d5449ca tvm::runtime::PackedFuncObj::Extractor<tvm::runtime::PackedFuncSubObjtvm::runtime::$_1 >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) + 356
E [bt] (6) 7 libtvm_runtime.dylib 0x000000010dadc820 tvm::runtime::Module::LoadFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) + 1024
E [bt] (5) 6 tvmrpc 0x000000010d544de4 tvm::runtime::PackedFuncObj::Extractor<tvm::runtime::PackedFuncSubObjtvm::runtime::$_2 >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) + 162
E [bt] (4) 5 tvmrpc 0x000000010d545028 tvm::runtime::UnsignedDSOLoader::Init(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) + 312
E [bt] (3) 4 tvmrpc 0x000000010d53cd99 tvm::runtime::detail::LogFatal::~LogFatal() + 9
E [bt] (2) 3 tvmrpc 0x000000010d542d87 tvm::runtime::detail::LogFatal::~LogFatal() + 63
E [bt] (1) 2 tvmrpc 0x000000010d541982 tvm::runtime::detail::LogFatalImpl(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, std::__1::basic_string<char, std::__1::char_traits, std::_1::allocator > const&) + 82
E [bt] (0) 1 libtvm_runtime.dylib 0x000000010dad45a8 tvm::runtime::Backtrace() + 24
E File "/usr/local/miniconda/envs/tvm-build/conda-bld/tvm-package_1666630917786/work/src/runtime/rpc/rpc_endpoint.cc", line 376
E RPCError: Error caught from RPC call:
E [18:25:04] /Users/runner/work/tvm/tvm/apps/ios_rpc/tvmrpc/TVMRuntime.mm:98:
E ---------------------------------------------------------------
E An error occurred during the execution of TVM.
E For more information, please see: https://tvm.apache.org/docs/errors.html
E ---------------------------------------------------------------
E Check failed: (lib_handle != nullptr) is false: Failed to load dynamic shared library /Users/runner/Library/Developer/CoreSimulator/Devices/7EDC75D2-89BC-4138-88C2-F5538F273DFF/data/Containers/Data/Application/EB676A89-0020-4F67-9A5C-1F4DAD337B23/tmp/lib.dylib Error happens during dlopen execution. Unimplemented

tvm/_ffi/_cython/./base.pxi:181: RPCError
________________________ test_graph_executor_remote_run ________________________

def wrapper():
    with server_ios_launcher.ServerIOSContextManager(
        mode=server_ios_launcher.RPCServerMode.standalone.value,
        host=HOST_URL,
        port=HOST_PORT,

=============================== warnings summary ===============================
tests/python/contrib/test_rpc_server_device.py:224
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:224: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:232
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:232: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:242
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:242: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:252
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:252: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:262
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:262: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:271
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:271: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_proxy"])

tests/python/contrib/test_rpc_server_device.py:280
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:280: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker"])

tests/python/contrib/test_rpc_server_device.py:289
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:289: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker_via_proxy"])

tests/python/contrib/test_rpc_server_device.py:298
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:298: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:332
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:332: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:357
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:357: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:393
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:393: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker"])

tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session
tests/python/contrib/test_rpc_server_device.py::test_cleanup_workspace_after_session_end
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/driver/build_module.py:265: UserWarning: target_host parameter is going to be deprecated. Please pass in tvm.target.Target(target, host=target_host) instead.
"target_host parameter is going to be deprecated. "

tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/target/target.py:323: UserWarning: target_host parameter is going to be deprecated. Please pass in tvm.target.Target(target, host=target_host) instead.
"target_host parameter is going to be deprecated. "

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session
FAILED tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run
======= 2 failed, 8 passed, 2 xfailed, 15 warnings in 398.49s (0:06:38) ========

</details>



cc @Mousius @areusch @gigiblender

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:ciRelates to TVM CI infrastructure

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions