Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Nightly tests fail with "Cannot find TVM op config" #16704

Closed
ptrendx opened this issue Nov 1, 2019 · 7 comments
Closed

Nightly tests fail with "Cannot find TVM op config" #16704

ptrendx opened this issue Nov 1, 2019 · 7 comments

Comments

@ptrendx
Copy link
Member

ptrendx commented Nov 1, 2019

Description

Nightly tests on master branch fail with Cannot find the TVM op config message (look e.g. here: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/NightlyTestsForBinaries/detail/master/493/pipeline)

Error Message

======================================================================

ERROR: Failure: RuntimeError (Cannot find the TVM op config.

List of candidates:

/work/mxnet/python/mxnet/../../lib/tvmop.conf

/work/mxnet/python/mxnet/../../build/tvmop.conf)

----------------------------------------------------------------------

Traceback (most recent call last):

  File "/usr/local/lib/python2.7/dist-packages/nose/loader.py", line 418, in loadTestsFromName

    addr.filename, addr.module)

  File "/usr/local/lib/python2.7/dist-packages/nose/importer.py", line 47, in importFromPath

    return self.importFromDir(dir_path, fqname)

  File "/usr/local/lib/python2.7/dist-packages/nose/importer.py", line 94, in importFromDir

    mod = load_module(part_fqname, fh, filename, desc)

  File "/work/mxnet/tests/nightly/estimator/test_estimator_cnn.py", line 23, in <module>

    import mxnet as mx

  File "/work/mxnet/python/mxnet/__init__.py", line 90, in <module>

    from . import tvmop

  File "/work/mxnet/python/mxnet/tvmop.py", line 34, in <module>

    _CONF_TVM_OP = find_conf_path("tvmop")

  File "/work/mxnet/python/mxnet/libinfo.py", line 140, in find_conf_path

    'List of candidates:\n' + str('\n'.join(candidates_path)))

RuntimeError: Cannot find the TVM op config.

List of candidates:

/work/mxnet/python/mxnet/../../lib/tvmop.conf

/work/mxnet/python/mxnet/../../build/tvmop.conf

@apeforest @szha @reminisce

@ptrendx ptrendx added the Bug label Nov 1, 2019
@szha
Copy link
Member

szha commented Nov 2, 2019

@yzhliu

@hzfan
Copy link
Contributor

hzfan commented Nov 11, 2019

Thank @ptrendx. I created a fix in #16773

@samskalicky
Copy link
Contributor

@zachgk assign @szha

@ptrendx
Copy link
Member Author

ptrendx commented Nov 12, 2019

@hzfan @szha How can we test this fix without merging and waiting for the nightly tests?

@samskalicky
Copy link
Contributor

@ptrendx #16773 is merged, can you cherry pick into 1.6?

@ptrendx
Copy link
Member Author

ptrendx commented Nov 15, 2019

Nightly tests did not run yet, are you sure it fixes the failures?

@ptrendx
Copy link
Member Author

ptrendx commented Nov 19, 2019

Fix merged to both master and 1.6, closing.

@ptrendx ptrendx closed this as completed Nov 19, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

6 participants