Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AutoTVM] Fix hang/crash issues on feature extraction #3689

Merged
merged 3 commits into from
Aug 2, 2019

Conversation

merrymercy
Copy link
Member

@merrymercy merrymercy commented Aug 1, 2019

Currently, if a schedule is invalid and makes tvm crashes during tvm.lower (e.g. failed tensorization), then it will make the XGBTuner with feature_type="itervar" crashes or hangs.

This pr fixes it and enables the tuners to tolerate these invalid schedules.

@merrymercy merrymercy requested a review from eqy August 1, 2019 13:41
@merrymercy
Copy link
Member Author

cc @cbalint13 @eqy

Copy link
Contributor

@cbalint13 cbalint13 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@merrymercy merrymercy requested a review from vinx13 August 2, 2019 04:55
feature_len = None
for idx in indexes:
if fea_cache[idx] is not None:
feature_len = fea_cache[idx].shape[-1]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is fea_cache[idx].shape[-1] the same for all non-None element in fea_cache?
Is break missing here?

Copy link
Member Author

@merrymercy merrymercy Aug 2, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch. A break is missing.
All non-None elements should have the same length, otherwise it will raise error in L324

@vinx13 vinx13 merged commit 8ad36a1 into apache:master Aug 2, 2019
@merrymercy merrymercy deleted the pr-fix-feature branch August 3, 2019 12:14
wweic pushed a commit to wweic/tvm that referenced this pull request Aug 9, 2019
* [AutoTVM] Fix hang/crash issues on feature extraction

* Update xgboost_cost_model.py

* fix lint
wweic pushed a commit to neo-ai/tvm that referenced this pull request Sep 6, 2019
* [AutoTVM] Fix hang/crash issues on feature extraction

* Update xgboost_cost_model.py

* fix lint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants