Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle trials with corrupted status #372

Merged

Conversation

bouthilx
Copy link
Member

@bouthilx bouthilx commented Apr 1, 2020

Why:

Database corruption occurs when there is Timeouts in PickledDB. The objective is saved but status is not set to completed.

How:

We catch non-completed trials with objective and log a warning with a pointer to documentation to manually fix corrupted trials.

Note:

Also add substantial documentation on storage which was required to document what the user can do to fix the database corruption.

@bouthilx bouthilx added bug Indicates an unexpected problem or unintended behavior documentation Regarding description, documentation, tutorials, etc v0.1.8 labels Apr 1, 2020
@bouthilx bouthilx requested a review from Thomsch April 1, 2020 01:47
@bouthilx
Copy link
Member Author

bouthilx commented Apr 1, 2020

bouthilx added 5 commits April 1, 2020 09:08
Why:

The helper functions were in different modules which was confusing.
Moving them to storage/base and storage/legacy makes it more coherent.
Why:

The method fetch many trials, not only one, hence the name is confusing.
Why:

Database corruption occurs when there is Timeouts in PickledDB. The
objective is saved but status is not set to completed.

How:

We catch
non-completed trials with objective and log a warning with a pointer to
documentation to manually fix corrupted trials.
@bouthilx bouthilx force-pushed the fix/handle_corrupt_trials_status branch from f529bf8 to e28a934 Compare April 1, 2020 13:08
@bouthilx
Copy link
Member Author

bouthilx commented Apr 1, 2020

Closing and reopening to trigger build on travis-ci.com (migrated from travis-ci.org few minutes ago).

@bouthilx bouthilx closed this Apr 1, 2020
@bouthilx bouthilx reopened this Apr 1, 2020
@codecov-io
Copy link

codecov-io commented Apr 1, 2020

Codecov Report

Merging #372 into develop will decrease coverage by 0.23%.
The diff coverage is 27.15%.

Impacted file tree graph

@@             Coverage Diff             @@
##           develop     #372      +/-   ##
===========================================
- Coverage    45.45%   45.22%   -0.24%     
===========================================
  Files           67       67              
  Lines        12245    12388     +143     
  Branches       306      306              
===========================================
+ Hits          5566     5602      +36     
- Misses        6654     6761     +107     
  Partials        25       25              
Impacted Files Coverage Δ
tests/unittests/storage/test_storage.py 16.90% <21.33%> (+0.48%) ⬆️
tests/unittests/storage/test_legacy.py 31.89% <28.07%> (-4.78%) ⬇️
tests/unittests/core/test_strategy.py 37.50% <44.44%> (+2.71%) ⬆️
src/orion/core/__init__.py 95.23% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9dbfdef...e28a934. Read the comment docs.

@bouthilx bouthilx mentioned this pull request Apr 1, 2020
@Thomsch Thomsch merged commit e28a934 into Epistimio:develop Apr 6, 2020
This was referenced Jun 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Indicates an unexpected problem or unintended behavior documentation Regarding description, documentation, tutorials, etc v0.1.8
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants