Skip to content

Multi Objective CNN benchmark - [WIP] #147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 40 commits into from
Jun 1, 2022
Merged

Multi Objective CNN benchmark - [WIP] #147

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
f8f2702
-added mo cnn benchmarks from bag of baseline paper
ayushi-3536 May 5, 2022
d2b3762
-removing log from categorical cs
ayushi-3536 May 6, 2022
0107e43
- integrating data loaded output
ayushi-3536 May 6, 2022
d5cfa1c
integration of data manager with bench;changes in cs paramname
May 6, 2022
bf9d525
- removing unwanted logs
ayushi-3536 May 6, 2022
ba31486
Merge branch 'development' of github.com:automl/HPOBench into mo_cnn
ayushi-3536 May 12, 2022
074c43a
- added singularity config for mo cnn benches
ayushi-3536 May 12, 2022
2251c77
add \ to the end of command
ayushi-3536 May 12, 2022
ed8846a
remove redundant command
ayushi-3536 May 12, 2022
d5fed0c
cleanup
ayushi-3536 May 12, 2022
9350ca5
- rebase mo interface
ayushi-3536 May 12, 2022
f76ea99
- removing sample size fidelity
ayushi-3536 May 12, 2022
6285096
Revert "- removing sample size fidelity"
ayushi-3536 May 12, 2022
10dbfa7
- removed hard coded input size and output class to facilitate integr…
ayushi-3536 May 16, 2022
d009268
Incorporate Requests
PhMueller May 17, 2022
23e5cfc
Make deterministic
PhMueller May 17, 2022
d85732c
Add test file
PhMueller May 17, 2022
55684c3
Fix Test Config
PhMueller May 17, 2022
17b48e3
- report total elapsed time in obj func as cost(as in original bench)
ayushi-3536 May 19, 2022
945e720
Update Recipe
PhMueller May 20, 2022
0400bf2
Add init and log statement
PhMueller May 20, 2022
86f18c0
Add __init__ files
PhMueller May 24, 2022
30815af
Clean up
PhMueller May 24, 2022
05cf152
Allow to evaluate the test performance on different budgets
PhMueller May 24, 2022
5baa3b1
Enable the gpu automatically for the container.
PhMueller May 24, 2022
396dfb4
Adapt Test
PhMueller May 24, 2022
c1ee943
Add missing signatures
PhMueller May 30, 2022
82a842c
Return training time instead of evaluation time.
PhMueller May 30, 2022
4b64dcb
Fix dependency version
PhMueller May 30, 2022
74c50f5
Update CNN Mo Tests
PhMueller May 30, 2022
47a9c64
-add conditional dependencies in search space
ayushi-3536 May 31, 2022
c7ec827
Update tests
PhMueller May 31, 2022
6262ebc
Merge remote-tracking branch 'fork_ayushi/mo_cnn' into mo_cnn
PhMueller May 31, 2022
c5921ab
Update tests
PhMueller May 31, 2022
65740ec
Simlify ConfigSpace. + Update Tests.
PhMueller May 31, 2022
a4ab38e
Simlify ConfigSpace. + Update Tests.
PhMueller May 31, 2022
863ad6d
Simlify ConfigSpace. + Update Tests.
PhMueller May 31, 2022
47b8978
Change returned Objectives
PhMueller Jun 1, 2022
cf7ccfa
Change returned Objectives.. again
PhMueller Jun 1, 2022
761a7ee
Change inheritance in container benchmark
PhMueller Jun 1, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions extra_requirements/mo_cnn.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
{
"mo_cnn": [
"tqdm>=3.0.0",
"torch==1.9.0",
"pandas==1.2.4"
]
}
Empty file added hpobench/benchmarks/mo/__init__.py
View file
Open in desktop
Empty file.
Loading