Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DATA SUBMISSION] random search on the bbob-constrained test suite #2094

Closed
paulduf opened this issue Mar 31, 2022 · 2 comments
Closed

[DATA SUBMISSION] random search on the bbob-constrained test suite #2094

paulduf opened this issue Mar 31, 2022 · 2 comments

Comments

@paulduf
Copy link
Collaborator

paulduf commented Mar 31, 2022

Hello COCO developer!

Here is the random search data with a relatively large budget (2x10^5 times dimension (f+g) evals)

Reference and Description of the Algorithm

This data was generated from the example_experiment2.py script in the cocoex module using cocoex.solvers.random_search.
The batch implementation of random search has been recently modified to be compliant with the performance assessment in the constrained case in this commit.
The previous implementation was querying first the objective for all sampled points in the batch, then all constaints, which caused trouble in the target triggering and undesirable plateaux in the ECDFs

Link to Data

The zipped file on google drive is roughly 40MB
https://drive.google.com/file/d/1RR7ywjaZUUAecKyNq5AKxmUdYeFrpc3b/view?usp=sharing

Optional: Source Code of Experiment

The source code is in the cocoex module.

@brockho
Copy link
Contributor

brockho commented Apr 5, 2022

Thanks, @paulduf, for the data submission. I could download the data from the provided link and will take care that it appears in the official data archive.

@brockho
Copy link
Contributor

brockho commented Apr 9, 2022

I don't know why it takes that long for the Github Pages to deploy, but the data is cleaned up and committed to the repository since Thursday: https://github.com/numbbo/data-archive/tree/gh-pages/data-archive/bbob-constrained/2022

I will leave this issue still here until the webpage shows up and until we can therefore access the data set directly in the postprocessing module (right now, the outdated archive definition file is loaded - as long as the webpage is not updated).

The same holds for the data of #2063 and #2065.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants