Skip to content

Commit

Permalink
added latest data archive submission also to webpage,
Browse files Browse the repository at this point in the history
added list of algorithms for each year on performance comparison pages for bbob (update) and bbob-biobj (new)
  • Loading branch information
brockho committed Jan 26, 2025
1 parent 62f6035 commit 6b9545e
Show file tree
Hide file tree
Showing 4 changed files with 75 additions and 17 deletions.
4 changes: 2 additions & 2 deletions _quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -82,10 +82,10 @@ website:
href: testsuites/bbob-biobj/def.qmd
- text: Gradient Angle Plots
href: testsuites/bbob-biobj/ecdfs.qmd
- text: Performance Comparison
href: testsuites/bbob-biobj/performancecomparisons.qmd
- text: Data Archive
href: testsuites/bbob-biobj/data-archive.qmd
- text: Postprocessed Data
href: testsuites/bbob-biobj/ppdata.qmd
- section: bbob-biobj-mixint
- section: bbob-boxed
contents:
Expand Down
8 changes: 8 additions & 0 deletions assets/data/data-archive.json
Original file line number Diff line number Diff line change
Expand Up @@ -2575,6 +2575,14 @@
"dataset": "https://raw.githubusercontent.com/numbbo/data-archive/gh-pages/data-archive/bbob-largescale/2022/MTSLS1-9_Tanabe.tgz",
"comment": "Multiple Trajectory Search with local search LS1 and parameter c set to 0.9: [BBOB-2022 paper](https://arxiv.org/pdf/2204.13284)"
},
{
"suite": "bbob-largescale",
"algorithm": "RANDOMSEARCH",
"year": 2024,
"author": "Brockhoff",
"dataset": "https://raw.githubusercontent.com/numbbo/data-archive/gh-pages/data-archive/bbob-largescale/2024/RANDOMSEARCH_Brockhoff.zip",
"comment": "Simple random sampling, uniformly distributed in $[-5,5]^n$"
},
{
"suite": "bbob-constrained",
"algorithm": "RandomSearch-5",
Expand Down
46 changes: 46 additions & 0 deletions testsuites/bbob-biobj/performancecomparisons.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
---
title: Performance Visualizations for the `bbob-biobj` test suite
---

Below, we provide postprocessed data showing the performance of all [30+ officially supported algorithm data sets](../../../../data-archive/bbob-biobj.html) for the `bbob-biobj` test suite.

Due to the large amount of algorithms (and the limited space in the figures), we currently group algorithm data sets by year of publication.


## Performance Comparisons per Year

```{python}
#| echo: false
#| output: asis
import re
import sys
sys.path.insert(1, '../../scripts/')
from IPython.display import Markdown
import cocopp
for year in range(2016, 2030):
dd = cocopp.bbob_biobj.find(str(year))
if len(dd) > 1:
dda = [(re.search('/(.*)', d.partition('_')[0]).group(1)) for d in dd]
display(Markdown("\n- [{0}](https://numbbo.github.io/ppdata-archive/bbob-biobj/{0}/index.html):".format(year)))
display(Markdown("{0}".format(', '.join(dda))))
```



## Example code to produce the figures

The Python code to locally generate the second entry, 2019,
above (other entries work respectively) reads

```python
import cocopp # see https://pypi.org/project/cocopp
cocopp.genericsettings.background = {None: cocopp.archives.bbob_biobj.get_all('2016')}
cocopp.main('bbob-biobj/2019/*') # will take several minutes to process

```


34 changes: 19 additions & 15 deletions testsuites/bbob/performancecomparisons.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -9,21 +9,25 @@ Due to the large amount of algorithms (and the limited space in the figures), we

## Performance Comparisons per Year

```{python}
#| echo: false
#| output: asis
- [2009](https://numbbo.github.io/ppdata-archive/bbob/2009/index.html)
- [2010](https://numbbo.github.io/ppdata-archive/bbob/2010/index.html)
- [2012](https://numbbo.github.io/ppdata-archive/bbob/2012/index.html)
- [2013](https://numbbo.github.io/ppdata-archive/bbob/2013/index.html)
- [2014](https://numbbo.github.io/ppdata-archive/bbob/2014/index.html)
- [2015](https://numbbo.github.io/ppdata-archive/bbob/2015/index.html)
- [2016](https://numbbo.github.io/ppdata-archive/bbob/2016/index.html)
- [2017](https://numbbo.github.io/ppdata-archive/bbob/2017/index.html)
- [2018](https://numbbo.github.io/ppdata-archive/bbob/2018/index.html)
- [2019](https://numbbo.github.io/ppdata-archive/bbob/2019/index.html)
- [2020](https://numbbo.github.io/ppdata-archive/bbob/2020/index.html)
- [2021](https://numbbo.github.io/ppdata-archive/bbob/2021/index.html)
- [2022](https://numbbo.github.io/ppdata-archive/bbob/2022/index.html)
- [2023](https://numbbo.github.io/ppdata-archive/bbob/2023/index.html)
import re
import sys
sys.path.insert(1, '../../scripts/')
from IPython.display import Markdown
import cocopp
for year in range(2009, 2030):
dd = cocopp.bbob.find(str(year))
if len(dd) > 1:
dda = [(re.search('/(.*)', d.partition('_')[0]).group(1)) for d in dd]
display(Markdown("\n- [{0}](https://numbbo.github.io/ppdata-archive/bbob/{0}/index.html):".format(year)))
display(Markdown("{0}".format(', '.join(dda))))
```



Expand All @@ -35,7 +39,7 @@ above (other entries work respectively) reads
```python
import cocopp # see https://pypi.org/project/cocopp
cocopp.genericsettings.background = {None: cocopp.archives.bbob.get_all('2009')}
cocopp.main('bbob/2009/*') # will take several minutes to process
cocopp.main('bbob/2010/*') # will take several minutes to process

```

Expand Down

0 comments on commit 6b9545e

Please sign in to comment.