To build the docker image (from the root of this repo):
docker build -t qutee_elites docker/.
To run the docker image:
docker run --ulimit nofile=500000:500000 -it --rm -v $(pwd)/src/qutee_elites:/microros_ws/src/qutee_elites -v $(pwd)/src/qutee_msg:/microros_ws/src/qutee_msg -v --privileged --workdir /microros_ws qutee_elites /bin/bash
then do
colcon build
to build the two ros packages included in this repo (qutee_msg and qutee_elites).
This repository contains "reference implementations" of:
- CVT-MAP-Elites (Vassiliades, Chatzilygeroudis, Mouret, 2017)
- Multitask-MAP-Elites (Mouret and Maguire, 2020)
CVT-MAP-Elites can be used instead of the standard MAP-Elites described in: Mouret JB, Clune J. Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909. 2015 Apr 20.
The general philosophy is to provide implementations (1 page of code) that are easy to transform and include in your own research. This means that there is some code redundancy between the algorithms. If you are interested in a more advanced framework:
- Sferes (C++): https://github.com/sferes2/sferes2
- QDPy (Python) https://pypi.org/project/qdpy/
By default, the evaluations are parallelized on each core (using the multiprocessing package).
- python3
- numpy
- sklearn (scikit-learn) [for CVT]
- matplotlib (optional, for plotting)
If you use this code in a scientific paper, please cite:
Main paper: Mouret JB, Clune J. Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909. 2015 Apr 20.
CVT Map-Elites: Vassiliades V, Chatzilygeroudis K, Mouret JB. Using centroidal voronoi tessellations to scale up the multi-dimensional archive of phenotypic elites algorithm. IEEE Transactions on Evolutionary Computation. 2017 Aug 3.
Variation operator: Vassiliades V, Mouret JB. Discovering the Elite Hypervolume by Leveraging Interspecies Correlation. Proc. of GECCO. 2018.
Multitask-MAP-Elites: Mouret JB, Maguire G. Quality Diversity for Multi-task Optimization. Proc of GECCO. 2020.
(you need to have the map_elites module map_elites in your Python path)
import map_elites.cvt as cvt_map_elites
archive = cvt_map_elites.compute(2, 10, rastrigin, n_niches=10000, max_evals=2e6, log_file=open('cvt.dat', 'w'))
Where 2
is the dimensionality of the map, 10
is the dimensionality of the genotype, n_niches
is the number of niches, and max_evals
is the number of evaluations. You can also pass an optional params
argument to tune a few parameters. Here are the default values:
default_params = \
{
# more of this -> higher-quality CVT
"cvt_samples": 25000,
# we evaluate in batches to paralleliez
"batch_size": 100,
# proportion of niches to be filled before starting
"random_init": 0.1,
# batch for random initialization
"random_init_batch": 100,
# when to write results (one generation = one batch)
"dump_period": 10000,
# do we use several cores?
"parallel": True,
# do we cache the result of CVT and reuse?
"cvt_use_cache": True,
# min/max of parameters
"min": 0,
"max": 1,
}
See the examples
directory for a few examples.