From feb7382fb275b6c8d6f6994471c65b649d1c85d8 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:10:07 -0400 Subject: [PATCH 01/16] Better requirements.txt docs --- .pre-commit-config.yaml | 4 ++++ README.md | 18 ++++++++++++++++++ docs/get-started/installation.md | 6 ++++++ 3 files changed, 28 insertions(+) diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index c97efb144..2f82802e2 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -72,6 +72,10 @@ repos: name: poetry-export requirements-jax.txt args: ["--without-hashes", "-o", "requirements/requirements-jax.txt", "--with", "jax"] stages: [manual] + - id: poetry-export + name: poetry-export requirements-optuna.txt + args: ["--without-hashes", "-o", "requirements/requirements-optuna.txt", "--with", "optuna"] + stages: [manual] - id: poetry-export name: poetry-export requirements-docs.txt args: ["--without-hashes", "-o", "requirements/requirements-docs.txt", "--with", "docs"] diff --git a/README.md b/README.md index 2a6ceb6f0..bf90c78ee 100644 --- a/README.md +++ b/README.md @@ -70,6 +70,24 @@ poetry run python cleanrl/ppo.py \ --wandb-project-name cleanrltest ``` +If you are not using `poetry`, you can install CleanRL with `requirements.txt`: + +```bash +# core dependencies +pip install -r requirements/requirements.txt + +# optional dependencies +pip install -r requirements/requirements-atari.txt +pip install -r requirements/requirements-pybullet.txt +pip install -r requirements/requirements-mujoco_py.txt +pip install -r requirements/requirements-procgen.txt +pip install -r requirements/requirements-envpool.txt +pip install -r requirements/requirements-pettingzoo.txt +pip install -r requirements/requirements-jax.txt +pip install -r requirements/requirements-docs.txt +pip install -r requirements/requirements-cloud.txt +``` + To run training scripts in other games: ``` poetry shell diff --git a/docs/get-started/installation.md b/docs/get-started/installation.md index ea96d3b75..a11e598dd 100644 --- a/docs/get-started/installation.md +++ b/docs/get-started/installation.md @@ -91,11 +91,17 @@ poetry install --with cloud While we recommend using `poetry` to manage environments and dependencies, the traditional `requirements.txt` are available: ```bash +# core dependencies pip install -r requirements/requirements.txt + +# optional dependencies pip install -r requirements/requirements-atari.txt pip install -r requirements/requirements-pybullet.txt pip install -r requirements/requirements-mujoco_py.txt pip install -r requirements/requirements-procgen.txt pip install -r requirements/requirements-envpool.txt pip install -r requirements/requirements-pettingzoo.txt +pip install -r requirements/requirements-jax.txt +pip install -r requirements/requirements-docs.txt +pip install -r requirements/requirements-cloud.txt ``` From 5673401d8b10bea38d40d6149c950790e4b683cf Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:17:17 -0400 Subject: [PATCH 02/16] add c51 docs --- docs/rl-algorithms/c51.md | 70 +++++++++++++++++++++++++++++++++------ 1 file changed, 59 insertions(+), 11 deletions(-) diff --git a/docs/rl-algorithms/c51.md b/docs/rl-algorithms/c51.md index cebc0de63..9142a6e00 100644 --- a/docs/rl-algorithms/c51.md +++ b/docs/rl-algorithms/c51.md @@ -32,11 +32,22 @@ The [c51_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51_at ### Usage -```bash -poetry install --with atari -python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 -python cleanrl/c51_atari.py --env-id PongNoFrameskip-v4 -``` + +=== "poetry" + + ```bash + poetry install --with atari + poetry run python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 + poetry run python cleanrl/c51_atari.py --env-id PongNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 + python cleanrl/c51_atari.py --env-id PongNoFrameskip-v4 + ``` ### Explanation of the logged metrics @@ -104,9 +115,17 @@ The [c51.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51.py) has ### Usage -```bash -python cleanrl/c51.py --env-id CartPole-v1 -``` +=== "poetry" + + ```bash + poetry run python cleanrl/c51.py --env-id CartPole-v1 + ``` + +=== "pip" + + ```bash + python cleanrl/c51.py --env-id CartPole-v1 + ``` ### Explanation of the logged metrics @@ -200,6 +219,26 @@ python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 ``` +=== "poetry" + + ```bash + poetry install --with atari,jax + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + poetry run python cleanrl/c51_atari_jax.py --env-id BreakoutNoFrameskip-v4 + poetry run python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + pip install -r requirements/requirements-jax.txt + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + python cleanrl/c51_atari_jax.py --env-id BreakoutNoFrameskip-v4 + python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 + ``` + + ### Explanation of the logged metrics See [related docs](/rl-algorithms/c51/#explanation-of-the-logged-metrics) for `c51_atari.py`. @@ -254,9 +293,18 @@ The [c51_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51_jax. ### Usage -```bash -python cleanrl/c51_jax.py --env-id CartPole-v1 -``` + +=== "poetry" + + ```bash + poetry run python cleanrl/c51_jax.py --env-id CartPole-v1 + ``` + +=== "pip" + + ```bash + python cleanrl/c51_jax.py --env-id CartPole-v1 + ``` ### Explanation of the logged metrics From 2763c19a5da97df4a893c82cc30db380b2c73ed1 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:20:56 -0400 Subject: [PATCH 03/16] update c51 docs --- docs/rl-algorithms/c51.md | 13 +++++-------- 1 file changed, 5 insertions(+), 8 deletions(-) diff --git a/docs/rl-algorithms/c51.md b/docs/rl-algorithms/c51.md index 9142a6e00..7bba0cd86 100644 --- a/docs/rl-algorithms/c51.md +++ b/docs/rl-algorithms/c51.md @@ -211,13 +211,6 @@ The [c51_atari_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c5 ### Usage -```bash -poetry install --with atari,jax -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -python cleanrl/c51_atari_jax.py --env-id BreakoutNoFrameskip-v4 -python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 -``` - === "poetry" @@ -233,7 +226,7 @@ python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 ```bash pip install -r requirements/requirements-atari.txt pip install -r requirements/requirements-jax.txt - poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html python cleanrl/c51_atari_jax.py --env-id BreakoutNoFrameskip-v4 python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 ``` @@ -297,12 +290,16 @@ The [c51_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51_jax. === "poetry" ```bash + poetry install --with jax + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python cleanrl/c51_jax.py --env-id CartPole-v1 ``` === "pip" ```bash + pip install -r requirements/requirements-jax.txt + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html python cleanrl/c51_jax.py --env-id CartPole-v1 ``` From 1e757cc9d5acbaa1995ff26204c4d6ae51420098 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:23:52 -0400 Subject: [PATCH 04/16] update dqn docs --- docs/rl-algorithms/dqn.md | 74 ++++++++++++++++++++++++++++++++++----- 1 file changed, 65 insertions(+), 9 deletions(-) diff --git a/docs/rl-algorithms/dqn.md b/docs/rl-algorithms/dqn.md index 6099b743a..680487d04 100644 --- a/docs/rl-algorithms/dqn.md +++ b/docs/rl-algorithms/dqn.md @@ -40,6 +40,22 @@ python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 ``` +=== "poetry" + + ```bash + poetry install --with atari + poetry run python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 + poetry run python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 + python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 + ``` + ### Explanation of the logged metrics @@ -130,9 +146,19 @@ The [dqn.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/dqn.py) has ### Usage -```bash -python cleanrl/dqn.py --env-id CartPole-v1 -``` + + +=== "poetry" + + ```bash + poetry run python cleanrl/dqn.py --env-id CartPole-v1 + ``` + +=== "pip" + + ```bash + python cleanrl/dqn.py --env-id CartPole-v1 + ``` ### Explanation of the logged metrics @@ -218,12 +244,26 @@ The [dqn_atari_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/dq ### Usage -```bash -poetry install --with atari,jax -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -python cleanrl/dqn_atari_jax.py --env-id BreakoutNoFrameskip-v4 -python cleanrl/dqn_atari_jax.py --env-id PongNoFrameskip-v4 -``` + +=== "poetry" + + ```bash + poetry install --with atari,jax + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + poetry run python cleanrl/dqn_atari_jax.py --env-id BreakoutNoFrameskip-v4 + poetry run python cleanrl/dqn_atari_jax.py --env-id PongNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + pip install -r requirements/requirements-jax.txt + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + python cleanrl/dqn_atari_jax.py --env-id BreakoutNoFrameskip-v4 + python cleanrl/dqn_atari_jax.py --env-id PongNoFrameskip-v4 + ``` + ???+ warning @@ -289,6 +329,22 @@ Tracked experiments and game play videos: python cleanrl/dqn_jax.py --env-id CartPole-v1 ``` +=== "poetry" + + ```bash + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + poetry run python cleanrl/dqn_jax.py --env-id CartPole-v1 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-jax.txt + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + python cleanrl/dqn_jax.py --env-id CartPole-v1 + ``` + + ### Explanation of the logged metrics See [related docs](/rl-algorithms/dqn/#explanation-of-the-logged-metrics) for `dqn_atari.py`. From d17fd2954a44fb00d2a7785982a1897113183968 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:24:00 -0400 Subject: [PATCH 05/16] update optuna docs --- requirements/requirements-optuna.txt | 156 +++++++++++++++++++++++++++ 1 file changed, 156 insertions(+) create mode 100644 requirements/requirements-optuna.txt diff --git a/requirements/requirements-optuna.txt b/requirements/requirements-optuna.txt new file mode 100644 index 000000000..1f6114684 --- /dev/null +++ b/requirements/requirements-optuna.txt @@ -0,0 +1,156 @@ +absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" +boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" +cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" +decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" +envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" +glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" +grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +huggingface-hub==0.11.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" +jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" +opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" +protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" +pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" +pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" +stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" +wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" From 8ded0bbf0084a85bceca2644d30de9227d518e23 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:42:58 -0400 Subject: [PATCH 06/16] update docs for ddpg, sac, and td3 --- docs/rl-algorithms/ddpg.md | 58 +++++++++++++++++++++++++++----------- docs/rl-algorithms/sac.md | 52 +++++++++++++++++++++------------- docs/rl-algorithms/td3.md | 57 ++++++++++++++++++++++++++----------- 3 files changed, 116 insertions(+), 51 deletions(-) diff --git a/docs/rl-algorithms/ddpg.md b/docs/rl-algorithms/ddpg.md index 51e55e8a9..fc7d95b45 100644 --- a/docs/rl-algorithms/ddpg.md +++ b/docs/rl-algorithms/ddpg.md @@ -36,14 +36,26 @@ The [ddpg_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/c ### Usage -```bash -poetry install -poetry install --with pybullet -python cleanrl/ddpg_continuous_action.py --help -python cleanrl/ddpg_continuous_action.py --env-id HopperBulletEnv-v0 -poetry install --with mujoco_py # only works in Linux -python cleanrl/ddpg_continuous_action.py --env-id Hopper-v3 -``` +=== "poetry" + + ```bash + poetry install + poetry install --with pybullet + poetry run python cleanrl/ddpg_continuous_action.py --help + poetry run python cleanrl/ddpg_continuous_action.py --env-id HopperBulletEnv-v0 + poetry install --with mujoco_py # only works in Linux + poetry run python cleanrl/ddpg_continuous_action.py --env-id Hopper-v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-pybullet.txt + python cleanrl/ddpg_continuous_action.py --help + python cleanrl/ddpg_continuous_action.py --env-id HopperBulletEnv-v0 + pip install -r requirements/requirements-mujoco_py.txt # only works in Linux, you have to pick either `mujoco` or `mujoco_py` + python cleanrl/ddpg_continuous_action.py --env-id Hopper-v2 + ``` ### Explanation of the logged metrics @@ -261,14 +273,28 @@ The [ddpg_continuous_action_jax.py](https://github.com/vwxyzjn/cleanrl/blob/mast ### Usage -```bash -poetry install --with mujoco_py,jax -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -poetry run python -c "import mujoco_py" -python cleanrl/ddpg_continuous_action_jax.py --help -poetry install --with mujoco_py # only works in Linux -python cleanrl/ddpg_continuous_action_jax.py --env-id Hopper-v3 -``` +=== "poetry" + + ```bash + poetry install + poetry install --with pybullet,jax + poetry run python cleanrl/ddpg_continuous_action_jax.py --help + poetry run python cleanrl/ddpg_continuous_action_jax.py --env-id HopperBulletEnv-v0 + poetry install --with mujoco_py # only works in Linux + poetry run python cleanrl/ddpg_continuous_action_jax.py --env-id Hopper-v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-pybullet.txt + pip install -r requirements/requirements-jax.txt + python cleanrl/ddpg_continuous_action_jax.py --help + python cleanrl/ddpg_continuous_action_jax.py --env-id HopperBulletEnv-v0 + pip install -r requirements/requirements-mujoco_py.txt # only works in Linux, you have to pick either `mujoco` or `mujoco_py` + python cleanrl/ddpg_continuous_action_jax.py --env-id Hopper-v2 + ``` + ???+ warning diff --git a/docs/rl-algorithms/sac.md b/docs/rl-algorithms/sac.md index ed4a54723..fe37138dc 100644 --- a/docs/rl-algorithms/sac.md +++ b/docs/rl-algorithms/sac.md @@ -46,18 +46,28 @@ The [sac_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ### Usage for continuous action spaces -```bash -poetry install - -# Pybullet -poetry install --with pybullet +=== "poetry" + + ```bash + poetry install + poetry install --with pybullet + poetry run python cleanrl/sac_continuous_action.py --help + poetry run python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 + poetry install --with mujoco_py # only works in Linux + poetry run python cleanrl/sac_continuous_action.py --env-id Hopper-v2 + poetry run python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 --autotune False --alpha 0.2 ## Without Automatic entropy coef. tuning + ``` -## Default -python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 +=== "pip" -## Without Automatic entropy coef. tuning -python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 --autotune False --alpha 0.2 -``` + ```bash + pip install -r requirements/requirements-pybullet.txt + python cleanrl/sac_continuous_action.py --help + python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 + pip install -r requirements/requirements-mujoco_py.txt # only works in Linux, you have to pick either `mujoco` or `mujoco_py` + python cleanrl/sac_continuous_action.py --env-id Hopper-v2 + python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 --autotune False --alpha 0.2 ## Without Automatic entropy coef. tuning + ``` ### Explanation of the logged metrics @@ -233,18 +243,22 @@ The [sac_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/sac_at ### Usage for discrete action spaces -```bash -poetry install +=== "poetry" -# Atari -poetry install -E atari + ```bash + poetry install + poetry install --with atari + poetry run python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 + poetry run python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 --autotune False --alpha 0.2 + ``` -## Default -python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 +=== "pip" -## Without Automatic entropy coef. tuning -python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 --autotune False --alpha 0.2 -``` + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 + python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 --autotune False --alpha 0.2 + ``` ### Explanation of the logged metrics diff --git a/docs/rl-algorithms/td3.md b/docs/rl-algorithms/td3.md index a5892b081..f888b3374 100644 --- a/docs/rl-algorithms/td3.md +++ b/docs/rl-algorithms/td3.md @@ -35,14 +35,26 @@ The [td3_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ### Usage -```bash -poetry install -poetry install --with pybullet -python cleanrl/td3_continuous_action.py --help -python cleanrl/td3_continuous_action.py --env-id HopperBulletEnv-v0 -poetry install --with mujoco_py # only works in Linux -python cleanrl/td3_continuous_action.py --env-id Hopper-v3 -``` +=== "poetry" + + ```bash + poetry install + poetry install --with pybullet + poetry run python cleanrl/td3_continuous_action.py --help + poetry run python cleanrl/td3_continuous_action.py --env-id HopperBulletEnv-v0 + poetry install --with mujoco_py # only works in Linux + poetry run python cleanrl/td3_continuous_action.py --env-id Hopper-v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-pybullet.txt + python cleanrl/td3_continuous_action.py --help + python cleanrl/td3_continuous_action.py --env-id HopperBulletEnv-v0 + pip install -r requirements/requirements-mujoco_py.txt # only works in Linux, you have to pick either `mujoco` or `mujoco_py` + python cleanrl/td3_continuous_action.py --env-id Hopper-v2 + ``` ### Explanation of the logged metrics @@ -175,14 +187,27 @@ The [td3_continuous_action_jax.py](https://github.com/vwxyzjn/cleanrl/blob/maste ### Usage -```bash -poetry install --with mujoco_py,jax -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -poetry run python -c "import mujoco_py" -python cleanrl/td3_continuous_action_jax.py --help -poetry install --with mujoco_py # only works in Linux -python cleanrl/td3_continuous_action_jax.py --env-id Hopper-v3 -``` +=== "poetry" + + ```bash + poetry install + poetry install --with pybullet,jax + poetry run python cleanrl/td3_continuous_action_jax.py --help + poetry run python cleanrl/td3_continuous_action_jax.py --env-id HopperBulletEnv-v0 + poetry install --with mujoco_py # only works in Linux + poetry run python cleanrl/td3_continuous_action_jax.py --env-id Hopper-v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-pybullet.txt + pip install -r requirements/requirements-jax.txt + python cleanrl/td3_continuous_action_jax.py --help + python cleanrl/td3_continuous_action_jax.py --env-id HopperBulletEnv-v0 + pip install -r requirements/requirements-mujoco_py.txt # only works in Linux, you have to pick either `mujoco` or `mujoco_py` + python cleanrl/td3_continuous_action_jax.py --env-id Hopper-v2 + ``` ### Explanation of the logged metrics From 0be6aa1f85a240dcc14745caf00a6b35e02c40b4 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 12:49:20 -0400 Subject: [PATCH 07/16] add dependencies --- .pre-commit-config.yaml | 8 ++ requirements/requirements-dm_control.txt | 156 +++++++++++++++++++++++ requirements/requirements-mujoco.txt | 98 ++++++++++++-- 3 files changed, 252 insertions(+), 10 deletions(-) create mode 100644 requirements/requirements-dm_control.txt diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index 2f82802e2..ec3076f0d 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -52,6 +52,14 @@ repos: name: poetry-export requirements-pybullet.txt args: ["--without-hashes", "-o", "requirements/requirements-pybullet.txt", "--with", "pybullet"] stages: [manual] + - id: poetry-export + name: poetry-export requirements-mujoco.txt + args: ["--without-hashes", "-o", "requirements/requirements-mujoco.txt", "--with", "mujoco"] + stages: [manual] + - id: poetry-export + name: poetry-export requirements-dm_control.txt + args: ["--without-hashes", "-o", "requirements/requirements-dm_control.txt", "--with", "dm_control"] + stages: [manual] - id: poetry-export name: poetry-export requirements-mujoco_py.txt args: ["--without-hashes", "-o", "requirements/requirements-mujoco_py.txt", "--with", "mujoco_py"] diff --git a/requirements/requirements-dm_control.txt b/requirements/requirements-dm_control.txt new file mode 100644 index 000000000..1f6114684 --- /dev/null +++ b/requirements/requirements-dm_control.txt @@ -0,0 +1,156 @@ +absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" +boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" +cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" +decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" +envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" +glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" +grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +huggingface-hub==0.11.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" +jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" +opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" +protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" +pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" +pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" +stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" +wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-mujoco.txt b/requirements/requirements-mujoco.txt index 439529054..1f6114684 100644 --- a/requirements/requirements-mujoco.txt +++ b/requirements/requirements-mujoco.txt @@ -1,78 +1,156 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" +boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" +bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" +cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" +envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" +glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -gymnasium[mujoco]==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +huggingface-hub==0.11.1 ; python_full_version >= "3.7.1" and python_version < "3.10" idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-metadata==4.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" +jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" +lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" +msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" +mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" +opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" -promise==2.3 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" +pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyparsing==3.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" +pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shortuuid==1.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -tqdm==4.64.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" -wandb==0.13.3 ; python_full_version >= "3.7.1" and python_version < "3.10" +wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" +watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" +wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" From d5683896b0f52b891ff5554245e464924332f394 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:39:51 -0400 Subject: [PATCH 08/16] remove poetry groups --- .pre-commit-config.yaml | 24 +-- Dockerfile | 6 +- benchmark/c51.sh | 2 +- benchmark/ddpg.sh | 4 +- benchmark/dqn.sh | 6 +- benchmark/ppg.sh | 2 +- benchmark/ppo.sh | 24 +-- benchmark/rnd.sh | 2 +- benchmark/rpo.sh | 10 +- benchmark/sac.sh | 2 +- benchmark/sac_atari.sh | 2 +- benchmark/td3.sh | 4 +- benchmark/zoo.sh | 38 +++++ docs/advanced/hyperparameter-tuning.md | 2 +- docs/cloud/installation.md | 2 +- docs/contribution.md | 4 +- docs/get-started/examples.md | 10 +- docs/get-started/installation.md | 24 +-- docs/rl-algorithms/c51.md | 6 +- docs/rl-algorithms/ddpg.md | 8 +- docs/rl-algorithms/dqn.md | 6 +- docs/rl-algorithms/ppg.md | 2 +- docs/rl-algorithms/ppo-rnd.md | 2 +- docs/rl-algorithms/ppo.md | 107 ++++++++---- docs/rl-algorithms/rpo.md | 4 +- docs/rl-algorithms/sac.md | 6 +- docs/rl-algorithms/td3.md | 8 +- poetry.lock | 204 +++++++++++------------ pyproject.toml | 78 +-------- requirements/requirements-atari.txt | 83 +-------- requirements/requirements-cloud.txt | 81 +-------- requirements/requirements-dm_control.txt | 79 +-------- requirements/requirements-docs.txt | 73 +------- requirements/requirements-envpool.txt | 85 +--------- requirements/requirements-jax.txt | 71 +------- requirements/requirements-mujoco.txt | 86 +--------- requirements/requirements-mujoco_py.txt | 82 +-------- requirements/requirements-optuna.txt | 61 +------ requirements/requirements-pettingzoo.txt | 85 +--------- requirements/requirements-procgen.txt | 82 +-------- requirements/requirements-pybullet.txt | 88 +--------- requirements/requirements.txt | 89 +--------- 42 files changed, 337 insertions(+), 1307 deletions(-) create mode 100644 benchmark/zoo.sh diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index ec3076f0d..f9c770c08 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -46,49 +46,49 @@ repos: stages: [manual] - id: poetry-export name: poetry-export requirements-atari.txt - args: ["--without-hashes", "-o", "requirements/requirements-atari.txt", "--with", "atari"] + args: ["--without-hashes", "-o", "requirements/requirements-atari.txt", "-E", "atari"] stages: [manual] - id: poetry-export name: poetry-export requirements-pybullet.txt - args: ["--without-hashes", "-o", "requirements/requirements-pybullet.txt", "--with", "pybullet"] + args: ["--without-hashes", "-o", "requirements/requirements-pybullet.txt", "-E", "pybullet"] stages: [manual] - id: poetry-export name: poetry-export requirements-mujoco.txt - args: ["--without-hashes", "-o", "requirements/requirements-mujoco.txt", "--with", "mujoco"] + args: ["--without-hashes", "-o", "requirements/requirements-mujoco.txt", "-E", "mujoco"] stages: [manual] - id: poetry-export name: poetry-export requirements-dm_control.txt - args: ["--without-hashes", "-o", "requirements/requirements-dm_control.txt", "--with", "dm_control"] + args: ["--without-hashes", "-o", "requirements/requirements-dm_control.txt", "-E", "dm_control"] stages: [manual] - id: poetry-export name: poetry-export requirements-mujoco_py.txt - args: ["--without-hashes", "-o", "requirements/requirements-mujoco_py.txt", "--with", "mujoco_py"] + args: ["--without-hashes", "-o", "requirements/requirements-mujoco_py.txt", "-E", "mujoco_py"] stages: [manual] - id: poetry-export name: poetry-export requirements-procgen.txt - args: ["--without-hashes", "-o", "requirements/requirements-procgen.txt", "--with", "procgen"] + args: ["--without-hashes", "-o", "requirements/requirements-procgen.txt", "-E", "procgen"] stages: [manual] - id: poetry-export name: poetry-export requirements-envpool.txt - args: ["--without-hashes", "-o", "requirements/requirements-envpool.txt", "--with", "envpool"] + args: ["--without-hashes", "-o", "requirements/requirements-envpool.txt", "-E", "envpool"] stages: [manual] - id: poetry-export name: poetry-export requirements-pettingzoo.txt - args: ["--without-hashes", "-o", "requirements/requirements-pettingzoo.txt", "--with", "pettingzoo"] + args: ["--without-hashes", "-o", "requirements/requirements-pettingzoo.txt", "-E", "pettingzoo"] stages: [manual] - id: poetry-export name: poetry-export requirements-jax.txt - args: ["--without-hashes", "-o", "requirements/requirements-jax.txt", "--with", "jax"] + args: ["--without-hashes", "-o", "requirements/requirements-jax.txt", "-E", "jax"] stages: [manual] - id: poetry-export name: poetry-export requirements-optuna.txt - args: ["--without-hashes", "-o", "requirements/requirements-optuna.txt", "--with", "optuna"] + args: ["--without-hashes", "-o", "requirements/requirements-optuna.txt", "-E", "optuna"] stages: [manual] - id: poetry-export name: poetry-export requirements-docs.txt - args: ["--without-hashes", "-o", "requirements/requirements-docs.txt", "--with", "docs"] + args: ["--without-hashes", "-o", "requirements/requirements-docs.txt", "-E", "docs"] stages: [manual] - id: poetry-export name: poetry-export requirements-cloud.txt - args: ["--without-hashes", "-o", "requirements/requirements-cloud.txt", "--with", "cloud"] + args: ["--without-hashes", "-o", "requirements/requirements-cloud.txt", "-E", "cloud"] stages: [manual] diff --git a/Dockerfile b/Dockerfile index 513cc7114..9ddcc8027 100644 --- a/Dockerfile +++ b/Dockerfile @@ -12,8 +12,8 @@ RUN pip install poetry --upgrade COPY pyproject.toml pyproject.toml COPY poetry.lock poetry.lock RUN poetry install -RUN poetry install --with atari -RUN poetry install --with pybullet +RUN poetry install -E atari +RUN poetry install -E pybullet # install mujoco_py RUN apt-get -y install wget unzip software-properties-common \ @@ -21,7 +21,7 @@ RUN apt-get -y install wget unzip software-properties-common \ libgl1-mesa-glx \ libglew-dev \ libosmesa6-dev patchelf -RUN poetry install --with mujoco_py +RUN poetry install -E mujoco_py RUN poetry run python -c "import mujoco_py" COPY entrypoint.sh /usr/local/bin/ diff --git a/benchmark/c51.sh b/benchmark/c51.sh index 58e74e099..fb46bb6b4 100644 --- a/benchmark/c51.sh +++ b/benchmark/c51.sh @@ -5,7 +5,7 @@ OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 9 -poetry install --with atari +poetry install -E atari OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ --command "poetry run python cleanrl/c51_atari.py --track --capture-video" \ diff --git a/benchmark/ddpg.sh b/benchmark/ddpg.sh index 64e982b0a..3baa075c9 100644 --- a/benchmark/ddpg.sh +++ b/benchmark/ddpg.sh @@ -1,4 +1,4 @@ -poetry install --with mujoco_py,pybullet +poetry install -E "mujoco_py pybullet" python -c "import mujoco_py" xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 InvertedPendulum-v2 Humanoid-v2 Pusher-v2 \ @@ -6,7 +6,7 @@ xvfb-run -a python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 1 -poetry install --with mujoco_py,jax +poetry install -E "mujoco_py pybullet jax" poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python -c "import mujoco_py" xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ diff --git a/benchmark/dqn.sh b/benchmark/dqn.sh index e00d4d32c..9a8d8e32e 100644 --- a/benchmark/dqn.sh +++ b/benchmark/dqn.sh @@ -5,14 +5,14 @@ OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 9 -poetry install --with atari +poetry install -E atari OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ --command "poetry run python cleanrl/dqn_atari.py --track --capture-video" \ --num-seeds 3 \ --workers 1 -poetry install --with jax +poetry install -E jax poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids CartPole-v1 Acrobot-v1 MountainCar-v0 \ @@ -20,7 +20,7 @@ xvfb-run -a python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 1 -poetry install --with atari,jax +poetry install -E "atari jax" poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ diff --git a/benchmark/ppg.sh b/benchmark/ppg.sh index 1e165d001..20fde68cf 100644 --- a/benchmark/ppg.sh +++ b/benchmark/ppg.sh @@ -1,6 +1,6 @@ # export WANDB_ENTITY=openrlbenchmark -poetry install --with procgen +poetry install -E procgen xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids starpilot bossfight bigfish \ --command "poetry run python cleanrl/ppg_procgen.py --track --capture-video" \ diff --git a/benchmark/ppo.sh b/benchmark/ppo.sh index 489bc0b5c..7fefcd933 100644 --- a/benchmark/ppo.sh +++ b/benchmark/ppo.sh @@ -7,28 +7,28 @@ OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 9 -poetry install --with atari +poetry install -E atari OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ --command "poetry run python cleanrl/ppo_atari.py --track --capture-video" \ --num-seeds 3 \ --workers 3 -poetry install --with atari +poetry install -E atari OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ --command "poetry run python cleanrl/ppo_atari_lstm.py --track --capture-video" \ --num-seeds 3 \ --workers 3 -poetry install --with envpool +poetry install -E envpool xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids Pong-v5 BeamRider-v5 Breakout-v5 \ --command "poetry run python cleanrl/ppo_atari_envpool.py --track --capture-video" \ --num-seeds 3 \ --workers 1 -poetry install --with mujoco_py,mujoco +poetry install -E "mujoco_py mujoco" poetry run python -c "import mujoco_py" OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 InvertedPendulum-v2 Humanoid-v2 Pusher-v2 \ @@ -36,21 +36,21 @@ OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 6 -poetry install --with procgen +poetry install -E procgen xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids starpilot bossfight bigfish \ --command "poetry run python cleanrl/ppo_procgen.py --track --capture-video" \ --num-seeds 3 \ --workers 1 -poetry install --with atari +poetry install -E atari xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ --command "poetry run torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --track --capture-video" \ --num-seeds 3 \ --workers 1 -poetry install --with pettingzoo,atari +poetry install "pettingzoo atari" poetry run AutoROM --accept-license xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids pong_v3 surround_v2 tennis_v3 \ @@ -73,7 +73,7 @@ xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --workers 1 -poetry install --with envpool,jax +poetry install "envpool jax" poetry run python -m cleanrl_utils.benchmark \ --env-ids Alien-v5 Amidar-v5 Assault-v5 Asterix-v5 Asteroids-v5 Atlantis-v5 BankHeist-v5 BattleZone-v5 BeamRider-v5 Berzerk-v5 Bowling-v5 Boxing-v5 Breakout-v5 Centipede-v5 ChopperCommand-v5 CrazyClimber-v5 Defender-v5 DemonAttack-v5 \ --command "poetry run python ppo_atari_envpool_xla_jax.py --track --wandb-project-name envpool-atari --wandb-entity openrlbenchmark" \ @@ -91,28 +91,28 @@ poetry run python -m cleanrl_utils.benchmark \ --workers 1 # gymnasium support -poetry install --with mujoco +poetry install -E mujoco OMP_NUM_THREADS=1 xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v4 Walker2d-v4 Hopper-v4 InvertedPendulum-v4 Humanoid-v4 Pusher-v4 \ --command "poetry run python cleanrl/gymnasium_support/ppo_continuous_action.py --cuda False --track" \ --num-seeds 3 \ --workers 1 -poetry install --with dm_control,mujoco +poetry install "dm_control mujoco" OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids dm_control/acrobot-swingup-v0 dm_control/acrobot-swingup_sparse-v0 dm_control/ball_in_cup-catch-v0 dm_control/cartpole-balance-v0 dm_control/cartpole-balance_sparse-v0 dm_control/cartpole-swingup-v0 dm_control/cartpole-swingup_sparse-v0 dm_control/cartpole-two_poles-v0 dm_control/cartpole-three_poles-v0 dm_control/cheetah-run-v0 dm_control/dog-stand-v0 dm_control/dog-walk-v0 dm_control/dog-trot-v0 dm_control/dog-run-v0 dm_control/dog-fetch-v0 dm_control/finger-spin-v0 dm_control/finger-turn_easy-v0 dm_control/finger-turn_hard-v0 dm_control/fish-upright-v0 dm_control/fish-swim-v0 dm_control/hopper-stand-v0 dm_control/hopper-hop-v0 dm_control/humanoid-stand-v0 dm_control/humanoid-walk-v0 dm_control/humanoid-run-v0 dm_control/humanoid-run_pure_state-v0 dm_control/humanoid_CMU-stand-v0 dm_control/humanoid_CMU-run-v0 dm_control/lqr-lqr_2_1-v0 dm_control/lqr-lqr_6_2-v0 dm_control/manipulator-bring_ball-v0 dm_control/manipulator-bring_peg-v0 dm_control/manipulator-insert_ball-v0 dm_control/manipulator-insert_peg-v0 dm_control/pendulum-swingup-v0 dm_control/point_mass-easy-v0 dm_control/point_mass-hard-v0 dm_control/quadruped-walk-v0 dm_control/quadruped-run-v0 dm_control/quadruped-escape-v0 dm_control/quadruped-fetch-v0 dm_control/reacher-easy-v0 dm_control/reacher-hard-v0 dm_control/stacker-stack_2-v0 dm_control/stacker-stack_4-v0 dm_control/swimmer-swimmer6-v0 dm_control/swimmer-swimmer15-v0 dm_control/walker-stand-v0 dm_control/walker-walk-v0 dm_control/walker-run-v0 \ --command "poetry run python cleanrl/gymnasium_support/ppo_continuous_action.py --cuda False --track" \ --num-seeds 3 \ --workers 9 -poetry install --with envpool,jax +poetry install "envpool jax" python -m cleanrl_utils.benchmark \ --env-ids Pong-v5 BeamRider-v5 Breakout-v5 \ --command "poetry run python cleanrl/ppo_atari_envpool_xla_jax_scan.py --track --capture-video" \ --num-seeds 3 \ --workers 1 -poetry install --with mujoco,dm_control +poetry install "mujoco dm_control" OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids dm_control/acrobot-swingup-v0 dm_control/acrobot-swingup_sparse-v0 dm_control/ball_in_cup-catch-v0 dm_control/cartpole-balance-v0 dm_control/cartpole-balance_sparse-v0 dm_control/cartpole-swingup-v0 dm_control/cartpole-swingup_sparse-v0 dm_control/cartpole-two_poles-v0 dm_control/cartpole-three_poles-v0 dm_control/cheetah-run-v0 dm_control/dog-stand-v0 dm_control/dog-walk-v0 dm_control/dog-trot-v0 dm_control/dog-run-v0 dm_control/dog-fetch-v0 dm_control/finger-spin-v0 dm_control/finger-turn_easy-v0 dm_control/finger-turn_hard-v0 dm_control/fish-upright-v0 dm_control/fish-swim-v0 dm_control/hopper-stand-v0 dm_control/hopper-hop-v0 dm_control/humanoid-stand-v0 dm_control/humanoid-walk-v0 dm_control/humanoid-run-v0 dm_control/humanoid-run_pure_state-v0 dm_control/humanoid_CMU-stand-v0 dm_control/humanoid_CMU-run-v0 dm_control/lqr-lqr_2_1-v0 dm_control/lqr-lqr_6_2-v0 dm_control/manipulator-bring_ball-v0 dm_control/manipulator-bring_peg-v0 dm_control/manipulator-insert_ball-v0 dm_control/manipulator-insert_peg-v0 dm_control/pendulum-swingup-v0 dm_control/point_mass-easy-v0 dm_control/point_mass-hard-v0 dm_control/quadruped-walk-v0 dm_control/quadruped-run-v0 dm_control/quadruped-escape-v0 dm_control/quadruped-fetch-v0 dm_control/reacher-easy-v0 dm_control/reacher-hard-v0 dm_control/stacker-stack_2-v0 dm_control/stacker-stack_4-v0 dm_control/swimmer-swimmer6-v0 dm_control/swimmer-swimmer15-v0 dm_control/walker-stand-v0 dm_control/walker-walk-v0 dm_control/walker-run-v0 \ --command "poetry run python cleanrl/ppo_continuous_action.py --exp-name ppo_continuous_action_8M --total-timesteps 8000000 --cuda False --track" \ diff --git a/benchmark/rnd.sh b/benchmark/rnd.sh index c2d5bcdf7..d07b55e01 100644 --- a/benchmark/rnd.sh +++ b/benchmark/rnd.sh @@ -1,6 +1,6 @@ # export WANDB_ENTITY=openrlbenchmark -poetry install --with envpool +poetry install -E envpool xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids MontezumaRevenge-v5 \ --command "poetry run python cleanrl/ppo_rnd_envpool.py --track" \ diff --git a/benchmark/rpo.sh b/benchmark/rpo.sh index f81e525d6..cbb551bac 100644 --- a/benchmark/rpo.sh +++ b/benchmark/rpo.sh @@ -1,4 +1,4 @@ -poetry install --with mujoco,dm_control +poetry install "mujoco dm_control" OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids dm_control/acrobot-swingup-v0 dm_control/acrobot-swingup_sparse-v0 dm_control/ball_in_cup-catch-v0 dm_control/cartpole-balance-v0 dm_control/cartpole-balance_sparse-v0 dm_control/cartpole-swingup-v0 dm_control/cartpole-swingup_sparse-v0 dm_control/cartpole-two_poles-v0 dm_control/cartpole-three_poles-v0 dm_control/cheetah-run-v0 dm_control/dog-stand-v0 dm_control/dog-walk-v0 dm_control/dog-trot-v0 dm_control/dog-run-v0 dm_control/dog-fetch-v0 dm_control/finger-spin-v0 dm_control/finger-turn_easy-v0 dm_control/finger-turn_hard-v0 dm_control/fish-upright-v0 dm_control/fish-swim-v0 dm_control/hopper-stand-v0 dm_control/hopper-hop-v0 dm_control/humanoid-stand-v0 dm_control/humanoid-walk-v0 dm_control/humanoid-run-v0 dm_control/humanoid-run_pure_state-v0 dm_control/humanoid_CMU-stand-v0 dm_control/humanoid_CMU-run-v0 dm_control/lqr-lqr_2_1-v0 dm_control/lqr-lqr_6_2-v0 dm_control/manipulator-bring_ball-v0 dm_control/manipulator-bring_peg-v0 dm_control/manipulator-insert_ball-v0 dm_control/manipulator-insert_peg-v0 dm_control/pendulum-swingup-v0 dm_control/point_mass-easy-v0 dm_control/point_mass-hard-v0 dm_control/quadruped-walk-v0 dm_control/quadruped-run-v0 dm_control/quadruped-escape-v0 dm_control/quadruped-fetch-v0 dm_control/reacher-easy-v0 dm_control/reacher-hard-v0 dm_control/stacker-stack_2-v0 dm_control/stacker-stack_4-v0 dm_control/swimmer-swimmer6-v0 dm_control/swimmer-swimmer15-v0 dm_control/walker-stand-v0 dm_control/walker-walk-v0 dm_control/walker-run-v0 \ --command "poetry run python cleanrl/rpo_continuous_action.py --cuda False --track" \ @@ -12,28 +12,28 @@ OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --num-seeds 1 \ --workers 1 -poetry install --with mujoco +poetry install -E mujoco OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids HumanoidStandup-v4 Humanoid-v4 InvertedPendulum-v4 Walker2d-v4 \ --command "poetry run python cleanrl/rpo_continuous_action.py --cuda False --track --capture-video" \ --num-seeds 10 \ --workers 1 -poetry install --with mujoco +poetry install -E mujoco OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids HumanoidStandup-v2 Humanoid-v2 InvertedPendulum-v2 Walker2d-v2 \ --command "poetry run python cleanrl/rpo_continuous_action.py --cuda False --track --capture-video" \ --num-seeds 10 \ --workers 1 -poetry install --with mujoco +poetry install -E mujoco OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids Ant-v4 InvertedDoublePendulum-v4 Reacher-v4 Pusher-v4 Hopper-v4 HalfCheetah-v4 Swimmer-v4 \ --command "poetry run python cleanrl/rpo_continuous_action.py --rpo-alpha 0.01 --cuda False --track --capture-video" \ --num-seeds 10 \ --workers 1 -poetry install --with mujoco +poetry install -E mujoco OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids Ant-v2 InvertedDoublePendulum-v2 Reacher-v2 Pusher-v2 Hopper-v2 HalfCheetah-v2 Swimmer-v2 \ --command "poetry run python cleanrl/rpo_continuous_action.py --rpo-alpha 0.01 --cuda False --track --capture-video" \ diff --git a/benchmark/sac.sh b/benchmark/sac.sh index 68eeb84cf..b726d4f0c 100644 --- a/benchmark/sac.sh +++ b/benchmark/sac.sh @@ -1,4 +1,4 @@ -poetry install --with mujoco_py,pybullet +poetry install -E "mujoco_py pybullet" poetry run python -c "import mujoco_py" OMP_NUM_THREADS=1 xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 \ diff --git a/benchmark/sac_atari.sh b/benchmark/sac_atari.sh index f16bc96c1..13f9e3c9d 100755 --- a/benchmark/sac_atari.sh +++ b/benchmark/sac_atari.sh @@ -1,4 +1,4 @@ -poetry install --with atari +poetry install -E atari OMP_NUM_THREADS=1 python -m cleanrl_utils.benchmark \ --env-ids PongNoFrameskip-v4 BreakoutNoFrameskip-v4 BeamRiderNoFrameskip-v4 \ --command "poetry run python cleanrl/sac_atari.py --cuda True --track" \ diff --git a/benchmark/td3.sh b/benchmark/td3.sh index d61f58db0..2406bac76 100644 --- a/benchmark/td3.sh +++ b/benchmark/td3.sh @@ -1,4 +1,4 @@ -poetry install --with mujoco_py,pybullet +poetry install -E "mujoco_py pybullet" python -c "import mujoco_py" OMP_NUM_THREADS=1 xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 InvertedPendulum-v2 Humanoid-v2 Pusher-v2 \ @@ -6,7 +6,7 @@ OMP_NUM_THREADS=1 xvfb-run -a python -m cleanrl_utils.benchmark \ --num-seeds 3 \ --workers 1 -poetry install --with mujoco_py,jax +poetry install -E "mujoco_py pybullet jax" poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python -c "import mujoco_py" xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ diff --git a/benchmark/zoo.sh b/benchmark/zoo.sh new file mode 100644 index 000000000..f7646c5d5 --- /dev/null +++ b/benchmark/zoo.sh @@ -0,0 +1,38 @@ +poetry run python cleanrl/dqn_jax.py --env-id CartPole-v1 --save-model --upload-model --hf-entity cleanrl +poetry run python cleanrl/dqn_atari_jax.py --env-id SeaquestNoFrameskip-v4 --save-model --upload-model --hf-entity cleanrl + +xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ + --env-ids CartPole-v1 Acrobot-v1 MountainCar-v0 \ + --command "poetry run python cleanrl/dqn.py --cuda False --track --capture-video --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 + +CUDA_VISIBLE_DEVICES="-1" xvfb-run -a poetry run python -m cleanrl_utils.benchmark \ + --env-ids CartPole-v1 Acrobot-v1 MountainCar-v0 \ + --command "poetry run python cleanrl/dqn_jax.py --track --capture-video --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 + +xvfb-run -a python -m cleanrl_utils.benchmark \ + --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ + --command "poetry run python cleanrl/dqn_atari_jax.py --track --capture-video --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 + +xvfb-run -a python -m cleanrl_utils.benchmark \ + --env-ids PongNoFrameskip-v4 BeamRiderNoFrameskip-v4 BreakoutNoFrameskip-v4 \ + --command "poetry run python cleanrl/dqn_atari.py --track --capture-video --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 + +python -m cleanrl_utils.benchmark \ + --env-ids Pong-v5 BeamRider-v5 Breakout-v5 \ + --command "poetry run python cleanrl/ppo_atari_envpool_xla_jax_scan.py --track --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 + +CUDA_VISIBLE_DEVICES="1" taskset --cpu-list 16,17,18,19,20,21,22,23 python -m cleanrl_utils.benchmark \ + --env-ids Breakout-v5 \ + --command "poetry run python cleanrl/ppo_atari_envpool_xla_jax_scan.py --track --save-model --upload-model --hf-entity cleanrl" \ + --num-seeds 1 \ + --workers 1 diff --git a/docs/advanced/hyperparameter-tuning.md b/docs/advanced/hyperparameter-tuning.md index 410273e99..65eb7ffc5 100644 --- a/docs/advanced/hyperparameter-tuning.md +++ b/docs/advanced/hyperparameter-tuning.md @@ -44,7 +44,7 @@ tuner.tune( You can run the tuner with the following command: ```bash -poetry install --with optuna +poetry install -E optuna python tuner_example.py ``` diff --git a/docs/cloud/installation.md b/docs/cloud/installation.md index 8fbbd643e..28f26ceb7 100644 --- a/docs/cloud/installation.md +++ b/docs/cloud/installation.md @@ -11,7 +11,7 @@ We use Terraform to define our infrastructure with AWS Batch, which you can spin ```bash # assuming you are at the root of the CleanRL project -poetry install --with cloud +poetry install -E cloud cd cloud python -m awscli configure terraform init diff --git a/docs/contribution.md b/docs/contribution.md index cb770bdbd..b7e0a0a68 100644 --- a/docs/contribution.md +++ b/docs/contribution.md @@ -9,7 +9,7 @@ Good luck and have fun! To setup the development environment, please clone the repository and follow the [installation docs](/get-started/installation/) and [usage docs](/get-started/basic-usage). They should help you set a working poetry environment, so you have the same set up as other contributors. Additionally, you may want to run the following command to install dev-dependencies for documentation: ```bash -poetry install --with docs +poetry install -E docs ``` @@ -77,7 +77,7 @@ Importantly, **regardless of the slight difference in performance-impacting chan Given a new feature, we create a PR and then run the benchmark experiments through [`benchmark.py`](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl_utils/benchmark.py), such as the following: ```bash -poetry install --with mujoco,pybullet +poetry install -E "pybullet mujoco_py" python -c "import mujoco_py" xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 \ diff --git a/docs/get-started/examples.md b/docs/get-started/examples.md index b9c4b676c..14883e257 100644 --- a/docs/get-started/examples.md +++ b/docs/get-started/examples.md @@ -4,14 +4,14 @@ ``` poetry shell -poetry install --with atari +poetry install -E atari python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/ppo_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/sac_atari.py --env-id BreakoutNoFrameskip-v4 # NEW: 3-4x side-effects free speed up with envpool's atari (only available to linux) -poetry install --with envpool +poetry install -E envpool python cleanrl/ppo_atari_envpool.py --env-id BreakoutNoFrameskip-v4 # Learn Pong-v5 in ~5-10 mins # Side effects such as lower sample efficiency might occur @@ -36,7 +36,7 @@ python cleanrl/c51.py --env-id CartPole-v1 ``` poetry shell -poetry install --with pybullet +poetry install -E pybullet python cleanrl/td3_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 python cleanrl/ddpg_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 python cleanrl/sac_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 @@ -46,7 +46,7 @@ python cleanrl/sac_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 ``` poetry shell -poetry install --with procgen +poetry install -E procgen python cleanrl/ppo_procgen.py --env-id starpilot python cleanrl/ppg_procgen.py --env-id starpilot ``` @@ -56,6 +56,6 @@ python cleanrl/ppg_procgen.py --env-id starpilot ``` poetry shell -poetry install --with atari +poetry install -E atari python cleanrl/ppo_atari_lstm.py --env-id BreakoutNoFrameskip-v4 ``` diff --git a/docs/get-started/installation.md b/docs/get-started/installation.md index a11e598dd..84b9d8c60 100644 --- a/docs/get-started/installation.md +++ b/docs/get-started/installation.md @@ -74,16 +74,18 @@ procgen = "^0.10.7" You can install them using the following command ```bash -poetry install --with atari -poetry install --with pybullet -poetry install --with mujoco_py -poetry install --with procgen -poetry install --with envpool -poetry install --with pettingzoo -poetry install --with jax -poetry install --with optuna -poetry install --with docs -poetry install --with cloud +poetry install -E atari +poetry install -E pybullet +poetry install -E mujoco +poetry install -E mujoco_py +poetry install -E dm_control +poetry install -E procgen +poetry install -E envpool +poetry install -E pettingzoo +poetry install -E jax +poetry install -E optuna +poetry install -E docs +poetry install -E cloud ``` ## Install via `pip` @@ -97,7 +99,9 @@ pip install -r requirements/requirements.txt # optional dependencies pip install -r requirements/requirements-atari.txt pip install -r requirements/requirements-pybullet.txt +pip install -r requirements/requirements-mujoco.txt pip install -r requirements/requirements-mujoco_py.txt +pip install -r requirements/requirements/requirements-mujoco.txt pip install -r requirements/requirements-procgen.txt pip install -r requirements/requirements-envpool.txt pip install -r requirements/requirements-pettingzoo.txt diff --git a/docs/rl-algorithms/c51.md b/docs/rl-algorithms/c51.md index 7bba0cd86..c5dd66503 100644 --- a/docs/rl-algorithms/c51.md +++ b/docs/rl-algorithms/c51.md @@ -36,7 +36,7 @@ The [c51_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51_at === "poetry" ```bash - poetry install --with atari + poetry install -E atari poetry run python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 poetry run python cleanrl/c51_atari.py --env-id PongNoFrameskip-v4 ``` @@ -215,7 +215,7 @@ The [c51_atari_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c5 === "poetry" ```bash - poetry install --with atari,jax + poetry install -E "atari jax" poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python cleanrl/c51_atari_jax.py --env-id BreakoutNoFrameskip-v4 poetry run python cleanrl/c51_atari_jax.py --env-id PongNoFrameskip-v4 @@ -290,7 +290,7 @@ The [c51_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/c51_jax. === "poetry" ```bash - poetry install --with jax + poetry install -E jax poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python cleanrl/c51_jax.py --env-id CartPole-v1 ``` diff --git a/docs/rl-algorithms/ddpg.md b/docs/rl-algorithms/ddpg.md index fc7d95b45..05fdbaab1 100644 --- a/docs/rl-algorithms/ddpg.md +++ b/docs/rl-algorithms/ddpg.md @@ -40,10 +40,10 @@ The [ddpg_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/c ```bash poetry install - poetry install --with pybullet + poetry install -E pybullet poetry run python cleanrl/ddpg_continuous_action.py --help poetry run python cleanrl/ddpg_continuous_action.py --env-id HopperBulletEnv-v0 - poetry install --with mujoco_py # only works in Linux + poetry install -E mujoco_py # only works in Linux poetry run python cleanrl/ddpg_continuous_action.py --env-id Hopper-v2 ``` @@ -277,10 +277,10 @@ The [ddpg_continuous_action_jax.py](https://github.com/vwxyzjn/cleanrl/blob/mast ```bash poetry install - poetry install --with pybullet,jax + poetry install -E "pybullet jax" poetry run python cleanrl/ddpg_continuous_action_jax.py --help poetry run python cleanrl/ddpg_continuous_action_jax.py --env-id HopperBulletEnv-v0 - poetry install --with mujoco_py # only works in Linux + poetry install -E mujoco_py # only works in Linux poetry run python cleanrl/ddpg_continuous_action_jax.py --env-id Hopper-v2 ``` diff --git a/docs/rl-algorithms/dqn.md b/docs/rl-algorithms/dqn.md index 680487d04..b29f3fa47 100644 --- a/docs/rl-algorithms/dqn.md +++ b/docs/rl-algorithms/dqn.md @@ -35,7 +35,7 @@ The [dqn_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/dqn_at ### Usage ```bash -poetry install --with atari +poetry install -E atari python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 ``` @@ -43,7 +43,7 @@ python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 === "poetry" ```bash - poetry install --with atari + poetry install -E atari poetry run python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 poetry run python cleanrl/dqn_atari.py --env-id PongNoFrameskip-v4 ``` @@ -248,7 +248,7 @@ The [dqn_atari_jax.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/dq === "poetry" ```bash - poetry install --with atari,jax + poetry install -E "atari jax" poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html poetry run python cleanrl/dqn_atari_jax.py --env-id BreakoutNoFrameskip-v4 poetry run python cleanrl/dqn_atari_jax.py --env-id PongNoFrameskip-v4 diff --git a/docs/rl-algorithms/ppg.md b/docs/rl-algorithms/ppg.md index 74fa1f6c1..0b2e40134 100644 --- a/docs/rl-algorithms/ppg.md +++ b/docs/rl-algorithms/ppg.md @@ -30,7 +30,7 @@ Below are our single-file implementations of PPG: ### Usage ```bash -poetry install --with procgen +poetry install -E procgen python cleanrl/ppg_procgen.py --help python cleanrl/ppg_procgen.py --env-id "bigfish" ``` diff --git a/docs/rl-algorithms/ppo-rnd.md b/docs/rl-algorithms/ppo-rnd.md index 3e55e8e71..98fb86f26 100644 --- a/docs/rl-algorithms/ppo-rnd.md +++ b/docs/rl-algorithms/ppo-rnd.md @@ -47,7 +47,7 @@ The [ppo_rnd_envpool.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ ### Usage ```bash -poetry install --with envpool +poetry install -E envpool python cleanrl/ppo_rnd_envpool.py --help python cleanrl/ppo_rnd_envpool.py --env-id MontezumaRevenge-v5 ``` diff --git a/docs/rl-algorithms/ppo.md b/docs/rl-algorithms/ppo.md index 0d06070cf..0d85e35d2 100644 --- a/docs/rl-algorithms/ppo.md +++ b/docs/rl-algorithms/ppo.md @@ -46,11 +46,20 @@ The [ppo.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ppo.py) has ### Usage -```bash -poetry install -python cleanrl/ppo.py --help -python cleanrl/ppo.py --env-id CartPole-v1 -``` +=== "poetry" + + ```bash + poetry install + poetry run python cleanrl/ppo.py --help + poetry run python cleanrl/ppo.py --env-id CartPole-v1 + ``` + +=== "pip" + + ```bash + python cleanrl/ppo.py --help + python cleanrl/ppo.py --env-id CartPole-v1 + ``` ### Explanation of the logged metrics @@ -137,11 +146,21 @@ The [ppo_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ppo_at ### Usage -```bash -poetry install --with atari -python cleanrl/ppo_atari.py --help -python cleanrl/ppo_atari.py --env-id BreakoutNoFrameskip-v4 -``` +=== "poetry" + + ```bash + poetry install -E atari + poetry run python cleanrl/ppo_atari.py --help + poetry run python cleanrl/ppo_atari.py --env-id BreakoutNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/ppo_atari.py --help + python cleanrl/ppo_atari.py --env-id BreakoutNoFrameskip-v4 + ``` ### Explanation of the logged metrics @@ -219,18 +238,32 @@ The [ppo_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ### Usage -```bash -# mujoco v4 environments -poetry install --with mujoco -python cleanrl/ppo_continuous_action.py --help -python cleanrl/ppo_continuous_action.py --env-id Hopper-v2 -# dm_control v4 environments -poetry install --with mujoco,dm_control -python cleanrl/ppo_continuous_action.py --env-id dm_control/cartpole-balance-v0 -# backwards compatibility with mujoco v2 environments -poetry install --with mujoco_py,mujoco -python cleanrl/ppo_continuous_action.py --env-id Hopper-v2 -``` +=== "poetry" + + ```bash + # mujoco v4 environments + poetry install -E mujoco + python cleanrl/ppo_continuous_action.py --help + python cleanrl/ppo_continuous_action.py --env-id Hopper-v4 + # dm_control environments + poetry install -E "mujoco dm_control" + python cleanrl/ppo_continuous_action.py --env-id dm_control/cartpole-balance-v0 + # backwards compatibility with mujoco v2 environments + poetry install -E mujoco_py + python cleanrl/ppo_continuous_action.py --env-id Hopper-v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-mujoco.txt + python cleanrl/ppo_continuous_action.py --help + python cleanrl/ppo_continuous_action.py --env-id Hopper-v4 + pip install -r requirements/requirements-dm_control.txt + python cleanrl/ppo_continuous_action.py --env-id dm_control/cartpole-balance-v0 + pip install -r requirements/requirements-mujoco_py.txt + python cleanrl/ppo_continuous_action.py --env-id Hopper-v2 + ``` ???+ warning "dm_control installation issue" @@ -411,11 +444,23 @@ The [ppo_atari_lstm.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/p ### Usage -```bash -poetry install --with atari -python cleanrl/ppo_atari_lstm.py --help -python cleanrl/ppo_atari_lstm.py --env-id BreakoutNoFrameskip-v4 -``` + +=== "poetry" + + ```bash + poetry install -E atari + poetry run python cleanrl/ppo_atari_lstm.py --help + poetry run python cleanrl/ppo_atari_lstm.py --env-id BreakoutNoFrameskip-v4 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/ppo_atari_lstm.py --help + python cleanrl/ppo_atari_lstm.py --env-id BreakoutNoFrameskip-v4 + ``` + ### Explanation of the logged metrics @@ -496,7 +541,7 @@ The [ppo_atari_envpool.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanr ### Usage ```bash -poetry install --with envpool +poetry install -E envpool python cleanrl/ppo_atari_envpool.py --help python cleanrl/ppo_atari_envpool.py --env-id Breakout-v5 ``` @@ -797,7 +842,7 @@ The [ppo_procgen.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ppo_ ### Usage ```bash -poetry install --with procgen +poetry install -E procgen python cleanrl/ppo_procgen.py --help python cleanrl/ppo_procgen.py --env-id starpilot ``` @@ -876,7 +921,7 @@ The [ppo_atari_multigpu.py](https://github.com/vwxyzjn/cleanrl/blob/master/clean ### Usage ```bash -poetry install --with atari +poetry install -E atari python cleanrl/ppo_atari_multigpu.py --help # `--nproc_per_node=2` specifies how many subprocesses we spawn for training with data parallelism @@ -1126,7 +1171,7 @@ Tracked experiments and game play videos: ### Usage ```bash -poetry install --with pettingzoo,atari +poetry install -E "pettingzoo atari" poetry run AutoROM --accept-license python cleanrl/ppo_pettingzoo_ma_atari.py --help python cleanrl/ppo_pettingzoo_ma_atari.py --env-id pong_v3 diff --git a/docs/rl-algorithms/rpo.md b/docs/rl-algorithms/rpo.md index c94c017c2..b048fb483 100644 --- a/docs/rl-algorithms/rpo.md +++ b/docs/rl-algorithms/rpo.md @@ -33,13 +33,13 @@ The [rpo_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ```bash # mujoco v4 environments -poetry install --with mujoco +poetry install -E mujoco python cleanrl/rpo_continuous_action.py --help python cleanrl/rpo_continuous_action.py --env-id Walker2d-v4 # NOTE: we recommend using --rpo-alpha 0.01 for Ant Hopper InvertedDoublePendulum Reacher Pusher python cleanrl/rpo_continuous_action.py --env-id Ant-v4 --rpo-alpha 0.01 # dm_control v4 environments -poetry install --with mujoco,dm_control +poetry install -E "mujoco dm_control" python cleanrl/rpo_continuous_action.py --env-id dm_control/cartpole-balance-v0 # BipedalWalker-v3 experiment (hack) poetry install diff --git a/docs/rl-algorithms/sac.md b/docs/rl-algorithms/sac.md index fe37138dc..342470b70 100644 --- a/docs/rl-algorithms/sac.md +++ b/docs/rl-algorithms/sac.md @@ -50,10 +50,10 @@ The [sac_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ```bash poetry install - poetry install --with pybullet + poetry install -E pybullet poetry run python cleanrl/sac_continuous_action.py --help poetry run python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 - poetry install --with mujoco_py # only works in Linux + poetry install -E mujoco_py # only works in Linux poetry run python cleanrl/sac_continuous_action.py --env-id Hopper-v2 poetry run python cleanrl/sac_continuous_action.py --env-id HopperBulletEnv-v0 --autotune False --alpha 0.2 ## Without Automatic entropy coef. tuning ``` @@ -247,7 +247,7 @@ The [sac_atari.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/sac_at ```bash poetry install - poetry install --with atari + poetry install -E atari poetry run python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 poetry run python cleanrl/sac_atari.py.py --env-id PongNoFrameskip-v4 --autotune False --alpha 0.2 ``` diff --git a/docs/rl-algorithms/td3.md b/docs/rl-algorithms/td3.md index f888b3374..c52d45f61 100644 --- a/docs/rl-algorithms/td3.md +++ b/docs/rl-algorithms/td3.md @@ -39,10 +39,10 @@ The [td3_continuous_action.py](https://github.com/vwxyzjn/cleanrl/blob/master/cl ```bash poetry install - poetry install --with pybullet + poetry install -E pybullet poetry run python cleanrl/td3_continuous_action.py --help poetry run python cleanrl/td3_continuous_action.py --env-id HopperBulletEnv-v0 - poetry install --with mujoco_py # only works in Linux + poetry install -E mujoco_py # only works in Linux poetry run python cleanrl/td3_continuous_action.py --env-id Hopper-v2 ``` @@ -191,10 +191,10 @@ The [td3_continuous_action_jax.py](https://github.com/vwxyzjn/cleanrl/blob/maste ```bash poetry install - poetry install --with pybullet,jax + poetry install -E "pybullet jax" poetry run python cleanrl/td3_continuous_action_jax.py --help poetry run python cleanrl/td3_continuous_action_jax.py --env-id HopperBulletEnv-v0 - poetry install --with mujoco_py # only works in Linux + poetry install -E mujoco_py # only works in Linux poetry run python cleanrl/td3_continuous_action_jax.py --env-id Hopper-v2 ``` diff --git a/poetry.lock b/poetry.lock index a977bd442..ea2c39ce6 100644 --- a/poetry.lock +++ b/poetry.lock @@ -17,7 +17,7 @@ name = "ale-py" version = "0.7.4" description = "The Arcade Learning Environment (ALE) - a platform for AI research." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "ale_py-0.7.4-cp310-cp310-macosx_10_15_x86_64.whl", hash = "sha256:418eea1539c2669c799274fedead4d44d05dfc3dcd6c536378d5984c42bc340b"}, @@ -50,7 +50,7 @@ name = "alembic" version = "1.8.1" description = "A database migration tool for SQLAlchemy." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "alembic-1.8.1-py3-none-any.whl", hash = "sha256:0a024d7f2de88d738d7395ff866997314c837be6104e90c5724350313dee4da4"}, @@ -127,7 +127,7 @@ name = "autopage" version = "0.5.1" description = "A library to provide automatic paging for console output" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "autopage-0.5.1-py3-none-any.whl", hash = "sha256:0fbf5efbe78d466a26753e1dee3272423a3adc989d6a778c700e89a3f8ff0d88"}, @@ -181,7 +181,7 @@ name = "awscli" version = "1.25.71" description = "Universal Command Line Environment for AWS." category = "main" -optional = false +optional = true python-versions = ">= 3.7" files = [ {file = "awscli-1.25.71-py3-none-any.whl", hash = "sha256:694b0144041988b41ec8ed1adb2ac2a31b78a11fb3ff183066f36201eca0f692"}, @@ -201,7 +201,7 @@ name = "boto3" version = "1.24.70" description = "The AWS SDK for Python" category = "main" -optional = false +optional = true python-versions = ">= 3.7" files = [ {file = "boto3-1.24.70-py3-none-any.whl", hash = "sha256:bb69ebe7c484305568b1aaed664db3d09716dc93235e41f23538f99ea4f3addc"}, @@ -221,7 +221,7 @@ name = "botocore" version = "1.27.70" description = "Low-level, data-driven core of boto 3." category = "main" -optional = false +optional = true python-versions = ">= 3.7" files = [ {file = "botocore-1.27.70-py3-none-any.whl", hash = "sha256:c0a014b4dfd7ffe739393034aa6e70e73f3a1b22c7667a59858259b341bf5082"}, @@ -241,7 +241,7 @@ name = "bottle" version = "0.12.23" description = "Fast and simple WSGI-framework for small web-applications." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "bottle-0.12.23-py3-none-any.whl", hash = "sha256:9f1c363257c590bd34db5fad4693a7f06ff4217e9ad18337451de69c25137127"}, @@ -277,7 +277,7 @@ name = "cffi" version = "1.15.1" description = "Foreign Function Interface for Python calling C code." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "cffi-1.15.1-cp27-cp27m-macosx_10_9_x86_64.whl", hash = "sha256:a66d3508133af6e8548451b25058d5812812ec3798c886bf38ed24a98216fab2"}, @@ -381,7 +381,7 @@ name = "chex" version = "0.1.4" description = "Chex: Testing made fun, in JAX!" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "chex-0.1.4-py3-none-any.whl", hash = "sha256:432395fceacdafc78a9cc8c56c98200d8247db6535bca83ffaecd61e16e4d9b6"}, @@ -417,7 +417,7 @@ name = "cliff" version = "3.10.1" description = "Command Line Interface Formulation Framework" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "cliff-3.10.1-py3-none-any.whl", hash = "sha256:a21da482714b9f0b0e9bafaaf2f6a8b3b14161bb47f62e10e28d2fe4ff4b1626"}, @@ -450,7 +450,7 @@ name = "cmaes" version = "0.8.2" description = "Lightweight Covariance Matrix Adaptation Evolution Strategy (CMA-ES) implementation for Python 3." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "cmaes-0.8.2-py3-none-any.whl", hash = "sha256:9c4127be8942da3ac6857a7564d18a4a655462d77aa2d551a8e88063b23e0699"}, @@ -465,7 +465,7 @@ name = "cmd2" version = "2.4.2" description = "cmd2 - quickly build feature-rich and user-friendly interactive command line applications in Python" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "cmd2-2.4.2-py3-none-any.whl", hash = "sha256:a77e3056751393270b4125c990cf527db132f15951a20a3a5dd2df4290aadf20"}, @@ -502,7 +502,7 @@ name = "colorlog" version = "6.7.0" description = "Add colours to the output of Python's logging module." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "colorlog-6.7.0-py2.py3-none-any.whl", hash = "sha256:0d33ca236784a1ba3ff9c532d4964126d8a2c44f1f0cb1d2b0728196f512f662"}, @@ -520,7 +520,7 @@ name = "commonmark" version = "0.9.1" description = "Python parser for the CommonMark Markdown spec" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "commonmark-0.9.1-py2.py3-none-any.whl", hash = "sha256:da2f38c92590f83de410ba1a3cbceafbc74fee9def35f9251ba9a971d6d66fd9"}, @@ -547,7 +547,7 @@ name = "Cython" version = "0.29.32" description = "The Cython compiler for writing C extensions for the Python language." category = "main" -optional = false +optional = true python-versions = ">=2.6, !=3.0.*, !=3.1.*, !=3.2.*" files = [ {file = "Cython-0.29.32-cp27-cp27m-manylinux_2_5_i686.manylinux1_i686.whl", hash = "sha256:39afb4679b8c6bf7ccb15b24025568f4f9b4d7f9bf3cbd981021f542acecd75b"}, @@ -596,8 +596,8 @@ files = [ name = "dataclasses" version = "0.6" description = "A backport of the dataclasses module for Python 3.6" -category = "dev" -optional = false +category = "main" +optional = true python-versions = "*" files = [ {file = "dataclasses-0.6-py3-none-any.whl", hash = "sha256:454a69d788c7fda44efd71e259be79577822f5e3f53f029a22d08004e951dc9f"}, @@ -638,8 +638,8 @@ dev = ["PyTest", "PyTest (<5)", "PyTest-Cov", "PyTest-Cov (<2.6)", "bump2version name = "dill" version = "0.3.6" description = "serialize all of python" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "dill-0.3.6-py3-none-any.whl", hash = "sha256:a07ffd2351b8c678dfc4a856a3005f8067aea51d6ba6c700796a4d9e280f39f0"}, @@ -666,7 +666,7 @@ name = "dm-control" version = "1.0.8" description = "Continuous control environments and MuJoCo Python bindings." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "dm_control-1.0.8-py3-none-any.whl", hash = "sha256:64d4a3a123c6997ee413a495147102fc9b41902fc25d37b4a4e1479df8ae0dfe"}, @@ -698,7 +698,7 @@ name = "dm-env" version = "1.5" description = "A Python interface for Reinforcement Learning environments." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "dm-env-1.5.tar.gz", hash = "sha256:3efd99b0652563599507c415d48b51896c88be2f01c2b6250af8bab51571e353"}, @@ -715,7 +715,7 @@ name = "dm-tree" version = "0.1.7" description = "Tree is a library for working with nested data structures." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "dm-tree-0.1.7.tar.gz", hash = "sha256:30fec8aca5b92823c0e796a2f33b875b4dccd470b57e91e6c542405c5f77fd2a"}, @@ -762,7 +762,7 @@ name = "docutils" version = "0.16" description = "Docutils -- Python Documentation Utilities" category = "main" -optional = false +optional = true python-versions = ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*" files = [ {file = "docutils-0.16-py2.py3-none-any.whl", hash = "sha256:0c5b78adfbf7762415433f5515cd5c9e762339e23369dbe8000d84a4bf4ab3af"}, @@ -774,7 +774,7 @@ name = "envpool" version = "0.6.4" description = "\"C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.\"" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "envpool-0.6.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl", hash = "sha256:74c0e31b777964c166d9ec91cf2812a7850f186e3e18043ee3deb6b45fb061fc"}, @@ -795,7 +795,7 @@ name = "etils" version = "0.7.1" description = "Collection of common python utils" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "etils-0.7.1-py3-none-any.whl", hash = "sha256:9b5140835372e3db8b6e8d7da9e16beb2390ae6f24c253107c8127e4d2205189"}, @@ -826,8 +826,8 @@ etree-tf = ["etils[etree]", "tf-nightly"] name = "expt" version = "0.4.1" description = "EXperiment. Plot. Tabulate." -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.6" files = [ {file = "expt-0.4.1.tar.gz", hash = "sha256:5006cc6197c814b38aa5ae1f7457078bac212c10b30f2d4a4a309c3c8a1d3b33"}, @@ -850,7 +850,7 @@ name = "fasteners" version = "0.15" description = "A python package that provides useful locks." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "fasteners-0.15-py2.py3-none-any.whl", hash = "sha256:007e4d2b2d4a10093f67e932e5166722d2eab83b77724156e92ad013c6226574"}, @@ -882,7 +882,7 @@ name = "flax" version = "0.6.0" description = "Flax: A neural network library for JAX designed for flexibility" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "flax-0.6.0-py3-none-any.whl", hash = "sha256:98197d17a82bb239c13d9317508cc4cee8daf8728e8db8fcfbe80277a7dfd9e6"}, @@ -933,7 +933,7 @@ name = "free-mujoco-py" version = "2.1.6" description = "" category = "main" -optional = false +optional = true python-versions = ">=3.7.1,<3.11" files = [ {file = "free-mujoco-py-2.1.6.tar.gz", hash = "sha256:77e18302e21979bbd77a7c1584070815843cab1b1249f8a17667e15aba528a9a"}, @@ -953,7 +953,7 @@ name = "ghp-import" version = "2.1.0" description = "Copy your docs directly to the gh-pages branch." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "ghp-import-2.1.0.tar.gz", hash = "sha256:9c535c4c61193c2df8871222567d7fd7e5014d835f97dc7b7439069e2413d343"}, @@ -1002,7 +1002,7 @@ name = "glcontext" version = "2.3.6" description = "Portable OpenGL Context" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "glcontext-2.3.6-cp310-cp310-macosx_10_9_universal2.whl", hash = "sha256:2eb3c2d7879076a33e801283ab2403788b78e1a45dc89e664a3100b967d471a1"}, @@ -1050,7 +1050,7 @@ name = "glfw" version = "1.12.0" description = "A ctypes-based wrapper for GLFW3." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "glfw-1.12.0-py2.py27.py3.py30.py31.py32.py33.py34.py35.py36.py37.py38-none-macosx_10_6_intel.whl", hash = "sha256:88bd1cd2ace036d275e9af8312993068d94b3ac19248421eedc35a4baf53bb8c"}, @@ -1110,7 +1110,7 @@ name = "greenlet" version = "1.1.3" description = "Lightweight in-process concurrent programming" category = "main" -optional = false +optional = true python-versions = ">=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*" files = [ {file = "greenlet-1.1.3-cp27-cp27m-macosx_10_14_x86_64.whl", hash = "sha256:8c287ae7ac921dfde88b1c125bd9590b7ec3c900c2d3db5197f1286e144e712b"}, @@ -1279,7 +1279,7 @@ name = "gym3" version = "0.3.3" description = "Vectorized Reinforcement Learning Environment Interface" category = "main" -optional = false +optional = true python-versions = ">=3.6.0" files = [ {file = "gym3-0.3.3-py3-none-any.whl", hash = "sha256:bacc0e124f8ce5e1d8a9dceb85725123332954f13ef4e226133506597548838a"}, @@ -1508,7 +1508,7 @@ name = "iniconfig" version = "1.1.1" description = "iniconfig: brain-dead simple config-ini parsing" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "iniconfig-1.1.1-py2.py3-none-any.whl", hash = "sha256:011e24c64b7f47f6ebd835bb12a743f2fbe9a26d4cecaa7f53bc4f35ee9da8b3"}, @@ -1570,7 +1570,7 @@ name = "jax" version = "0.3.17" description = "Differentiate, compile, and transform Numpy code." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "jax-0.3.17.tar.gz", hash = "sha256:2a2794e4e0c93595a1b1d625026580c0686be93bd60d4f6906b090446692cadc"}, @@ -1599,7 +1599,7 @@ name = "jaxlib" version = "0.3.15" description = "XLA library for JAX" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "jaxlib-0.3.15-cp310-none-macosx_10_14_x86_64.whl", hash = "sha256:7555be95d567572579a2010ed03506e31ff87d55c21c1bc80eddcccd87b3f723"}, @@ -1625,7 +1625,7 @@ name = "Jinja2" version = "3.1.2" description = "A very fast and expressive template engine." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "Jinja2-3.1.2-py3-none-any.whl", hash = "sha256:6088930bfe239f0e6710546ab9c19c9ef35e29792895fed6e6e31a023a182a61"}, @@ -1643,7 +1643,7 @@ name = "jmespath" version = "1.0.1" description = "JSON Matching Expressions" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "jmespath-1.0.1-py3-none-any.whl", hash = "sha256:02e2e4cc71b5bcab88332eebf907519190dd9e6e82107fa7f83b1003a6252980"}, @@ -1655,7 +1655,7 @@ name = "joblib" version = "1.1.0" description = "Lightweight pipelining with Python functions" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "joblib-1.1.0-py2.py3-none-any.whl", hash = "sha256:f21f109b3c7ff9d95f8387f752d0d9c34a02aa2f7060c2135f465da0e5160ff6"}, @@ -1772,7 +1772,7 @@ name = "labmaze" version = "1.0.5" description = "LabMaze: DeepMind Lab's text maze generator." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "labmaze-1.0.5-cp310-cp310-macosx_10_9_x86_64.whl", hash = "sha256:09b297e2cae9e0880298eaedcdee96374f1106eda7eb0873815d01b15c0c5099"}, @@ -1810,7 +1810,7 @@ name = "lxml" version = "4.9.1" description = "Powerful and Pythonic XML processing library combining libxml2/libxslt with the ElementTree API." category = "main" -optional = false +optional = true python-versions = ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, != 3.4.*" files = [ {file = "lxml-4.9.1-cp27-cp27m-macosx_10_15_x86_64.whl", hash = "sha256:98cafc618614d72b02185ac583c6f7796202062c41d2eeecdf07820bad3295ed"}, @@ -1896,7 +1896,7 @@ name = "Mako" version = "1.2.2" description = "A super-fast templating language that borrows the best ideas from the existing templating languages." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "Mako-1.2.2-py3-none-any.whl", hash = "sha256:8efcb8004681b5f71d09c983ad5a9e6f5c40601a6ec469148753292abc0da534"}, @@ -1935,7 +1935,7 @@ name = "markdown-include" version = "0.7.0" description = "This is an extension to Python-Markdown which provides an \"include\" function, similar to that found in LaTeX (and also the C pre-processor and Fortran). I originally wrote it for my FORD Fortran auto-documentation generator." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "markdown_include-0.7.0-py3-none-any.whl", hash = "sha256:a06183b7c7225e73112737acdc6fe0ac0686c39457234eeb5ede23881fed001d"}, @@ -2055,7 +2055,7 @@ name = "mergedeep" version = "1.3.4" description = "A deep merge function for 🐍." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "mergedeep-1.3.4-py3-none-any.whl", hash = "sha256:70775750742b25c0d8f36c55aed03d24c3384d17c951b3175d898bd778ef0307"}, @@ -2067,7 +2067,7 @@ name = "mkdocs" version = "1.3.0" description = "Project documentation with Markdown." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "mkdocs-1.3.0-py3-none-any.whl", hash = "sha256:26bd2b03d739ac57a3e6eed0b7bcc86168703b719c27b99ad6ca91dc439aacde"}, @@ -2094,7 +2094,7 @@ name = "mkdocs-material" version = "8.4.3" description = "Documentation that simply works" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "mkdocs-material-8.4.3.tar.gz", hash = "sha256:f39af3234ce0b60024b7712995af0de5b5227ab6504f0b9c8709c9a770bd94bf"}, @@ -2114,7 +2114,7 @@ name = "mkdocs-material-extensions" version = "1.0.3" description = "Extension pack for Python Markdown." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "mkdocs-material-extensions-1.0.3.tar.gz", hash = "sha256:bfd24dfdef7b41c312ede42648f9eb83476ea168ec163b613f9abd12bbfddba2"}, @@ -2126,7 +2126,7 @@ name = "moderngl" version = "5.6.4" description = "ModernGL: High performance rendering for Python 3" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "moderngl-5.6.4-cp310-cp310-macosx_10_9_universal2.whl", hash = "sha256:186f8ab2b869c56f677dc87de0577a60790fb9306bd5149cedc433a39e9291e5"}, @@ -2196,7 +2196,7 @@ name = "monotonic" version = "1.6" description = "An implementation of time.monotonic() for Python 2 & < 3.3" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "monotonic-1.6-py2.py3-none-any.whl", hash = "sha256:68687e19a14f11f26d140dd5c86f3dba4bf5df58003000ed467e0e2a69bca96c"}, @@ -2298,7 +2298,7 @@ name = "mujoco" version = "2.3.0" description = "MuJoCo Physics Simulator" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "mujoco-2.3.0-cp310-cp310-macosx_10_12_x86_64.whl", hash = "sha256:5b0d86454e13de40d856a01f7c32bacece1ce498aa68bd497c1a115ad245f6dd"}, @@ -2334,7 +2334,7 @@ name = "multi-agent-ale-py" version = "0.1.11" description = "Multi-Agent Arcade Learning Environment Python Interface" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "multi-agent-ale-py-0.1.11.tar.gz", hash = "sha256:ba3ff800420f65ff354574975bdfa79035ae1597e8938b37d1df12ffc4122edb"}, @@ -2356,8 +2356,8 @@ numpy = "*" name = "multiprocess" version = "0.70.14" description = "better multiprocessing and multithreading in python" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "multiprocess-0.70.14-pp37-pypy37_pp73-macosx_10_9_x86_64.whl", hash = "sha256:560a27540daef4ce8b24ed3cc2496a3c670df66c96d02461a4da67473685adf3"}, @@ -2500,7 +2500,7 @@ name = "opencv-python" version = "4.6.0.66" description = "Wrapper package for OpenCV python bindings." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "opencv-python-4.6.0.66.tar.gz", hash = "sha256:c5bfae41ad4031e66bb10ec4a0a2ffd3e514d092652781e8b1ac98d1b59f1158"}, @@ -2524,8 +2524,8 @@ numpy = [ name = "openrlbenchmark" version = "0.1.1b4" description = "" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7.1,<4.0.0" files = [ {file = "openrlbenchmark-0.1.1b4-py3-none-any.whl", hash = "sha256:f012fdfbac560f3a0b0f825560635eeceaeb4f97c43996a19a8e2916b95f43cb"}, @@ -2549,7 +2549,7 @@ name = "opt-einsum" version = "3.3.0" description = "Optimizing numpys einsum function" category = "main" -optional = false +optional = true python-versions = ">=3.5" files = [ {file = "opt_einsum-3.3.0-py3-none-any.whl", hash = "sha256:2455e59e3947d3c275477df7f5205b30635e266fe6dc300e3d9f9646bfcea147"}, @@ -2568,7 +2568,7 @@ name = "optax" version = "0.1.3" description = "A gradient processing and optimisation library in JAX." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "optax-0.1.3-py3-none-any.whl", hash = "sha256:33ac3b36bc8f6e087e112fd3a14ab054b99d1c26867aae552db80e234916e522"}, @@ -2588,7 +2588,7 @@ name = "optuna" version = "3.0.1" description = "A hyperparameter optimization framework" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "optuna-3.0.1-py3-none-any.whl", hash = "sha256:391f64be51c1e47618e2f6e8c80ca5c908a7672b0a96ae648c6538f6d1813f24"}, @@ -2621,7 +2621,7 @@ name = "optuna-dashboard" version = "0.7.2" description = "Real-time dashboard for Optuna." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "optuna-dashboard-0.7.2.tar.gz", hash = "sha256:36422b657682d49fa03eec951fccb26e16464fc709eaef7a0640802b751a9c91"}, @@ -2713,7 +2713,7 @@ name = "pbr" version = "5.10.0" description = "Python Build Reasonableness" category = "main" -optional = false +optional = true python-versions = ">=2.6" files = [ {file = "pbr-5.10.0-py2.py3-none-any.whl", hash = "sha256:da3e18aac0a3c003e9eea1a81bd23e5a3a75d745670dcf736317b7d966887fdf"}, @@ -2725,7 +2725,7 @@ name = "PettingZoo" version = "1.18.1" description = "Gym for multi-agent reinforcement learning" category = "main" -optional = false +optional = true python-versions = ">=3.7, <3.11" files = [ {file = "PettingZoo-1.18.1-py3-none-any.whl", hash = "sha256:25ae45fcfa2c623800e1f81b98ae50f5f5a1af6caabc5946764248de71a0371d"}, @@ -2823,8 +2823,8 @@ tests = ["check-manifest", "coverage", "defusedxml", "markdown2", "olefile", "pa name = "pip" version = "22.3.1" description = "The PyPA recommended tool for installing Python packages." -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "pip-22.3.1-py3-none-any.whl", hash = "sha256:908c78e6bc29b676ede1c4d57981d490cb892eb45cd8c214ab6298125119e077"}, @@ -2864,7 +2864,7 @@ name = "pluggy" version = "1.0.0" description = "plugin and hook calling mechanisms for python" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "pluggy-1.0.0-py2.py3-none-any.whl", hash = "sha256:74134bbf457f031a36d68416e1509f34bd5ccc019f0bcc952c7b909d06b37bd3"}, @@ -2904,7 +2904,7 @@ name = "prettytable" version = "3.4.1" description = "A simple Python library for easily displaying tabular data in a visually appealing ASCII table format" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "prettytable-3.4.1-py3-none-any.whl", hash = "sha256:0d23ff81e165077d93367e1379d97893c7a51541483d25bad45b9647660ef06f"}, @@ -2923,7 +2923,7 @@ name = "procgen" version = "0.10.7" description = "Procedurally Generated Game-Like RL Environments" category = "main" -optional = false +optional = true python-versions = ">=3.6.0" files = [ {file = "procgen-0.10.7-cp310-cp310-macosx_10_9_x86_64.whl", hash = "sha256:277c0e781dc80ec568f0da428185d0b767ff1b6610304af85c7b7522d0ecfec6"}, @@ -3050,7 +3050,7 @@ name = "py" version = "1.11.0" description = "library with cross-python path, ini-parsing, io, code, log facilities" category = "main" -optional = false +optional = true python-versions = ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*" files = [ {file = "py-1.11.0-py2.py3-none-any.whl", hash = "sha256:607c53218732647dff4acdfcd50cb62615cedf612e72d1724fb1a0cc6405b378"}, @@ -3111,7 +3111,7 @@ name = "pybullet" version = "3.1.8" description = "Official Python Interface for the Bullet Physics SDK specialized for Robotics Simulation and Reinforcement Learning" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "pybullet-3.1.8-cp36-cp36m-manylinux1_x86_64.whl", hash = "sha256:0ae9bef2f8ea6b30ee0f8fbc7051801d9b47e82ec8637a47e47a0675d4f03fa4"}, @@ -3126,7 +3126,7 @@ name = "pycparser" version = "2.21" description = "C parser in Python" category = "main" -optional = false +optional = true python-versions = ">=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*" files = [ {file = "pycparser-2.21-py2.py3-none-any.whl", hash = "sha256:8ee45429555515e1f6b185e78100aea234072576aa43ab53aefcae078162fca9"}, @@ -3206,7 +3206,7 @@ name = "Pygments" version = "2.13.0" description = "Pygments is a syntax highlighting package written in Python." category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "Pygments-2.13.0-py3-none-any.whl", hash = "sha256:f643f331ab57ba3c9d89212ee4a2dabc6e94f117cf4eefde99a0574720d14c42"}, @@ -3221,7 +3221,7 @@ name = "pymdown-extensions" version = "9.5" description = "Extension pack for Python Markdown." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "pymdown_extensions-9.5-py3-none-any.whl", hash = "sha256:ec141c0f4983755349f0c8710416348d1a13753976c028186ed14f190c8061c4"}, @@ -3236,7 +3236,7 @@ name = "pyopengl" version = "3.1.6" description = "Standard OpenGL bindings for Python" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "PyOpenGL-3.1.6-py2-none-any.whl", hash = "sha256:57c597d989178e1413002df6b923619f6d29807501dece1c60cc6f12c0c8e8a7"}, @@ -3261,7 +3261,7 @@ name = "pyperclip" version = "1.8.2" description = "A cross-platform clipboard module for Python. (Only handles plain text for now.)" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "pyperclip-1.8.2.tar.gz", hash = "sha256:105254a8b04934f0bc84e9c24eb360a591aaf6535c9def5f29d92af107a9bf57"}, @@ -3272,7 +3272,7 @@ name = "pyreadline3" version = "3.4.1" description = "A python implementation of GNU readline." category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "pyreadline3-3.4.1-py3-none-any.whl", hash = "sha256:b0efb6516fd4fb07b45949053826a62fa4cb353db5be2bbb4a7aa1fdd1e345fb"}, @@ -3315,7 +3315,7 @@ name = "pytest" version = "7.1.3" description = "pytest: simple powerful testing with Python" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "pytest-7.1.3-py3-none-any.whl", hash = "sha256:1377bda3466d70b55e3f5cecfa55bb7cfcf219c7964629b967c37cf0bda818b7"}, @@ -3418,7 +3418,7 @@ name = "pyyaml_env_tag" version = "0.1" description = "A custom YAML tag for referencing environment variables in YAML files. " category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "pyyaml_env_tag-0.1-py3-none-any.whl", hash = "sha256:af31106dec8a4d68c60207c1886031cbf839b68aa7abccdb19868200532c2069"}, @@ -3547,7 +3547,7 @@ name = "rich" version = "11.2.0" description = "Render rich text, tables, progress bars, syntax highlighting, markdown and more to the terminal" category = "main" -optional = false +optional = true python-versions = ">=3.6.2,<4.0.0" files = [ {file = "rich-11.2.0-py3-none-any.whl", hash = "sha256:d5f49ad91fb343efcae45a2b2df04a9755e863e50413623ab8c9e74f05aee52b"}, @@ -3606,7 +3606,7 @@ name = "s3transfer" version = "0.6.0" description = "An Amazon S3 Transfer Manager" category = "main" -optional = false +optional = true python-versions = ">= 3.7" files = [ {file = "s3transfer-0.6.0-py3-none-any.whl", hash = "sha256:06176b74f3a15f61f1b4f25a1fc29a4429040b7647133a463da8fa5bd28d5ecd"}, @@ -3624,7 +3624,7 @@ name = "scikit-learn" version = "1.0.2" description = "A set of python modules for machine learning and data mining" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "scikit-learn-1.0.2.tar.gz", hash = "sha256:b5870959a5484b614f26d31ca4c17524b1b0317522199dc985c3b4256e030767"}, @@ -3719,8 +3719,8 @@ numpy = ">=1.16.5,<1.23.0" name = "seaborn" version = "0.12.2" description = "Statistical data visualization" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "seaborn-0.12.2-py3-none-any.whl", hash = "sha256:ebf15355a4dba46037dfd65b7350f014ceb1f13c05e814eda2c9f5fd731afc08"}, @@ -3890,7 +3890,7 @@ name = "shimmy" version = "0.1.0" description = "API for converting popular non-gymnasium environments to a gymnasium compatible environment." category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "Shimmy-0.1.0-py3-none-any.whl", hash = "sha256:f9b48b1a1dece5e244159aa1b2bb51e0bfe6645452f18abfb3158747f160ab9a"}, @@ -3938,7 +3938,7 @@ name = "SQLAlchemy" version = "1.4.41" description = "Database Abstraction Library" category = "main" -optional = false +optional = true python-versions = "!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,>=2.7" files = [ {file = "SQLAlchemy-1.4.41-cp27-cp27m-macosx_10_14_x86_64.whl", hash = "sha256:13e397a9371ecd25573a7b90bd037db604331cf403f5318038c46ee44908c44d"}, @@ -4039,7 +4039,7 @@ name = "stevedore" version = "3.5.0" description = "Manage dynamic plugins for Python applications" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "stevedore-3.5.0-py3-none-any.whl", hash = "sha256:a547de73308fd7e90075bb4d301405bebf705292fa90a90fc3bcf9133f58616c"}, @@ -4055,7 +4055,7 @@ name = "SuperSuit" version = "3.4.0" description = "Wrappers for Gym and PettingZoo" category = "main" -optional = false +optional = true python-versions = ">=3.7" files = [ {file = "SuperSuit-3.4.0-py3-none-any.whl", hash = "sha256:45b541b2b29faffd6494b53d649c8d94889966f407fd380b3e3211f9e68a49e9"}, @@ -4071,8 +4071,8 @@ tinyscaler = ">=1.0.4" name = "tabulate" version = "0.9.0" description = "Pretty-print tabular data" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "tabulate-0.9.0-py3-none-any.whl", hash = "sha256:024ca478df22e9340661486f85298cff5f6dcdba14f3813e8830015b9ed1948f"}, @@ -4164,7 +4164,7 @@ name = "threadpoolctl" version = "3.1.0" description = "threadpoolctl" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "threadpoolctl-3.1.0-py3-none-any.whl", hash = "sha256:8b99adda265feb6773280df41eece7b2e6561b772d21ffd52e372f999024907b"}, @@ -4176,7 +4176,7 @@ name = "tinyscaler" version = "1.2.4" description = "A tiny, simple image scaler" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "tinyscaler-1.2.4-cp310-cp310-manylinux2010_x86_64.whl", hash = "sha256:d5230e57e8eb25a770afc782289d3241a55517ad3f345245c9ca2ef65f4d4d69"}, @@ -4215,7 +4215,7 @@ name = "toolz" version = "0.12.0" description = "List processing tools and functional utilities" category = "main" -optional = false +optional = true python-versions = ">=3.5" files = [ {file = "toolz-0.12.0-py3-none-any.whl", hash = "sha256:2059bd4148deb1884bb0eb770a3cde70e7f954cfbbdc2285f1f2de01fd21eb6f"}, @@ -4319,8 +4319,8 @@ telegram = ["requests"] name = "tueplots" version = "0.0.4" description = "Scientific plotting made easy" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.7" files = [ {file = "tueplots-0.0.4-py3-none-any.whl", hash = "sha256:9c90ea249155913820bbaa3ed1ec9b184fc4d9fdd39af958f5726bf83f364264"}, @@ -4338,8 +4338,8 @@ examples = ["jupyter"] name = "typeguard" version = "2.13.3" description = "Run-time type checker for Python" -category = "dev" -optional = false +category = "main" +optional = true python-versions = ">=3.5.3" files = [ {file = "typeguard-2.13.3-py3-none-any.whl", hash = "sha256:5e3e3be01e887e7eafae5af63d1f36c849aaa94e3a0112097312aabfa16284f1"}, @@ -4355,7 +4355,7 @@ name = "types-protobuf" version = "3.20.2" description = "Typing stubs for protobuf" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "types-protobuf-3.20.2.tar.gz", hash = "sha256:cfb76b5eba514807796603006134ccc361432dd061a8ccb8db2cf9108a454369"}, @@ -4460,7 +4460,7 @@ name = "watchdog" version = "2.1.9" description = "Filesystem events monitoring" category = "main" -optional = false +optional = true python-versions = ">=3.6" files = [ {file = "watchdog-2.1.9-cp310-cp310-macosx_10_9_universal2.whl", hash = "sha256:a735a990a1095f75ca4f36ea2ef2752c99e6ee997c46b0de507ba40a09bf7330"}, @@ -4498,7 +4498,7 @@ name = "wcwidth" version = "0.2.5" description = "Measures the displayed width of unicode strings in a terminal" category = "main" -optional = false +optional = true python-versions = "*" files = [ {file = "wcwidth-0.2.5-py2.py3-none-any.whl", hash = "sha256:beb4802a9cebb9144e99086eff703a642a13d6a0052920003a230f3294bbe784"}, @@ -4636,7 +4636,7 @@ c51-atari-jax = ["ale-py", "AutoROM", "opencv-python", "jax", "jaxlib", "flax"] c51-jax = ["jax", "jaxlib", "flax"] cloud = ["boto3", "awscli"] dm-control = ["shimmy", "dm-control", "mujoco"] -docs = ["mkdocs-material", "markdown-include"] +docs = ["mkdocs-material", "markdown-include", "openrlbenchmark"] dqn = [] dqn-atari = ["ale-py", "AutoROM", "opencv-python"] dqn-atari-jax = ["ale-py", "AutoROM", "opencv-python", "jax", "jaxlib", "flax"] @@ -4656,4 +4656,4 @@ pytest = ["pytest"] [metadata] lock-version = "2.0" python-versions = ">=3.7.1,<3.10" -content-hash = "fc3f8df26c0943cb82d4fb58352f1ca9d4ea1a5dcbd2aa522f8a5d4b91288514" +content-hash = "921a8a7e4153e969e0cc03593f9739f8246c51d8f683f34eb4396db8863bc1b4" diff --git a/pyproject.toml b/pyproject.toml index 599d78b86..70340fab2 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -34,6 +34,7 @@ imageio = {version = "^2.14.1", optional = true} free-mujoco-py = {version = "^2.1.6", optional = true} mkdocs-material = {version = "^8.4.3", optional = true} markdown-include = {version = "^0.7.0", optional = true} +openrlbenchmark = {version = "^0.1.1b4", optional = true} jax = {version = "^0.3.17", optional = true} jaxlib = {version = "^0.3.15", optional = true} flax = {version = "^0.6.0", optional = true} @@ -52,77 +53,6 @@ dm-control = {version = "^1.0.8", optional = true} [tool.poetry.group.dev.dependencies] pre-commit = "^2.20.0" -[tool.poetry.group.atari] -optional = true -[tool.poetry.group.atari.dependencies] -ale-py = "0.7.4" -AutoROM = {extras = ["accept-rom-license"], version = "^0.4.2"} -opencv-python = "^4.6.0.66" - -[tool.poetry.group.pybullet] -optional = true -[tool.poetry.group.pybullet.dependencies] -pybullet = "3.1.8" - -[tool.poetry.group.procgen] -optional = true -[tool.poetry.group.procgen.dependencies] -procgen = "^0.10.7" - -[tool.poetry.group.pytest] -optional = true -[tool.poetry.group.pytest.dependencies] -pytest = "^7.1.3" - -[tool.poetry.group.mujoco] -optional = true -[tool.poetry.group.mujoco.dependencies] -mujoco = "^2.2" -imageio = "^2.14.1" - -[tool.poetry.group.mujoco_py] -optional = true -[tool.poetry.group.mujoco_py.dependencies] -free-mujoco-py = "^2.1.6" - -[tool.poetry.group.docs] -optional = true -[tool.poetry.group.docs.dependencies] -mkdocs-material = "^8.4.3" -markdown-include = "^0.7.0" -openrlbenchmark = "^0.1.1b4" - -[tool.poetry.group.jax] -optional = true -[tool.poetry.group.jax.dependencies] -jax = "^0.3.17" -jaxlib = "^0.3.15" -flax = "^0.6.0" - -[tool.poetry.group.optuna] -optional = true -[tool.poetry.group.optuna.dependencies] -optuna = "^3.0.1" -optuna-dashboard = "^0.7.2" -rich = "<12.0" - -[tool.poetry.group.envpool] -optional = true -[tool.poetry.group.envpool.dependencies] -envpool = "^0.6.4" - -[tool.poetry.group.pettingzoo] -optional = true -[tool.poetry.group.pettingzoo.dependencies] -PettingZoo = "1.18.1" -SuperSuit = "3.4.0" -multi-agent-ale-py = "0.1.11" - -[tool.poetry.group.cloud] -optional = true -[tool.poetry.group.cloud.dependencies] -boto3 = "^1.24.70" -awscli = "^1.25.71" [tool.poetry.group.isaacgym] optional = true @@ -130,12 +60,6 @@ optional = true isaacgymenvs = {git = "https://github.com/vwxyzjn/IsaacGymEnvs.git", rev = "poetry"} isaacgym = {path = "cleanrl/ppo_continuous_action_isaacgym/isaacgym", develop = true} -[tool.poetry.group.dm_control] -optional = true -[tool.poetry.group.dm_control.dependencies] -shimmy = "^0.1.0" -dm-control = "^1.0.8" -mujoco = "^2.2" [build-system] requires = ["poetry-core"] diff --git a/requirements/requirements-atari.txt b/requirements/requirements-atari.txt index 1f6114684..17fdbc40a 100644 --- a/requirements/requirements-atari.txt +++ b/requirements/requirements-atari.txt @@ -1,54 +1,25 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -58,99 +29,47 @@ imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.1 imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-cloud.txt b/requirements/requirements-cloud.txt index 1f6114684..deda689fa 100644 --- a/requirements/requirements-cloud.txt +++ b/requirements/requirements-cloud.txt @@ -1,54 +1,28 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +31,49 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-dm_control.txt b/requirements/requirements-dm_control.txt index 1f6114684..9e607fb75 100644 --- a/requirements/requirements-dm_control.txt +++ b/requirements/requirements-dm_control.txt @@ -1,54 +1,28 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,73 +31,35 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -132,25 +68,16 @@ setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-docs.txt b/requirements/requirements-docs.txt index a73644a1c..1b308b752 100644 --- a/requirements/requirements-docs.txt +++ b/requirements/requirements-docs.txt @@ -1,57 +1,29 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" dataclasses==0.6 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" dill==0.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" expt==0.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -60,17 +32,9 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -79,47 +43,25 @@ mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" multiprocess==0.70.14 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" openrlbenchmark==0.1.1b4 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pip==22.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -128,39 +70,28 @@ requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < " requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" seaborn==0.12.2 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tabulate==0.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tueplots==0.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" typeguard==2.13.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-envpool.txt b/requirements/requirements-envpool.txt index 1f6114684..26082333b 100644 --- a/requirements/requirements-envpool.txt +++ b/requirements/requirements-envpool.txt @@ -1,54 +1,27 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +30,48 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-jax.txt b/requirements/requirements-jax.txt index 1f6114684..8afb28e9c 100644 --- a/requirements/requirements-jax.txt +++ b/requirements/requirements-jax.txt @@ -1,54 +1,29 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -58,99 +33,55 @@ imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.1 imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-mujoco.txt b/requirements/requirements-mujoco.txt index 1f6114684..08a7ac128 100644 --- a/requirements/requirements-mujoco.txt +++ b/requirements/requirements-mujoco.txt @@ -1,54 +1,25 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +28,49 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-mujoco_py.txt b/requirements/requirements-mujoco_py.txt index 1f6114684..5035e766f 100644 --- a/requirements/requirements-mujoco_py.txt +++ b/requirements/requirements-mujoco_py.txt @@ -1,54 +1,29 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +32,49 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-optuna.txt b/requirements/requirements-optuna.txt index 1f6114684..fa77f5466 100644 --- a/requirements/requirements-optuna.txt +++ b/requirements/requirements-optuna.txt @@ -1,20 +1,14 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -24,31 +18,17 @@ colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,99 +37,62 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-pettingzoo.txt b/requirements/requirements-pettingzoo.txt index 1f6114684..2380947f8 100644 --- a/requirements/requirements-pettingzoo.txt +++ b/requirements/requirements-pettingzoo.txt @@ -1,54 +1,24 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +27,51 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-procgen.txt b/requirements/requirements-procgen.txt index 1f6114684..f066aa681 100644 --- a/requirements/requirements-procgen.txt +++ b/requirements/requirements-procgen.txt @@ -1,51 +1,25 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +31,50 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements-pybullet.txt b/requirements/requirements-pybullet.txt index 1f6114684..1a0823fe8 100644 --- a/requirements/requirements-pybullet.txt +++ b/requirements/requirements-pybullet.txt @@ -1,54 +1,24 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +27,48 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" diff --git a/requirements/requirements.txt b/requirements/requirements.txt index 1f6114684..fd505c5f5 100644 --- a/requirements/requirements.txt +++ b/requirements/requirements.txt @@ -1,54 +1,24 @@ absl-py==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -ale-py==0.7.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -alembic==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" appdirs==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -attrs==22.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -autopage==0.5.1 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom-accept-rom-license==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" autorom[accept-rom-license]==0.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -awscli==1.25.71 ; python_full_version >= "3.7.1" and python_version < "3.10" -boto3==1.24.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -botocore==1.27.70 ; python_full_version >= "3.7.1" and python_version < "3.10" -bottle==0.12.23 ; python_full_version >= "3.7.1" and python_version < "3.10" cachetools==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" certifi==2022.6.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -cffi==1.15.1 ; python_full_version >= "3.7.1" and python_version < "3.10" charset-normalizer==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -chex==0.1.4 ; python_full_version >= "3.7.1" and python_version < "3.10" click==8.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -cliff==3.10.1 ; python_full_version >= "3.7.1" and python_version < "3.10" cloudpickle==2.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmaes==0.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -cmd2==2.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -colorlog==6.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -commonmark==0.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" +colorama==0.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" and platform_system == "Windows" cycler==0.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -cython==0.29.32 ; python_full_version >= "3.7.1" and python_version < "3.10" decorator==4.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-control==1.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-env==1.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -dm-tree==0.1.7 ; python_full_version >= "3.7.1" and python_version < "3.10" docker-pycreds==0.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -docutils==0.16 ; python_full_version >= "3.7.1" and python_version < "3.10" -envpool==0.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -etils[epath]==0.7.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -fasteners==0.15 ; python_full_version >= "3.7.1" and python_version < "3.10" filelock==3.8.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -flax==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" fonttools==4.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -free-mujoco-py==2.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -ghp-import==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" gitdb==4.0.9 ; python_full_version >= "3.7.1" and python_version < "3.10" gitpython==3.1.27 ; python_full_version >= "3.7.1" and python_version < "3.10" -glcontext==2.3.6 ; python_full_version >= "3.7.1" and python_version < "3.10" -glfw==1.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth-oauthlib==0.4.6 ; python_full_version >= "3.7.1" and python_version < "3.10" google-auth==2.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -greenlet==1.1.3 ; python_full_version >= "3.7.1" and (platform_machine == "aarch64" or platform_machine == "ppc64le" or platform_machine == "x86_64" or platform_machine == "amd64" or platform_machine == "AMD64" or platform_machine == "win32" or platform_machine == "WIN32") and python_version < "3.10" grpcio==1.48.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gym-notices==0.0.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -gym3==0.3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" gym==0.23.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium-notices==0.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" gymnasium==0.26.3 ; python_full_version >= "3.7.1" and python_version < "3.10" @@ -57,100 +27,47 @@ idna==3.3 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio-ffmpeg==0.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" imageio==2.21.2 ; python_full_version >= "3.7.1" and python_version < "3.10" importlib-metadata==5.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -iniconfig==1.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -jax==0.3.17 ; python_full_version >= "3.7.1" and python_version < "3.10" -jaxlib==0.3.15 ; python_full_version >= "3.7.1" and python_version < "3.10" -jinja2==3.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -jmespath==1.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -joblib==1.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" +importlib-resources==5.9.0 ; python_full_version >= "3.7.1" and python_version < "3.9" kiwisolver==1.4.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -labmaze==1.0.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -lxml==4.9.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -mako==1.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -markdown-include==0.7.0 ; python_full_version >= "3.7.1" and python_version < "3.10" markdown==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" markupsafe==2.1.1 ; python_full_version >= "3.7.1" and python_version < "3.10" matplotlib==3.5.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mergedeep==1.3.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material-extensions==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs-material==8.4.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -mkdocs==1.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -moderngl==5.6.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -monotonic==1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" moviepy==1.0.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -msgpack==1.0.4 ; python_full_version >= "3.7.1" and python_version < "3.10" -mujoco==2.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -multi-agent-ale-py==0.1.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -numpy==1.21.6 ; python_version < "3.10" and python_full_version >= "3.7.1" +numpy==1.21.6 ; python_full_version >= "3.7.1" and python_version < "3.10" oauthlib==3.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -opencv-python==4.6.0.66 ; python_full_version >= "3.7.1" and python_version < "3.10" -opt-einsum==3.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -optax==0.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna-dashboard==0.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -optuna==3.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" packaging==21.3 ; python_full_version >= "3.7.1" and python_version < "3.10" pandas==1.3.5 ; python_full_version >= "3.7.1" and python_version < "3.10" pathtools==0.1.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pbr==5.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pettingzoo==1.18.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pillow==9.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pluggy==1.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -prettytable==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -procgen==0.10.7 ; python_full_version >= "3.7.1" and python_version < "3.10" proglog==0.1.10 ; python_full_version >= "3.7.1" and python_version < "3.10" protobuf==3.19.4 ; python_full_version >= "3.7.1" and python_version < "3.10" psutil==5.9.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -py==1.11.0 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1-modules==0.2.8 ; python_full_version >= "3.7.1" and python_version < "3.10" pyasn1==0.4.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pybullet==3.1.8 ; python_full_version >= "3.7.1" and python_version < "3.10" -pycparser==2.21 ; python_full_version >= "3.7.1" and python_version < "3.10" pygame==2.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pygments==2.13.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -pymdown-extensions==9.5 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyopengl==3.1.6 ; python_full_version >= "3.7.1" and python_version < "3.10" pyparsing==2.4.7 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyperclip==1.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyreadline3==3.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" and sys_platform == "win32" -pytest==7.1.3 ; python_full_version >= "3.7.1" and python_version < "3.10" python-dateutil==2.8.2 ; python_full_version >= "3.7.1" and python_version < "3.10" pytz==2022.2.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -pyyaml-env-tag==0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" pyyaml==5.4.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests-oauthlib==1.3.1 ; python_full_version >= "3.7.1" and python_version < "3.10" requests==2.28.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -rich==11.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" rsa==4.7.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -s3transfer==0.6.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -scikit-learn==1.0.2 ; python_full_version >= "3.7.1" and python_version < "3.10" -scipy==1.7.3 ; python_full_version >= "3.7.1" and python_version < "3.10" sentry-sdk==1.9.8 ; python_full_version >= "3.7.1" and python_version < "3.10" setproctitle==1.3.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools-scm==6.4.2 ; python_full_version >= "3.7.1" and python_version < "3.10" setuptools==65.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -shimmy==0.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" six==1.16.0 ; python_full_version >= "3.7.1" and python_version < "3.10" smmap==5.0.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -sqlalchemy==1.4.41 ; python_full_version >= "3.7.1" and python_version < "3.10" stable-baselines3==1.2.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -stevedore==3.5.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -supersuit==3.4.0 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-data-server==0.6.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard-plugin-wit==1.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tensorboard==2.10.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -threadpoolctl==3.1.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -tinyscaler==1.2.4 ; python_full_version >= "3.7.1" and python_version < "3.10" tomli==2.0.1 ; python_full_version >= "3.7.1" and python_version < "3.10" -toolz==0.12.0 ; python_full_version >= "3.7.1" and python_version < "3.10" torch==1.12.1 ; python_full_version >= "3.7.1" and python_version < "3.10" tqdm==4.65.0 ; python_full_version >= "3.7.1" and python_version < "3.10" -types-protobuf==3.20.2 ; python_full_version >= "3.7.1" and python_version < "3.10" typing-extensions==4.3.0 ; python_full_version >= "3.7.1" and python_version < "3.10" urllib3==1.26.12 ; python_full_version >= "3.7.1" and python_version < "3.10" wandb==0.13.11 ; python_full_version >= "3.7.1" and python_version < "3.10" -watchdog==2.1.9 ; python_full_version >= "3.7.1" and python_version < "3.10" -wcwidth==0.2.5 ; python_full_version >= "3.7.1" and python_version < "3.10" werkzeug==2.2.2 ; python_full_version >= "3.7.1" and python_version < "3.10" wheel==0.37.1 ; python_full_version >= "3.7.1" and python_version < "3.10" zipp==3.8.1 ; python_full_version >= "3.7.1" and python_version < "3.10" From 054aacb1b879228a3eca7f82b599c0c08ae0e002 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:40:36 -0400 Subject: [PATCH 09/16] remove poetry groups for tests --- .github/workflows/tests.yaml | 28 ++++++++++++++-------------- .github/workflows/utils_test.yaml | 4 ++-- 2 files changed, 16 insertions(+), 16 deletions(-) diff --git a/.github/workflows/tests.yaml b/.github/workflows/tests.yaml index 0437dec15..7df817dee 100644 --- a/.github/workflows/tests.yaml +++ b/.github/workflows/tests.yaml @@ -26,14 +26,14 @@ jobs: # classic control tests - name: Install core dependencies - run: poetry install --with pytest + run: poetry install -E pytest - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run core tests run: poetry run pytest tests/test_classic_control.py - name: Install jax if: runner.os == 'Linux' || runner.os == 'macOS' - run: poetry install --with jax + run: poetry install -E jax - name: Run core tests with jax if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_classic_control_jax.py @@ -41,7 +41,7 @@ jobs: if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_jax_compute_gae.py - name: Install tuner dependencies - run: poetry install --with optuna + run: poetry install -E optuna - name: Run tuner tests run: poetry run pytest tests/test_tuner.py @@ -65,14 +65,14 @@ jobs: # atari tests - name: Install atari dependencies - run: poetry install --with pytest,atari + run: poetry install -E "pytest atari" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run atari tests run: poetry run pytest tests/test_atari.py - name: Install jax if: runner.os == 'Linux' || runner.os == 'macOS' - run: poetry install --with jax + run: poetry install -E jax - name: Run core tests with jax if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_atari_jax.py @@ -97,9 +97,9 @@ jobs: # pybullet tests - name: Install core dependencies - run: poetry install --with pytest + run: poetry install -E pytest - name: Install pybullet dependencies - run: poetry install --with pybullet + run: poetry install -E pybullet - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run pybullet tests @@ -125,7 +125,7 @@ jobs: # procgen tests - name: Install core dependencies - run: poetry install --with pytest,procgen + run: poetry install -E "pytest procgen" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run pybullet tests @@ -151,7 +151,7 @@ jobs: # mujoco tests - name: Install dependencies - run: poetry install --with pytest,mujoco,dm_control + run: poetry install -E "pytest mujoco dm_control" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: install mujoco dependencies @@ -181,7 +181,7 @@ jobs: # mujoco tests - name: Install dependencies - run: poetry install --with pytest,mujoco,dm_control + run: poetry install -E "pytest mujoco dm_control" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run mujoco tests @@ -208,7 +208,7 @@ jobs: # mujoco_py tests - name: Install dependencies - run: poetry install --with pytest,pybullet,mujoco_py,mujoco,jax + run: poetry install -E "pytest pybullet mujoco_py mujoco jax" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: install mujoco_py dependencies @@ -241,7 +241,7 @@ jobs: # envpool tests - name: Install envpool dependencies - run: poetry install --with pytest,envpool,jax + run: poetry install -E "pytest envpool jax" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run envpool tests @@ -267,7 +267,7 @@ jobs: # atari multigpu tests - name: Install atari dependencies - run: poetry install --with pytest,atari + run: poetry install -E "pytest atari" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run atari tests @@ -293,7 +293,7 @@ jobs: # pettingzoo tests - name: Install pettingzoo dependencies - run: poetry install --with pytest,pettingzoo,atari + run: poetry install -E "pytest pettingzoo atari" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Install ROMs diff --git a/.github/workflows/utils_test.yaml b/.github/workflows/utils_test.yaml index 259e661cb..bca2892d9 100644 --- a/.github/workflows/utils_test.yaml +++ b/.github/workflows/utils_test.yaml @@ -25,9 +25,9 @@ jobs: poetry-version: ${{ matrix.poetry-version }} - name: Install test dependencies - run: poetry install --with pytest + run: poetry install -E pytest - name: Install cloud dependencies - run: poetry install --with cloud + run: poetry install -E cloud - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run utils tests From 2003afab739e3a015a7120b80857c9c90e579756 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:51:50 -0400 Subject: [PATCH 10/16] Update PPO, RND, and RPO docs --- docs/rl-algorithms/ppo-rnd.md | 20 +++-- docs/rl-algorithms/ppo.md | 161 +++++++++++++++++++++++++--------- docs/rl-algorithms/rpo.md | 37 ++++++++ 3 files changed, 172 insertions(+), 46 deletions(-) diff --git a/docs/rl-algorithms/ppo-rnd.md b/docs/rl-algorithms/ppo-rnd.md index 98fb86f26..9d70d96fa 100644 --- a/docs/rl-algorithms/ppo-rnd.md +++ b/docs/rl-algorithms/ppo-rnd.md @@ -46,11 +46,21 @@ The [ppo_rnd_envpool.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ ### Usage -```bash -poetry install -E envpool -python cleanrl/ppo_rnd_envpool.py --help -python cleanrl/ppo_rnd_envpool.py --env-id MontezumaRevenge-v5 -``` +=== "poetry" + + ```bash + poetry install -E envpool + poetry run python cleanrl/ppo_rnd_envpool.py --help + poetry run python cleanrl/ppo_rnd_envpool.py --env-id MontezumaRevenge-v5 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-envpool.txt + python cleanrl/ppo_rnd_envpool.py --help + python cleanrl/ppo_rnd_envpool.py --env-id MontezumaRevenge-v5 + ``` ### Explanation of the logged metrics diff --git a/docs/rl-algorithms/ppo.md b/docs/rl-algorithms/ppo.md index 0d85e35d2..e01086175 100644 --- a/docs/rl-algorithms/ppo.md +++ b/docs/rl-algorithms/ppo.md @@ -540,11 +540,21 @@ The [ppo_atari_envpool.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanr ### Usage -```bash -poetry install -E envpool -python cleanrl/ppo_atari_envpool.py --help -python cleanrl/ppo_atari_envpool.py --env-id Breakout-v5 -``` +=== "poetry" + + ```bash + poetry install -E envpool + poetry run python cleanrl/ppo_atari_envpool.py --help + poetry run python cleanrl/ppo_atari_envpool.py --env-id Breakout-v5 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-envpool.txt + python cleanrl/ppo_atari_envpool.py --help + python cleanrl/ppo_atari_envpool.py --env-id Breakout-v5 + ``` ### Explanation of the logged metrics @@ -623,12 +633,24 @@ The [ppo_atari_envpool_xla_jax.py](https://github.com/vwxyzjn/cleanrl/blob/maste ### Usage -```bash -poetry install -E "envpool jax" -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -python cleanrl/ppo_atari_envpool_xla_jax.py --help -python cleanrl/ppo_atari_envpool_xla_jax.py --env-id Breakout-v5 -``` +=== "poetry" + + ```bash + poetry install -E "envpool jax" + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + poetry run python cleanrl/ppo_atari_envpool_xla_jax.py --help + poetry run python cleanrl/ppo_atari_envpool_xla_jax.py --env-id Breakout-v5 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-envpool.txt + pip install -r requirements/requirements-jax.txt + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + python cleanrl/ppo_atari_envpool_xla_jax.py --help + python cleanrl/ppo_atari_envpool_xla_jax.py --env-id Breakout-v5 + ``` ### Explanation of the logged metrics @@ -786,12 +808,24 @@ The [ppo_atari_envpool_xla_jax_scan.py](https://github.com/vwxyzjn/cleanrl/blob/ ### Usage -```bash -poetry install -E "envpool jax" -poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html -python cleanrl/ppo_atari_envpool_xla_jax_scan.py --help -python cleanrl/ppo_atari_envpool_xla_jax_scan.py --env-id Breakout-v5 -``` +=== "poetry" + + ```bash + poetry install -E "envpool jax" + poetry run pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + poetry run python cleanrl/ppo_atari_envpool_xla_jax_scan.py --help + poetry run python cleanrl/ppo_atari_envpool_xla_jax_scan.py --env-id Breakout-v5 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-envpool.txt + pip install -r requirements/requirements-jax.txt + pip install --upgrade "jax[cuda]==0.3.17" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html + python cleanrl/ppo_atari_envpool_xla_jax_scan.py --help + python cleanrl/ppo_atari_envpool_xla_jax_scan.py --env-id Breakout-v5 + ``` ### Explanation of the logged metrics @@ -841,11 +875,21 @@ The [ppo_procgen.py](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/ppo_ ### Usage -```bash -poetry install -E procgen -python cleanrl/ppo_procgen.py --help -python cleanrl/ppo_procgen.py --env-id starpilot -``` +=== "poetry" + + ```bash + poetry install -E procgen + poetry run python cleanrl/ppo_procgen.py --help + poetry run python cleanrl/ppo_procgen.py --env-id starpilot + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-procgen.txt + python cleanrl/ppo_procgen.py --help + python cleanrl/ppo_procgen.py --env-id starpilot + ``` ### Explanation of the logged metrics @@ -920,21 +964,43 @@ The [ppo_atari_multigpu.py](https://github.com/vwxyzjn/cleanrl/blob/master/clean ### Usage -```bash -poetry install -E atari -python cleanrl/ppo_atari_multigpu.py --help -# `--nproc_per_node=2` specifies how many subprocesses we spawn for training with data parallelism -# note it is possible to run this with a *single GPU*: each process will simply share the same GPU -torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 +=== "poetry" + + ```bash + poetry install -E atari + poetry run python cleanrl/ppo_atari_multigpu.py --help + + # `--nproc_per_node=2` specifies how many subprocesses we spawn for training with data parallelism + # note it is possible to run this with a *single GPU*: each process will simply share the same GPU + poetry run torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 + + # by default we use the `gloo` backend, but you can use the `nccl` backend for better multi-GPU performance + poetry run torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --backend nccl + + # it is possible to spawn more processes than the amount of GPUs you have via `--device-ids` + # e.g., the command below spawns two processes using GPU 0 and two processes using GPU 1 + poetry run torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --device-ids 0 0 1 1 + ``` -# by default we use the `gloo` backend, but you can use the `nccl` backend for better multi-GPU performance -torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --backend nccl +=== "pip" + + ```bash + pip install -r requirements/requirements-atari.txt + python cleanrl/ppo_atari_multigpu.py --help + + # `--nproc_per_node=2` specifies how many subprocesses we spawn for training with data parallelism + # note it is possible to run this with a *single GPU*: each process will simply share the same GPU + torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 + + # by default we use the `gloo` backend, but you can use the `nccl` backend for better multi-GPU performance + torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --backend nccl + + # it is possible to spawn more processes than the amount of GPUs you have via `--device-ids` + # e.g., the command below spawns two processes using GPU 0 and two processes using GPU 1 + torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --device-ids 0 0 1 1 + ``` -# it is possible to spawn more processes than the amount of GPUs you have via `--device-ids` -# e.g., the command below spawns two processes using GPU 0 and two processes using GPU 1 -torchrun --standalone --nnodes=1 --nproc_per_node=2 cleanrl/ppo_atari_multigpu.py --env-id BreakoutNoFrameskip-v4 --device-ids 0 0 1 1 -``` ### Explanation of the logged metrics @@ -1170,13 +1236,26 @@ Tracked experiments and game play videos: ### Usage -```bash -poetry install -E "pettingzoo atari" -poetry run AutoROM --accept-license -python cleanrl/ppo_pettingzoo_ma_atari.py --help -python cleanrl/ppo_pettingzoo_ma_atari.py --env-id pong_v3 -python cleanrl/ppo_pettingzoo_ma_atari.py --env-id surround_v2 -``` +=== "poetry" + + ```bash + poetry install -E "pettingzoo atari" + poetry run AutoROM --accept-license + poetry run cleanrl/ppo_pettingzoo_ma_atari.py --help + poetry run cleanrl/ppo_pettingzoo_ma_atari.py --env-id pong_v3 + poetry run cleanrl/ppo_pettingzoo_ma_atari.py --env-id surround_v2 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-pettingzoo.txt + pip install -r requirements/requirements-atari.txt + AutoROM --accept-license + python cleanrl/ppo_pettingzoo_ma_atari.py --help + python cleanrl/ppo_pettingzoo_ma_atari.py --env-id pong_v3 + python cleanrl/ppo_pettingzoo_ma_atari.py --env-id surround_v2 + ``` See [https://www.pettingzoo.ml/atari](https://www.pettingzoo.ml/atari) for a full-list of supported environments such as `basketball_pong_v3`. Notice pettingzoo sometimes introduces breaking changes, so make sure to install the pinned dependencies via `poetry`. diff --git a/docs/rl-algorithms/rpo.md b/docs/rl-algorithms/rpo.md index b048fb483..b78b3adc0 100644 --- a/docs/rl-algorithms/rpo.md +++ b/docs/rl-algorithms/rpo.md @@ -48,6 +48,43 @@ python cleanrl/rpo_continuous_action.py --env-id BipedalWalker-v3 ``` +=== "poetry" + + ```bash + # mujoco v4 environments + poetry install -E mujoco + python cleanrl/rpo_continuous_action.py --help + python cleanrl/rpo_continuous_action.py --env-id Hopper-v4 + # NOTE: we recommend using --rpo-alpha 0.01 for Ant Hopper InvertedDoublePendulum Reacher Pusher + python cleanrl/rpo_continuous_action.py --env-id Ant-v4 --rpo-alpha 0.01 + # dm_control environments + poetry install -E "mujoco dm_control" + python cleanrl/rpo_continuous_action.py --env-id dm_control/cartpole-balance-v0 + # backwards compatibility with mujoco v2 environments + poetry install -E mujoco_py + python cleanrl/rpo_continuous_action.py --env-id Hopper-v2 + # BipedalWalker-v3 experiment (hack) + poetry run pip install box2d-py==2.3.5 + poetry run python cleanrl/rpo_continuous_action.py --env-id BipedalWalker-v3 + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-mujoco.txt + python cleanrl/rpo_continuous_action.py --help + python cleanrl/rpo_continuous_action.py --env-id Hopper-v4 + # NOTE: we recommend using --rpo-alpha 0.01 for Ant Hopper InvertedDoublePendulum Reacher Pusher + python cleanrl/rpo_continuous_action.py --env-id Ant-v4 --rpo-alpha 0.01 + pip install -r requirements/requirements-dm_control.txt + python cleanrl/rpo_continuous_action.py --env-id dm_control/cartpole-balance-v0 + pip install -r requirements/requirements-mujoco_py.txt + python cleanrl/rpo_continuous_action.py --env-id Hopper-v2 + pip install box2d-py==2.3.5 + python cleanrl/rpo_continuous_action.py --env-id BipedalWalker-v3 + ``` + + ### Explanation of the logged metrics See [related docs](/rl-algorithms/ppo/#explanation-of-the-logged-metrics) for `ppo.py`. From 15e8850914032726bab8c5e6675e2ef31694e78c Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:52:44 -0400 Subject: [PATCH 11/16] update PPG docs --- docs/rl-algorithms/ppg.md | 20 +++++++++++++++----- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git a/docs/rl-algorithms/ppg.md b/docs/rl-algorithms/ppg.md index 0b2e40134..8da484f55 100644 --- a/docs/rl-algorithms/ppg.md +++ b/docs/rl-algorithms/ppg.md @@ -29,11 +29,21 @@ Below are our single-file implementations of PPG: ### Usage -```bash -poetry install -E procgen -python cleanrl/ppg_procgen.py --help -python cleanrl/ppg_procgen.py --env-id "bigfish" -``` +=== "poetry" + + ```bash + poetry install -E procgen + poetry run python cleanrl/ppg_procgen.py --help + poetry run python cleanrl/ppg_procgen.py --env-id starpilot + ``` + +=== "pip" + + ```bash + pip install -r requirements/requirements-procgen.txt + python cleanrl/ppg_procgen.py --help + python cleanrl/ppg_procgen.py --env-id starpilot + ``` ### Explanation of the logged metrics From 47ab16afde47ef1db0a89369da74fb0c322f5652 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:53:06 -0400 Subject: [PATCH 12/16] update docs --- README.md | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index bf90c78ee..05937826e 100644 --- a/README.md +++ b/README.md @@ -79,7 +79,9 @@ pip install -r requirements/requirements.txt # optional dependencies pip install -r requirements/requirements-atari.txt pip install -r requirements/requirements-pybullet.txt +pip install -r requirements/requirements-mujoco.txt pip install -r requirements/requirements-mujoco_py.txt +pip install -r requirements/requirements/requirements-mujoco.txt pip install -r requirements/requirements-procgen.txt pip install -r requirements/requirements-envpool.txt pip install -r requirements/requirements-pettingzoo.txt @@ -98,27 +100,27 @@ python cleanrl/ppo.py --env-id CartPole-v1 python cleanrl/c51.py --env-id CartPole-v1 # atari -poetry install --with atari +poetry install -E atari python cleanrl/dqn_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/c51_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/ppo_atari.py --env-id BreakoutNoFrameskip-v4 python cleanrl/sac_atari.py --env-id BreakoutNoFrameskip-v4 # NEW: 3-4x side-effects free speed up with envpool's atari (only available to linux) -poetry install --with envpool +poetry install -E envpool python cleanrl/ppo_atari_envpool.py --env-id BreakoutNoFrameskip-v4 # Learn Pong-v5 in ~5-10 mins # Side effects such as lower sample efficiency might occur poetry run python ppo_atari_envpool.py --clip-coef=0.2 --num-envs=16 --num-minibatches=8 --num-steps=128 --update-epochs=3 # pybullet -poetry install --with pybullet +poetry install -E pybullet python cleanrl/td3_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 python cleanrl/ddpg_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 python cleanrl/sac_continuous_action.py --env-id MinitaurBulletDuckEnv-v0 # procgen -poetry install --with procgen +poetry install -E procgen python cleanrl/ppo_procgen.py --env-id starpilot python cleanrl/ppg_procgen.py --env-id starpilot From 8c07d535e3a112fb4f8fa60e47c5c5debaf266a1 Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 13:54:53 -0400 Subject: [PATCH 13/16] trigger CI --- cleanrl/ppo.py | 1 - 1 file changed, 1 deletion(-) diff --git a/cleanrl/ppo.py b/cleanrl/ppo.py index 4a7c2999d..1c4831f6d 100644 --- a/cleanrl/ppo.py +++ b/cleanrl/ppo.py @@ -1,5 +1,4 @@ # docs and experiment results can be found at https://docs.cleanrl.dev/rl-algorithms/ppo/#ppopy - import argparse import os import random From 4695c2993abb53c71d7ff0bab3865bb5469f187e Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Thu, 30 Mar 2023 16:08:06 -0400 Subject: [PATCH 14/16] fix CI --- .github/workflows/tests.yaml | 8 ++++---- .github/workflows/utils_test.yaml | 2 +- 2 files changed, 5 insertions(+), 5 deletions(-) diff --git a/.github/workflows/tests.yaml b/.github/workflows/tests.yaml index 7df817dee..315ac46b0 100644 --- a/.github/workflows/tests.yaml +++ b/.github/workflows/tests.yaml @@ -33,7 +33,7 @@ jobs: run: poetry run pytest tests/test_classic_control.py - name: Install jax if: runner.os == 'Linux' || runner.os == 'macOS' - run: poetry install -E jax + run: poetry install -E "pytest jax" - name: Run core tests with jax if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_classic_control_jax.py @@ -41,7 +41,7 @@ jobs: if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_jax_compute_gae.py - name: Install tuner dependencies - run: poetry install -E optuna + run: poetry install -E "pytest optuna" - name: Run tuner tests run: poetry run pytest tests/test_tuner.py @@ -72,7 +72,7 @@ jobs: run: poetry run pytest tests/test_atari.py - name: Install jax if: runner.os == 'Linux' || runner.os == 'macOS' - run: poetry install -E jax + run: poetry install -E "pytest atari jax" - name: Run core tests with jax if: runner.os == 'Linux' || runner.os == 'macOS' run: poetry run pytest tests/test_atari_jax.py @@ -99,7 +99,7 @@ jobs: - name: Install core dependencies run: poetry install -E pytest - name: Install pybullet dependencies - run: poetry install -E pybullet + run: poetry install -E "pytest pybullet" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run pybullet tests diff --git a/.github/workflows/utils_test.yaml b/.github/workflows/utils_test.yaml index bca2892d9..0139777ea 100644 --- a/.github/workflows/utils_test.yaml +++ b/.github/workflows/utils_test.yaml @@ -27,7 +27,7 @@ jobs: - name: Install test dependencies run: poetry install -E pytest - name: Install cloud dependencies - run: poetry install -E cloud + run: poetry install -E "pytest cloud" - name: Downgrade setuptools run: poetry run pip install setuptools==59.5.0 - name: Run utils tests From 0d055c2fb19cf61bfcd325ed4e2e205174801acc Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Fri, 31 Mar 2023 09:22:17 -0400 Subject: [PATCH 15/16] Fix depdenencies --- Dockerfile | 4 +--- README.md | 1 + docs/contribution.md | 2 +- 3 files changed, 3 insertions(+), 4 deletions(-) diff --git a/Dockerfile b/Dockerfile index 9ddcc8027..f75adf40f 100644 --- a/Dockerfile +++ b/Dockerfile @@ -12,8 +12,6 @@ RUN pip install poetry --upgrade COPY pyproject.toml pyproject.toml COPY poetry.lock poetry.lock RUN poetry install -RUN poetry install -E atari -RUN poetry install -E pybullet # install mujoco_py RUN apt-get -y install wget unzip software-properties-common \ @@ -21,7 +19,7 @@ RUN apt-get -y install wget unzip software-properties-common \ libgl1-mesa-glx \ libglew-dev \ libosmesa6-dev patchelf -RUN poetry install -E mujoco_py +RUN poetry install -E "atari mujoco_py pybullet" RUN poetry run python -c "import mujoco_py" COPY entrypoint.sh /usr/local/bin/ diff --git a/README.md b/README.md index 05937826e..760505851 100644 --- a/README.md +++ b/README.md @@ -125,6 +125,7 @@ python cleanrl/ppo_procgen.py --env-id starpilot python cleanrl/ppg_procgen.py --env-id starpilot # ppo + lstm +poetry install -E atari python cleanrl/ppo_atari_lstm.py --env-id BreakoutNoFrameskip-v4 ``` diff --git a/docs/contribution.md b/docs/contribution.md index b7e0a0a68..b5dd8094c 100644 --- a/docs/contribution.md +++ b/docs/contribution.md @@ -77,7 +77,7 @@ Importantly, **regardless of the slight difference in performance-impacting chan Given a new feature, we create a PR and then run the benchmark experiments through [`benchmark.py`](https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl_utils/benchmark.py), such as the following: ```bash -poetry install -E "pybullet mujoco_py" +poetry install -E "docs pybullet mujoco_py" python -c "import mujoco_py" xvfb-run -a python -m cleanrl_utils.benchmark \ --env-ids HalfCheetah-v2 Walker2d-v2 Hopper-v2 \ From de1776cbd4c9c9e1b186cb322b27df13825aee7b Mon Sep 17 00:00:00 2001 From: Costa Huang Date: Fri, 31 Mar 2023 09:25:00 -0400 Subject: [PATCH 16/16] Move up pip installation --- docs/get-started/installation.md | 46 +++++++++++++++++--------------- 1 file changed, 24 insertions(+), 22 deletions(-) diff --git a/docs/get-started/installation.md b/docs/get-started/installation.md index 84b9d8c60..2fda60cf1 100644 --- a/docs/get-started/installation.md +++ b/docs/get-started/installation.md @@ -45,6 +45,30 @@ poetry install default = true ``` + +## Install via `pip` + +While we recommend using `poetry` to manage environments and dependencies, the traditional `requirements.txt` are available: + +```bash +# core dependencies +pip install -r requirements/requirements.txt + +# optional dependencies +pip install -r requirements/requirements-atari.txt +pip install -r requirements/requirements-pybullet.txt +pip install -r requirements/requirements-mujoco.txt +pip install -r requirements/requirements-mujoco_py.txt +pip install -r requirements/requirements/requirements-mujoco.txt +pip install -r requirements/requirements-procgen.txt +pip install -r requirements/requirements-envpool.txt +pip install -r requirements/requirements-pettingzoo.txt +pip install -r requirements/requirements-jax.txt +pip install -r requirements/requirements-docs.txt +pip install -r requirements/requirements-cloud.txt +``` + + ## Optional Dependencies CleanRL makes it easy to install optional dependencies for common RL environments @@ -87,25 +111,3 @@ poetry install -E optuna poetry install -E docs poetry install -E cloud ``` - -## Install via `pip` - -While we recommend using `poetry` to manage environments and dependencies, the traditional `requirements.txt` are available: - -```bash -# core dependencies -pip install -r requirements/requirements.txt - -# optional dependencies -pip install -r requirements/requirements-atari.txt -pip install -r requirements/requirements-pybullet.txt -pip install -r requirements/requirements-mujoco.txt -pip install -r requirements/requirements-mujoco_py.txt -pip install -r requirements/requirements/requirements-mujoco.txt -pip install -r requirements/requirements-procgen.txt -pip install -r requirements/requirements-envpool.txt -pip install -r requirements/requirements-pettingzoo.txt -pip install -r requirements/requirements-jax.txt -pip install -r requirements/requirements-docs.txt -pip install -r requirements/requirements-cloud.txt -```