Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop the learner of NPG algorithm #84

Closed
wenzhangliu opened this issue Jan 12, 2025 · 1 comment
Closed

Develop the learner of NPG algorithm #84

wenzhangliu opened this issue Jan 12, 2025 · 1 comment

Comments

@wenzhangliu
Copy link
Collaborator

  • Initialize the NPG learner. Add the optimizer, scheduler, loss, gamma, etc.
  • The update method.
@wenzhangliu wenzhangliu added this to the Add NPG algorithm milestone Jan 12, 2025
@wenzhangliu
Copy link
Collaborator Author

The agent and learner modules of the NPG algorithm are successfully added. However, before running the NPG example, the configuration files (xuance/configs/npg/xxx.yaml) must be added. @XiangDuojie

import xuance

runner = xuance.get_runner(method='npg',
                           env='classic_control',
                           env_id='CartPole-v1',
                           is_test=False)
runner.run()

wenzhangliu added a commit that referenced this issue Jan 29, 2025
wenzhangliu added a commit that referenced this issue Feb 8, 2025
* extensive examples

* update coma and add examples

* examples for marl

* update the installation of SMAC

* arguments list

* update docs

* update discord invite link

* update dqn docs

* support optuna for dqn (#75)

* hyperparams for ddqn

* contributing to us

* agent.current_step (#79)

* pdqn_agent.md commit (#80)

* pdqn_agent.md commit1

* pdqn_agent.md commit2

* update readme and move demo to examples

* td3算法简介 (#81)

Co-authored-by: xiaoyangquan2002 <[email protected]>

* docs for hyperpameters tuning (#75)

* docs for hyperpameters tuning (#75)

* api documentation for tuning tools

* api documentation for tuning tools

* api documentation for tuning tools

* api documentation for tuning tools

* update DQN document (#82)

* td3算法简介

* docs for hyperpameters tuning (#75)

* docs for hyperpameters tuning (#75)

* api documentation for tuning tools

* api documentation for tuning tools

* api documentation for tuning tools

* api documentation for tuning tools

* update DQN document

---------

Co-authored-by: xiaoyangquan2002 <[email protected]>
Co-authored-by: wenzhangliu <[email protected]>

* hyperparameters setting for other algorithms (#77)

* hyperparameters setting for marl algorithms (#77)

* hyperparameters setting for marl algorithms (#77)

* update test files

* add basic examples for drl

* test for hyperparameters tuning

* update qrdqn configs

* a2c_agent.md commit (#90)

* pdqn_agent.md commit1

* pdqn_agent.md commit2

* a2c_agent.md commit-1

* add SAC document (#92)

* add SAC document

* update TD3 document

* update sac document

* update TD3 document

---------

Co-authored-by: xiaoyangquan2002 <[email protected]>

* DDPG.md (#93)

* add SAC document (#94)

* add SAC document

* update TD3 document

* update sac document

* update TD3 document

---------

Co-authored-by: xiaoyangquan2002 <[email protected]>

* example for dqn tuning

* hyperparameters tuning

* update configs

* remove to examples

* Add README_CN.md

* update readme

* update readme

* tune example

* installation for torch-scatter (#73)

* update

* multi-objective tuning

* return information during training #96

* itemgetter for one agent #97

* selected objectives for multi-objective tuning #98

* selected objectives for multi-objective tuning #98

* update readme

* installation

* environment link

* environment link

* docs for multi-objective tuning #100

* Add NPG agent and NPG learner (#102)

* complete the installation docs for torch-scatter #73

* complete the docs for multi-objective tuning #100

* environments

* environments

* complete the docs for multi-objective tuning #100

* npg config files #84

* usage update

* Add npg_agent.md (#103)

* Add NPG agent and NPG learner

* Add npg_agent.md and npg_learner.rst

* docs for npg

* npg index

* npg comments

* npg docs

* distributed training docs

* distributed training docs

* api annotation for operations

* update readme

* set_device

* v1.2.6

---------

Co-authored-by: TangY1fan <[email protected]>
Co-authored-by: xiaoyangquan2002 <[email protected]>
Co-authored-by: xiaoyangquan2002 <[email protected]>
Co-authored-by: XiangDuojie <[email protected]>
@wenzhangliu wenzhangliu mentioned this issue Feb 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant