Skip to content

Commit 36b378d

Browse files
wenzhangliuTangY1fanxiaoyangquan2002xiaoyangquan2002XiangDuojie
authored
v1.2.6 (#104)
* extensive examples * update coma and add examples * examples for marl * update the installation of SMAC * arguments list * update docs * update discord invite link * update dqn docs * support optuna for dqn (#75) * hyperparams for ddqn * contributing to us * agent.current_step (#79) * pdqn_agent.md commit (#80) * pdqn_agent.md commit1 * pdqn_agent.md commit2 * update readme and move demo to examples * td3算法简介 (#81) Co-authored-by: xiaoyangquan2002 <[email protected]> * docs for hyperpameters tuning (#75) * docs for hyperpameters tuning (#75) * api documentation for tuning tools * api documentation for tuning tools * api documentation for tuning tools * api documentation for tuning tools * update DQN document (#82) * td3算法简介 * docs for hyperpameters tuning (#75) * docs for hyperpameters tuning (#75) * api documentation for tuning tools * api documentation for tuning tools * api documentation for tuning tools * api documentation for tuning tools * update DQN document --------- Co-authored-by: xiaoyangquan2002 <[email protected]> Co-authored-by: wenzhangliu <[email protected]> * hyperparameters setting for other algorithms (#77) * hyperparameters setting for marl algorithms (#77) * hyperparameters setting for marl algorithms (#77) * update test files * add basic examples for drl * test for hyperparameters tuning * update qrdqn configs * a2c_agent.md commit (#90) * pdqn_agent.md commit1 * pdqn_agent.md commit2 * a2c_agent.md commit-1 * add SAC document (#92) * add SAC document * update TD3 document * update sac document * update TD3 document --------- Co-authored-by: xiaoyangquan2002 <[email protected]> * DDPG.md (#93) * add SAC document (#94) * add SAC document * update TD3 document * update sac document * update TD3 document --------- Co-authored-by: xiaoyangquan2002 <[email protected]> * example for dqn tuning * hyperparameters tuning * update configs * remove to examples * Add README_CN.md * update readme * update readme * tune example * installation for torch-scatter (#73) * update * multi-objective tuning * return information during training #96 * itemgetter for one agent #97 * selected objectives for multi-objective tuning #98 * selected objectives for multi-objective tuning #98 * update readme * installation * environment link * environment link * docs for multi-objective tuning #100 * Add NPG agent and NPG learner (#102) * complete the installation docs for torch-scatter #73 * complete the docs for multi-objective tuning #100 * environments * environments * complete the docs for multi-objective tuning #100 * npg config files #84 * usage update * Add npg_agent.md (#103) * Add NPG agent and NPG learner * Add npg_agent.md and npg_learner.rst * docs for npg * npg index * npg comments * npg docs * distributed training docs * distributed training docs * api annotation for operations * update readme * set_device * v1.2.6 --------- Co-authored-by: TangY1fan <[email protected]> Co-authored-by: xiaoyangquan2002 <[email protected]> Co-authored-by: xiaoyangquan2002 <[email protected]> Co-authored-by: XiangDuojie <[email protected]>
1 parent afc4113 commit 36b378d

File tree

320 files changed

+21034
-415
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

320 files changed

+21034
-415
lines changed

CODE_OF_CONDUCT.md

+78
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,78 @@
1+
# Contributor Covenant Code of Conduct
2+
3+
## Our Pledge
4+
5+
We as members, contributors, and leaders pledge to make participation in our community a harassment-free experience for everyone, regardless of age, body size, disability, ethnicity, gender identity and expression, level of experience, nationality, personal appearance, race, religion, or sexual identity and orientation.
6+
7+
We pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community.
8+
9+
## Our Standards
10+
11+
Examples of behavior that contributes to a positive environment for our community include:
12+
13+
- **Demonstrating empathy and kindness** toward other people
14+
- **Being respectful** of differing opinions, viewpoints, and experiences
15+
- **Giving and gracefully accepting constructive feedback**
16+
- **Accepting responsibility** for our mistakes, and **learning from them**
17+
- **Focusing on what is best** for the community
18+
- **Showing patience** and **understanding** toward new and less experienced community members
19+
20+
Examples of unacceptable behavior include:
21+
22+
- **The use of sexualized language or imagery**, and sexual attention or advances of any kind
23+
- **Trolling**, insulting or derogatory comments, and personal or political attacks
24+
- **Public or private harassment**
25+
- **Publishing others' private information**, such as a physical or electronic address, without explicit permission
26+
- **Other conduct which could reasonably be considered inappropriate** in a professional setting
27+
28+
## Enforcement Responsibilities
29+
30+
Community leaders are responsible for clarifying and enforcing our standards of acceptable behavior and will take appropriate and fair corrective action in response to any behavior that they deem inappropriate, threatening, offensive, or harmful.
31+
32+
Community leaders have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct, and will communicate reasons for moderation decisions when appropriate.
33+
34+
## Scope
35+
36+
This Code of Conduct applies within all community spaces, and also applies when an individual is officially representing the community in public spaces. Examples of representing our community include using an official e-mail address, posting via an official social media account, or acting as an appointed representative at an online or offline event.
37+
38+
## Enforcement
39+
40+
Instances of abusive, harassing, or otherwise unacceptable behavior may be reported to the community leaders responsible for enforcement at liu [_] wzh [at] foxmail [dot] com. All complaints will be reviewed and investigated promptly and fairly.
41+
42+
All community leaders are obligated to respect the privacy and security of the reporter of any incident.
43+
44+
## Enforcement Guidelines
45+
46+
Community leaders will follow these Community Impact Guidelines in determining the consequences for any action they deem in violation of this Code of Conduct:
47+
48+
### 1. Correction
49+
50+
**Community Impact**: Use of inappropriate language or other behavior deemed unprofessional or unwelcome in the community.
51+
52+
**Consequence**: A private, written warning from community leaders, providing additional details about the nature of the violation and an explanation of why the behavior was inappropriate. A public apology may be requested.
53+
54+
### 2. Warning
55+
56+
**Community Impact**: A violation through a single incident or series of actions.
57+
58+
**Consequence**: A warning with consequences for continued behavior. No interaction with the people involved, including unsolicited interaction with those enforcing the Code of Conduct, for a specified period of time.
59+
60+
### 3. Temporary Ban
61+
62+
**Community Impact**: A serious violation of community standards, including sustained inappropriate behavior.
63+
64+
**Consequence**: A temporary ban from any sort of interaction or public communication with the community for a specified period of time. No public or private interaction with the people involved, including unsolicited interaction with those enforcing the Code of Conduct, is allowed during this period.
65+
66+
### 4. Permanent Ban
67+
68+
**Community Impact**: Demonstrating a pattern of violation of community standards, including sustained inappropriate behavior, harassment of an individual, or aggression toward or disparagement of classes of individuals.
69+
70+
**Consequence**: A permanent ban from any sort of public interaction within the community.
71+
72+
## Attribution
73+
74+
This Code of Conduct is adapted from the [Contributor Covenant][https://www.contributor-covenant.org/], version 2.0, available at [https://www.contributor-covenant.org/version/2/0/code_of_conduct/](https://www.contributor-covenant.org/version/2/0/code_of_conduct/).
75+
76+
Community Impact Guidelines were inspired by [Mozilla's code of conduct enforcement ladder](https://github.com/mozilla/diversity).
77+
78+
Translations are available at [https://www.contributor-covenant.org/translations/](https://www.contributor-covenant.org/translations/)

CONTRIBUTING.md

+133
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,133 @@
1+
# Contributing to XuanCe
2+
3+
Thank you for your interest in contributing to **XuanCe**! We welcome and appreciate contributions from the community to help improve and expand this deep reinforcement learning library. By participating in this project, you help make XuanCe more robust, versatile, and user-friendly for researchers, developers, and enthusiasts alike.
4+
5+
## Table of Contents
6+
7+
- [How to Contribute](#how-to-contribute)
8+
- [Reporting Issues](#reporting-issues)
9+
- [Suggesting Enhancements](#suggesting-enhancements)
10+
- [Contributing Code](#contributing-code)
11+
- [Coding Guidelines](#coding-guidelines)
12+
- [Setting Up the Development Environment](#setting-up-the-development-environment)
13+
- [Pull Request Process](#pull-request-process)
14+
- [Code of Conduct](#code-of-conduct)
15+
- [Need Help?](#need-help)
16+
17+
## How to Contribute
18+
19+
### Reporting Issues
20+
21+
If you encounter a bug, have a feature request, or find something unclear, please help us by creating an issue:
22+
23+
1. Go to the [Issues](https://github.com/agi-brain/xuance/issues) page.
24+
2. Click on **New Issue**.
25+
3. Choose the appropriate template (bug report, feature request, etc.).
26+
4. Provide a clear and descriptive title.
27+
5. Fill out the template with as much detail as possible, including steps to reproduce the issue, expected behavior, actual behavior, and any relevant screenshots or logs.
28+
29+
### Suggesting Enhancements
30+
31+
We welcome suggestions for new features or improvements:
32+
33+
1. Open a new issue on the [Issues](https://github.com/agi-brain/xuance/issues) page.
34+
2. Choose the **Feature Request** template.
35+
3. Clearly describe the enhancement or feature you have in mind.
36+
4. Explain the problem it solves or the benefit it provides.
37+
38+
### Contributing Code
39+
40+
If you'd like to contribute code to XuanCe, please follow these steps:
41+
42+
1. **Fork the Repository**
43+
- Click the **Fork** button at the top-right corner of the [XuanCe GitHub repository](https://github.com/agi-brain/xuance).
44+
45+
2. **Clone Your Fork**
46+
```bash
47+
git clone https://github.com/<your-username>/xuance.git
48+
cd xuance
49+
50+
3. **Create a New Branch**
51+
- Use a descriptive branch name.
52+
53+
```bash
54+
git checkout -b branch-name
55+
```
56+
57+
4. **Make Your Changes**
58+
- Implement your feature or bug fix.
59+
- Ensure your code adheres to the project's coding standards.
60+
61+
5. **Run Tests**
62+
- Ensure all existing tests pass.
63+
- Add new tests for your changes if applicable.
64+
65+
6. **Commit Your Changes**
66+
- Write a clear and concise commit message.
67+
```bash
68+
git commit -m "short-description"
69+
```
70+
71+
7. **Push to Your Fork**
72+
```bash
73+
git push origin branch-name
74+
```
75+
76+
8. **Create a Pull Request**
77+
- Navigate to your fork on GitHub.
78+
- Click the Compare & pull request button.
79+
- Provide a detailed description of your changes.
80+
- Submit the pull request to the main branch of the original XuanCe repository.
81+
82+
### Coding Guidelines
83+
84+
To maintain consistency and quality across the project, please follow these guidelines:
85+
- Follow PEP 8: Adhere to PEP 8 coding standards for Python.
86+
- Meaningful Names: Use clear and descriptive names for variables, functions, classes, and modules.
87+
- Docstrings and Comments: Provide comprehensive docstrings for all public modules, functions, classes, and methods. Use comments to explain complex logic.
88+
- Modular Code: Write modular and reusable code. Break down large functions into smaller, manageable pieces.
89+
- Error Handling: Implement proper error handling to make the library robust and user-friendly.
90+
- Testing: Write unit tests for new features and bug fixes. Ensure that all tests pass before submitting a pull request.
91+
- Documentation: Update the documentation to reflect any changes or additions to the codebase.
92+
93+
### Pull Request Process
94+
95+
1. Ensure Your Branch is Up to Date
96+
- Sync your fork with the original repository to avoid merge conflicts.
97+
98+
2. Submit a Pull Request
99+
- Provide a clear title and detailed description of your changes.
100+
- Reference any related issues using keywords like Closes #123.
101+
102+
3. Address Feedback
103+
- Collaborate with maintainers to make necessary revisions.
104+
105+
4. Final Approval
106+
- Once approved, your pull request will be merged into the main branch.
107+
108+
### Code of Conduct
109+
110+
By participating in this project, you agree to abide by our [Code of Conduct](CODE_OF_CONDUCT.md).
111+
Please read it to understand the expectations for participation.
112+
113+
### Contributing to Documentation
114+
115+
Contributing to documentation improvements is highly valuable to us. Please follow the steps below to update or add documentation:
116+
117+
- **Locate Documentation Files:** Documentation is located in the `docs/` directory.
118+
- **Make Changes:** Update existing documentation or add new documentation files.
119+
- **Build Documentation Locally:** Follow the documentation build guide to preview your changes locally.
120+
- **Submit a Pull Request (PR):** Ensure your documentation changes are clear, properly formatted, and describe the changes made in your PR.
121+
122+
### Contact Us
123+
124+
If you have any questions or need further assistance, please contact us through the following methods:
125+
126+
- **Email:** liu [_] wzh [at] foxmail [dot] com
127+
- **GitHub Issues:** [Create a new issue](https://github.com/agi-brain/xuance/issues)
128+
- **Discussions:** [Join the discussion](https://github.com/agi-brain/xuance/discussions)
129+
- **Discord:** [https://discord.gg/HJn2TBQS7y](https://discord.gg/HJn2TBQS7y)
130+
- **Slack:** [https://join.slack.com/t/xuancerllib/](https://join.slack.com/t/xuancerllib/shared_invite/zt-2x2r98msi-iMX6mSVcgWwXYj95abcXIw)
131+
- **QQ group:** 552432695
132+
133+
Thank you for contributing to XuanCe! Your efforts help make this library a valuable resource for the community.

CONTRIBUTING_CN.md

+103
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,103 @@
1+
# 贡献指南
2+
3+
感谢您对 [XuanCe](https://github.com/agi-brain/xuance) 项目的兴趣!我们欢迎各种形式的贡献,包括但不限于报告错误、提出功能建议、改进文档以及代码贡献。以下是如何参与贡献的详细指南。
4+
5+
## 行为准则
6+
7+
请在参与贡献前阅读并遵守我们的 [行为准则](CODE_OF_CONDUCT.md)。我们致力于维护一个友好、包容和尊重的社区环境,确保每位贡献者都能感受到欢迎和尊重。
8+
9+
## 如何贡献
10+
11+
### 报告问题
12+
13+
如果您在使用 XuanCe 时发现了错误或有改进建议,请通过以下步骤报告问题:
14+
15+
1. **检查现有问题:** 在提交新问题前,请先浏览 [现有问题](https://github.com/agi-brain/xuance/issues),确保您的问题尚未被报告。
16+
2. **创建新问题:** 点击 “New issue” 按钮,选择合适的问题模板(如 Bug 报告或功能请求)。
17+
3. **详细描述:** 提供详细的问题描述,包括重现步骤、预期行为、实际行为以及任何相关的日志或截图。
18+
19+
### 提出功能建议
20+
21+
如果您有关于 XuanCe 的新功能或改进建议,请按照以下步骤操作:
22+
23+
1. **检查现有建议:** 在提交新建议前,请先浏览 [现有建议](https://github.com/agi-brain/xuance/issues),确保您的建议尚未被提出。
24+
2. **创建新建议:** 点击 “New issue” 按钮,选择 “Feature request” 模板。
25+
3. **详细描述:** 清晰地描述您的建议,包括功能的用途、预期效果以及可能的实现方式。
26+
27+
### 提交 Pull Request
28+
29+
我们鼓励您通过提交 Pull Request (PR) 的方式为项目做出贡献。以下是提交 PR 的步骤:
30+
31+
1. **Fork 仓库:**
32+
- 点击 [XuanCe GitHub 页面](https://github.com/agi-brain/xuance) 右上角的 “Fork” 按钮,将仓库复制到您的账户下。
33+
34+
2. **克隆您的 Fork:**
35+
```bash
36+
git clone https://github.com/您的用户名/xuance.git
37+
cd xuance
38+
39+
3. **创建新分支:**
40+
```bash
41+
git checkout -b 您的分支名称
42+
```
43+
44+
4. **更改您的代码:**
45+
- 接下来在您本地对克隆下来的代码进行修改。
46+
- 注意保持代码风格和 XuanCe 项目保持一致。
47+
48+
5. **运行测试:**
49+
- 确保所作改动正常通过测试。
50+
- 可在项目主目录下的``./tests``文件夹中新增测试用例(如有需要)。
51+
52+
6. **提交更改:**
53+
```bash
54+
git add .
55+
git commit -m '简要描述您的更改'
56+
```
57+
58+
7. **推送到您的 Fork:**
59+
```bash
60+
git push origin 您的分支名称
61+
```
62+
63+
8. **创建 Pull Request:**
64+
- 前往您的仓库页面。
65+
- 点击“Compare & pull request”按钮。
66+
- 填写 PR 标题和详细描述,解释您的更改内容和目的。
67+
- 提交 PR。
68+
69+
### 代码风格
70+
71+
请遵循以下代码风格指南,以确保代码的一致性和可读性:
72+
- PEP 8 标准: 遵循 PEP 8 Python 代码风格指南。
73+
- 命名约定: 使用有意义的变量和函数名称,遵循驼峰命名法或下划线命名法。
74+
- 文档字符串: 为所有公共模块、类和函数编写清晰的文档字符串。
75+
- 注释: 对复杂的代码段添加注释,解释其功能和逻辑。
76+
77+
### 测试
78+
79+
确保您的贡献包含适当的测试。请按照以下步骤添加和运行测试:
80+
- 添加测试用例: 在 tests/ 目录下为新功能或修复添加测试用例。
81+
- 确保所有测试通过: 在提交 PR 前,确保所有测试均通过,并且没有引入新的错误。
82+
83+
### 文档贡献
84+
85+
贡献文档改进对我们非常重要。请按照以下步骤更新或添加文档:
86+
- 定位文档文件: 文档位于 docs/ 目录下。
87+
- 进行更改: 更新现有文档或添加新的文档文件。
88+
- 本地构建文档: 按照文档构建指南在本地预览您的更改。
89+
- 提交 PR: 确保您的文档更改清晰、格式正确,并在 PR 中说明改动内容。
90+
91+
### 许可证
92+
93+
通过贡献,您同意将您的贡献许可给 XuanCe 项目,根据 MIT 许可证进行授权。
94+
95+
### 联系方式
96+
如果您有任何问题或需要进一步的帮助,请通过以下方式与我们联系:
97+
- GitHub Issues: https://github.com/agi-brain/xuance/issues
98+
- QQ群:552432695
99+
- 微信公众号后台:"玄策 RLlib"
100+
- Discord: [https://discord.gg/HJn2TBQS7y](https://discord.gg/HJn2TBQS7y)
101+
- Slack: [https://join.slack.com/t/xuancerllib/](https://join.slack.com/t/xuancerllib/shared_invite/zt-2x2r98msi-iMX6mSVcgWwXYj95abcXIw)
102+
103+
感谢您的贡献和支持!通过您的帮助,XuanCe 将变得更加强大和实用。

0 commit comments

Comments
 (0)