Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there any description of the structure of this package? #255

Open
xinyu-66 opened this issue Oct 2, 2023 · 3 comments
Open

Is there any description of the structure of this package? #255

xinyu-66 opened this issue Oct 2, 2023 · 3 comments

Comments

@xinyu-66
Copy link

xinyu-66 commented Oct 2, 2023

Hi, I want to know if there is any documentations about the structure of this package? There are many inheritances among the files, I still do not know which file is used for updating observations, running episode. Is there any description documents to learn this package quickly?

@Denys88
Copy link
Owner

Denys88 commented Oct 9, 2023

Hi! Ill answer in a couple of days.

@Denys88
Copy link
Owner

Denys88 commented Nov 22, 2023

I am sorry for a huge delay. I still remember about you.

@xinyu-66
Copy link
Author

I am sorry for a huge delay. I still remember about you.

Hi, Denys, do not worry. I have already had some experience in this field, and now I am trying to add a new model for generating visual representations, which are used as input for the agent.

I have noticed that reinforcement learning is more complicated than deep learning, and it is very hard to package the pipeline completely and fully at the same time. In addition, I still want to suggest adding some explanations for the packages' structure or opening one tutorial with a very simple version without running mean std or so. In the beginning, I was used to calling neural network as model, so I took some time to understand the network_builder.py and model_builder.py.

Anyway, this package is great, and the community is still active, my wish is to give more descriptions and lower the barrier for many beginners.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants