Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Passing info from Actor to Agent in Async implementation? #105

Open
Louis-Bagot opened this issue Jan 11, 2021 · 0 comments
Open

Passing info from Actor to Agent in Async implementation? #105

Louis-Bagot opened this issue Jan 11, 2021 · 0 comments

Comments

@Louis-Bagot
Copy link

Louis-Bagot commented Jan 11, 2021

Hello!
In the Async version of the DQN(etc) implementation, I was wondering if there is a good way to pass information from the asynchronous Actor to the agent. In my case, I would like to use the logger to print some info about inner workings of the Actor (action probas), but in the general case, I think it can often make sense to pass some print/plot/debug data from one to the other. For example, I can also think of the total number of steps, which is computed from the number of passed transitions; but this isn't very robust for me since I push additional transitions to the entries in the _transition method.
Would it make sense to add a PASS_INFO operation along with the STEP/NETWORKS... operations from the async Actor? And the Agent could grab said info at will.
Thanks in advance for any help!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant